Aug 09 16:28:52 user nova-compute[73091]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 09 16:28:54 user nova-compute[73091]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73091) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 16:28:54 user nova-compute[73091]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73091) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 16:28:54 user nova-compute[73091]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73091) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 16:28:54 user nova-compute[73091]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 09 16:28:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:28:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:28:54 user nova-compute[73091]: INFO nova.virt.driver [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 09 16:28:55 user nova-compute[73091]: INFO nova.compute.provider_config [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] Acquiring lock "singleton_lock" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] Acquired lock "singleton_lock" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] Releasing lock "singleton_lock" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] Full set of CONF: {{(pid=73091) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ******************************************************************************** {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] Configuration options gathered from: {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ================================================================================ {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] allow_resize_to_same_host      = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] arq_binding_timeout            = 300 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] backdoor_port                  = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] backdoor_socket                = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] block_device_allocate_retries  = 300 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] block_device_allocate_retries_interval = 5 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cert                           = self.pem {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] compute_monitors               = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] config_dir                     = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] config_drive_format            = iso9660 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] config_source                  = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] console_host                   = user {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] control_exchange               = nova {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cpu_allocation_ratio           = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] daemon                         = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] debug                          = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] default_access_ip_network_name = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] default_availability_zone      = nova {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] default_ephemeral_format       = ext4 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] default_schedule_zone          = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] disk_allocation_ratio          = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] enable_new_services            = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] enabled_ssl_apis               = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] flat_injected                  = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] force_config_drive             = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] force_raw_images               = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] graceful_shutdown_timeout      = 5 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] heal_instance_info_cache_interval = 60 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] host                           = user {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] instance_build_timeout         = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] instance_delete_interval       = 300 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] instance_name_template         = instance-%08x {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] instance_usage_audit           = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] instance_usage_audit_period    = month {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] internal_service_availability_zone = internal {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] key                            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] live_migration_retry_count     = 30 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] log_config_append              = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] log_dir                        = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] log_file                       = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] log_options                    = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] log_rotate_interval            = 1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] log_rotate_interval_type       = days {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] log_rotation_type              = none {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] long_rpc_timeout               = 1800 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] max_concurrent_builds          = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] max_concurrent_live_migrations = 1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] max_concurrent_snapshots       = 5 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] max_local_block_devices        = 3 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] max_logfile_count              = 30 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] max_logfile_size_mb            = 200 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] maximum_instance_delete_attempts = 5 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] metadata_listen                = 0.0.0.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] metadata_listen_port           = 8775 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] metadata_workers               = 3 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] migrate_max_retries            = -1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] mkisofs_cmd                    = genisoimage {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] my_ip                          = 10.0.0.210 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] network_allocate_retries       = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] osapi_compute_listen_port      = 8774 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] osapi_compute_unique_server_name_scope =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] osapi_compute_workers          = 3 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] password_length                = 12 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] periodic_enable                = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] periodic_fuzzy_delay           = 60 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] pointer_model                  = ps2mouse {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] preallocate_images             = none {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] publish_errors                 = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] pybasedir                      = /opt/stack/nova {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ram_allocation_ratio           = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] rate_limit_burst               = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] rate_limit_except_level        = CRITICAL {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] rate_limit_interval            = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] reboot_timeout                 = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] reclaim_instance_interval      = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] record                         = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] reimage_timeout_per_gb         = 60 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] report_interval                = 120 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] rescue_timeout                 = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] reserved_host_cpus             = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] reserved_host_disk_mb          = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] reserved_host_memory_mb        = 512 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] reserved_huge_pages            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] resize_confirm_window          = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] resize_fs_using_block_device   = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] resume_guests_state_on_host_boot = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] rpc_response_timeout           = 60 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] run_external_periodic_tasks    = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] running_deleted_instance_action = reap {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] running_deleted_instance_timeout = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] scheduler_instance_sync_interval = 120 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] service_down_time              = 720 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] servicegroup_driver            = db {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] shelved_offload_time           = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] shelved_poll_interval          = 3600 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] shutdown_timeout               = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] source_is_ipv6                 = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ssl_only                       = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] state_path                     = /opt/stack/data/nova {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] sync_power_state_interval      = 600 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] sync_power_state_pool_size     = 1000 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] syslog_log_facility            = LOG_USER {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] tempdir                        = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] timeout_nbd                    = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] transport_url                  = **** {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] update_resources_interval      = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] use_cow_images                 = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] use_eventlog                   = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] use_journal                    = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] use_json                       = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] use_rootwrap_daemon            = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] use_stderr                     = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] use_syslog                     = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vcpu_pin_set                   = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vif_plugging_is_fatal          = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vif_plugging_timeout           = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] virt_mkfs                      = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] volume_usage_poll_interval     = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] watch_log_file                 = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] web                            = /usr/share/spice-html5 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_concurrency.disable_process_locking = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.auth_strategy              = keystone {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.compute_link_prefix        = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.dhcp_domain                = novalocal {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.enable_instance_password   = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.glance_link_prefix         = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.instance_list_per_project_cells = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.list_records_by_skipping_down_cells = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.local_metadata_per_cell    = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.max_limit                  = 1000 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.metadata_cache_expiration  = 15 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.neutron_default_tenant_id  = default {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.use_forwarded_for          = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.use_neutron_default_nets   = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.vendordata_dynamic_targets = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.vendordata_jsonfile_path   = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.backend_argument         = **** {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.config_prefix            = cache.oslo {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.dead_timeout             = 60.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.debug_cache_backend      = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.enable_retry_client      = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.enable_socket_keepalive  = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.enabled                  = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.expiration_time          = 600 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.hashclient_retry_attempts = 2 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.memcache_dead_retry      = 300 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.memcache_password        =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.memcache_sasl_enabled    = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.memcache_username        =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.proxies                  = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.retry_attempts           = 2 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.retry_delay              = 0.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.socket_keepalive_count   = 1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.socket_keepalive_idle    = 1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.socket_keepalive_interval = 1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.tls_allowed_ciphers      = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.tls_cafile               = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.tls_certfile             = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.tls_enabled              = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cache.tls_keyfile              = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cinder.auth_section            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cinder.auth_type               = password {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cinder.cafile                  = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cinder.certfile                = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cinder.collect_timing          = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cinder.cross_az_attach         = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cinder.debug                   = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cinder.endpoint_template       = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cinder.http_retries            = 3 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cinder.insecure                = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cinder.keyfile                 = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cinder.os_region_name          = RegionOne {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cinder.split_loggers           = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cinder.timeout                 = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] compute.cpu_dedicated_set      = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] compute.cpu_shared_set         = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] compute.image_type_exclude_list = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] compute.resource_provider_association_refresh = 300 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] compute.shutdown_retry_interval = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] conductor.workers              = 3 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] console.allowed_origins        = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] console.ssl_ciphers            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] console.ssl_minimum_version    = default {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] consoleauth.token_ttl          = 600 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cyborg.cafile                  = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cyborg.certfile                = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cyborg.collect_timing          = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cyborg.connect_retries         = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cyborg.connect_retry_delay     = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cyborg.endpoint_override       = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cyborg.insecure                = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cyborg.keyfile                 = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cyborg.max_version             = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cyborg.min_version             = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cyborg.region_name             = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cyborg.service_name            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cyborg.service_type            = accelerator {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cyborg.split_loggers           = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cyborg.status_code_retries     = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cyborg.status_code_retry_delay = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cyborg.timeout                 = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] cyborg.version                 = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] database.backend               = sqlalchemy {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] database.connection            = **** {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] database.connection_debug      = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] database.connection_parameters =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] database.connection_recycle_time = 3600 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] database.connection_trace      = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] database.db_inc_retry_interval = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] database.db_max_retries        = 20 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] database.db_max_retry_interval = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] database.db_retry_interval     = 1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] database.max_overflow          = 50 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] database.max_pool_size         = 5 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] database.max_retries           = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] database.mysql_enable_ndb      = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] database.mysql_wsrep_sync_wait = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] database.pool_timeout          = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] database.retry_interval        = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] database.slave_connection      = **** {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] database.sqlite_synchronous    = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api_database.backend           = sqlalchemy {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api_database.connection        = **** {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api_database.connection_debug  = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api_database.connection_parameters =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api_database.connection_recycle_time = 3600 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api_database.connection_trace  = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api_database.db_inc_retry_interval = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api_database.db_max_retries    = 20 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api_database.db_max_retry_interval = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api_database.db_retry_interval = 1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api_database.max_overflow      = 50 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api_database.max_pool_size     = 5 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api_database.max_retries       = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api_database.mysql_enable_ndb  = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api_database.pool_timeout      = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api_database.retry_interval    = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api_database.slave_connection  = **** {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] api_database.sqlite_synchronous = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] devices.enabled_mdev_types     = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ephemeral_storage_encryption.enabled = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.api_servers             = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.cafile                  = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.certfile                = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.collect_timing          = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.connect_retries         = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.connect_retry_delay     = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.debug                   = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.default_trusted_certificate_ids = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.enable_certificate_validation = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.enable_rbd_download     = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.endpoint_override       = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.insecure                = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.keyfile                 = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.max_version             = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.min_version             = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.num_retries             = 3 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.rbd_ceph_conf           =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.rbd_connect_timeout     = 5 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.rbd_pool                =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.rbd_user                =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.region_name             = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.service_name            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.service_type            = image {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.split_loggers           = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.status_code_retries     = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.status_code_retry_delay = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.timeout                 = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.verify_glance_signatures = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] glance.version                 = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] guestfs.debug                  = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] hyperv.config_drive_cdrom      = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] hyperv.config_drive_inject_password = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] hyperv.enable_remotefx         = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] hyperv.instances_path_share    =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] hyperv.limit_cpu_features      = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] hyperv.use_multipath_io        = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] hyperv.vswitch_name            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] mks.enabled                    = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] image_cache.manager_interval   = 2400 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] image_cache.precache_concurrency = 1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] image_cache.remove_unused_base_images = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] image_cache.subdirectory_name  = _base {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.api_max_retries         = 60 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.api_retry_interval      = 2 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.auth_section            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.auth_type               = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.cafile                  = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.certfile                = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.collect_timing          = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.connect_retries         = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.connect_retry_delay     = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.endpoint_override       = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.insecure                = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.keyfile                 = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.max_version             = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.min_version             = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.partition_key           = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.peer_list               = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.region_name             = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.serial_console_state_timeout = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.service_name            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.service_type            = baremetal {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.split_loggers           = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.status_code_retries     = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.status_code_retry_delay = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.timeout                 = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ironic.version                 = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] key_manager.fixed_key          = **** {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican.barbican_api_version  = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican.barbican_endpoint     = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican.barbican_endpoint_type = public {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican.barbican_region_name  = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican.cafile                = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican.certfile              = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican.collect_timing        = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican.insecure              = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican.keyfile               = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican.number_of_retries     = 60 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican.retry_delay           = 1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican.send_service_user_token = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican.split_loggers         = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican.timeout               = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican.verify_ssl            = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican.verify_ssl_path       = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican_service_user.auth_section = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican_service_user.auth_type = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican_service_user.cafile   = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican_service_user.certfile = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican_service_user.collect_timing = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican_service_user.insecure = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican_service_user.keyfile  = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican_service_user.split_loggers = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] barbican_service_user.timeout  = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vault.approle_role_id          = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vault.approle_secret_id        = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vault.cafile                   = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vault.certfile                 = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vault.collect_timing           = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vault.insecure                 = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vault.keyfile                  = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vault.kv_mountpoint            = secret {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vault.kv_version               = 2 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vault.namespace                = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vault.root_token_id            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vault.split_loggers            = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vault.ssl_ca_crt_file          = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vault.timeout                  = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vault.use_ssl                  = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] keystone.cafile                = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] keystone.certfile              = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] keystone.collect_timing        = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] keystone.connect_retries       = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] keystone.connect_retry_delay   = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] keystone.endpoint_override     = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] keystone.insecure              = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] keystone.keyfile               = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] keystone.max_version           = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] keystone.min_version           = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] keystone.region_name           = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] keystone.service_name          = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] keystone.service_type          = identity {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] keystone.split_loggers         = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] keystone.status_code_retries   = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] keystone.status_code_retry_delay = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] keystone.timeout               = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] keystone.version               = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.connection_uri         =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.cpu_mode               = custom {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: WARNING oslo_config.cfg [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.cpu_power_governor_high = performance {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.cpu_power_management   = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.device_detach_attempts = 8 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.device_detach_timeout  = 20 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.disk_cachemodes        = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.disk_prefix            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.enabled_perf_events    = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.file_backed_memory     = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.gid_maps               = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.hw_disk_discard        = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.hw_machine_type        = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.images_rbd_pool        = rbd {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.images_type            = default {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.images_volume_group    = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.inject_key             = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.inject_partition       = -2 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.inject_password        = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.iscsi_iface            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.iser_use_multipath     = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.live_migration_downtime = 500 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.live_migration_inbound_addr = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.live_migration_scheme  = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.live_migration_timeout_action = abort {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.live_migration_tunnelled = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: WARNING oslo_config.cfg [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 09 16:28:55 user nova-compute[73091]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 09 16:28:55 user nova-compute[73091]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 09 16:28:55 user nova-compute[73091]: and ``live_migration_inbound_addr`` respectively.
Aug 09 16:28:55 user nova-compute[73091]: ).  Its value may be silently ignored in the future.
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.live_migration_with_native_tls = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.max_queues             = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.nfs_mount_options      = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.num_pcie_ports         = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.pmem_namespaces        = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.quobyte_client_cfg     = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.rbd_secret_uuid        = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.rbd_user               = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.rescue_image_id        = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.rescue_kernel_id       = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.rx_queue_size          = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.smbfs_mount_options    =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.snapshot_compression   = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.snapshot_image_format  = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.sparse_logical_volumes = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.swtpm_enabled          = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.swtpm_group            = tss {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.swtpm_user             = tss {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.sysinfo_serial         = unique {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.tb_cache_size          = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.tx_queue_size          = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.uid_maps               = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.use_virtio_for_bridges = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.virt_type              = kvm {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.volume_clear           = zero {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.volume_clear_size      = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.volume_use_multipath   = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.vzstorage_cache_path   = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.auth_section           = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.auth_type              = password {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.cafile                 = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.certfile               = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.collect_timing         = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.connect_retries        = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.connect_retry_delay    = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.default_floating_pool  = public {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.endpoint_override      = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.extension_sync_interval = 600 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.http_retries           = 3 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.insecure               = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.keyfile                = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.max_version            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.min_version            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.ovs_bridge             = br-int {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.physnets               = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.region_name            = RegionOne {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.service_metadata_proxy = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.service_name           = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.service_type           = network {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.split_loggers          = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.status_code_retries    = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.status_code_retry_delay = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.timeout                = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] neutron.version                = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] notifications.bdms_in_notifications = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] notifications.default_level    = INFO {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] notifications.notification_format = unversioned {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] notifications.notify_on_state_change = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] pci.alias                      = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] pci.device_spec                = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] pci.report_in_placement        = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.auth_section         = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.auth_type            = password {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.cafile               = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.certfile             = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.collect_timing       = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.connect_retries      = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.connect_retry_delay  = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.default_domain_id    = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.default_domain_name  = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.domain_id            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.domain_name          = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.endpoint_override    = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.insecure             = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.keyfile              = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.max_version          = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.min_version          = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.password             = **** {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.project_domain_id    = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.project_domain_name  = Default {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.project_id           = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.project_name         = service {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.region_name          = RegionOne {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.service_name         = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.service_type         = placement {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.split_loggers        = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.status_code_retries  = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.status_code_retry_delay = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.system_scope         = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.timeout              = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.trust_id             = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.user_domain_id       = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.user_domain_name     = Default {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.user_id              = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.username             = placement {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] placement.version              = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] quota.cores                    = 20 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] quota.count_usage_from_placement = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] quota.injected_file_content_bytes = 10240 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] quota.injected_file_path_length = 255 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] quota.injected_files           = 5 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] quota.instances                = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] quota.key_pairs                = 100 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] quota.metadata_items           = 128 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] quota.ram                      = 51200 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] quota.recheck_quota            = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] quota.server_group_members     = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] quota.server_groups            = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] rdp.enabled                    = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] scheduler.image_metadata_prefilter = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] scheduler.max_attempts         = 3 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] scheduler.max_placement_results = 1000 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] scheduler.workers              = 3 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.host_subset_size = 1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.isolated_hosts = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.isolated_images = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.pci_in_placement = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.track_instance_changes = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] metrics.required               = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] metrics.weight_multiplier      = 1.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] metrics.weight_setting         = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] serial_console.enabled         = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] serial_console.port_range      = 10000:20000 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] serial_console.serialproxy_port = 6083 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] service_user.auth_section      = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] service_user.auth_type         = password {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] service_user.cafile            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] service_user.certfile          = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] service_user.collect_timing    = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] service_user.insecure          = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] service_user.keyfile           = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] service_user.send_service_user_token = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] service_user.split_loggers     = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] service_user.timeout           = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] spice.agent_enabled            = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] spice.enabled                  = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] spice.html5proxy_port          = 6082 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] spice.image_compression        = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] spice.jpeg_compression         = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] spice.playback_compression     = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] spice.server_listen            = 127.0.0.1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] spice.streaming_mode           = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] spice.zlib_compression         = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] upgrade_levels.baseapi         = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] upgrade_levels.cert            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] upgrade_levels.compute         = auto {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] upgrade_levels.conductor       = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] upgrade_levels.scheduler       = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vendordata_dynamic_auth.cafile = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vendordata_dynamic_auth.certfile = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vendordata_dynamic_auth.insecure = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vendordata_dynamic_auth.timeout = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.api_retry_count         = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.ca_file                 = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.cache_prefix            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.cluster_name            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.connection_pool_size    = 10 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.console_delay_seconds   = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.datastore_regex         = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.host_ip                 = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.host_password           = **** {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.host_port               = 443 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.host_username           = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.insecure                = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.integration_bridge      = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.maximum_objects         = 100 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.pbm_default_policy      = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.pbm_enabled             = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.pbm_wsdl_location       = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.serial_port_proxy_uri   = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.serial_port_service_uri = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.task_poll_interval      = 0.5 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.use_linked_clone        = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.vnc_keymap              = en-us {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.vnc_port                = 5900 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vmware.vnc_port_total          = 10000 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vnc.auth_schemes               = ['none'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vnc.enabled                    = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vnc.novncproxy_port            = 6080 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vnc.vencrypt_ca_certs          = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vnc.vencrypt_client_cert       = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vnc.vencrypt_client_key        = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] workarounds.disable_rootwrap   = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] workarounds.enable_numa_live_migration = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] workarounds.libvirt_disable_apic = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] wsgi.client_socket_timeout     = 900 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] wsgi.default_pool_size         = 1000 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] wsgi.keep_alive                = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] wsgi.max_header_line           = 16384 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] wsgi.ssl_ca_file               = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] wsgi.ssl_cert_file             = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] wsgi.ssl_key_file              = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] wsgi.tcp_keepidle              = 600 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] zvm.ca_file                    = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] zvm.cloud_connector_url        = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] zvm.reachable_timeout          = 300 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_policy.enforce_new_defaults = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_policy.enforce_scope      = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_policy.policy_default_rule = default {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] profiler.connection_string     = messaging:// {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] profiler.enabled               = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] profiler.es_doc_type           = notification {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] profiler.es_scroll_size        = 10000 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] profiler.es_scroll_time        = 2m {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] profiler.filter_error_trace    = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] profiler.hmac_keys             = **** {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] profiler.sentinel_service_name = mymaster {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] profiler.socket_timeout        = 0.1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] profiler.trace_requests        = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] profiler.trace_sqlalchemy      = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] profiler_jaeger.process_tags   = {} {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] profiler_jaeger.service_name_prefix = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] profiler_otlp.service_name_prefix = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] remote_debug.host              = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] remote_debug.port              = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_notifications.retry = -1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.auth_section        = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.auth_type           = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.cafile              = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.certfile            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.collect_timing      = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.connect_retries     = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.connect_retry_delay = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.endpoint_id         = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.endpoint_override   = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.insecure            = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.keyfile             = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.max_version         = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.min_version         = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.region_name         = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.service_name        = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.service_type        = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.split_loggers       = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.status_code_retries = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.status_code_retry_delay = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.timeout             = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.valid_interfaces    = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_limit.version             = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_reports.file_event_handler = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] oslo_reports.log_dir           = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vif_plug_ovs_privileged.group  = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] vif_plug_ovs_privileged.user   = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] os_vif_ovs.isolate_vif         = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] os_brick.lock_path             = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] privsep_osbrick.capabilities   = [21] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] privsep_osbrick.group          = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] privsep_osbrick.helper_command = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] privsep_osbrick.user           = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] nova_sys_admin.group           = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] nova_sys_admin.helper_command  = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] nova_sys_admin.user            = None {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG oslo_service.service [None req-c976a51d-6c89-4b7f-8c0d-0c4b3d191743 None None] ******************************************************************************** {{(pid=73091) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 09 16:28:55 user nova-compute[73091]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 09 16:28:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Starting native event thread {{(pid=73091) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Starting green dispatch thread {{(pid=73091) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Starting connection event dispatch thread {{(pid=73091) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Connecting to libvirt: qemu:///system {{(pid=73091) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7ff08c1f4b50> {{(pid=73091) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 09 16:28:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7ff08c1f4b50> {{(pid=73091) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 09 16:28:55 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Connection event '1' reason 'None'
Aug 09 16:28:55 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 09 16:28:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.mount [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Initialising _HostMountState generation 0 {{(pid=73091) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 09 16:29:02 user nova-compute[73091]: INFO nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Libvirt host capabilities <capabilities>
Aug 09 16:29:02 user nova-compute[73091]:   <host>
Aug 09 16:29:02 user nova-compute[73091]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 09 16:29:02 user nova-compute[73091]:     <cpu>
Aug 09 16:29:02 user nova-compute[73091]:       <arch>x86_64</arch>
Aug 09 16:29:02 user nova-compute[73091]:       <model>IvyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 09 16:29:02 user nova-compute[73091]:       <microcode version='1070'/>
Aug 09 16:29:02 user nova-compute[73091]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 09 16:29:02 user nova-compute[73091]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature name='ss'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature name='vmx'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature name='pcid'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature name='osxsave'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature name='hypervisor'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature name='arat'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature name='tsc_adjust'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature name='md-clear'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature name='stibp'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature name='arch-capabilities'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature name='ssbd'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature name='invtsc'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature name='rsba'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature name='skip-l1dfl-vmentry'/>
Aug 09 16:29:02 user nova-compute[73091]:       <pages unit='KiB' size='4'/>
Aug 09 16:29:02 user nova-compute[73091]:       <pages unit='KiB' size='2048'/>
Aug 09 16:29:02 user nova-compute[73091]:     </cpu>
Aug 09 16:29:02 user nova-compute[73091]:     <power_management>
Aug 09 16:29:02 user nova-compute[73091]:       <suspend_mem/>
Aug 09 16:29:02 user nova-compute[73091]:       <suspend_disk/>
Aug 09 16:29:02 user nova-compute[73091]:       <suspend_hybrid/>
Aug 09 16:29:02 user nova-compute[73091]:     </power_management>
Aug 09 16:29:02 user nova-compute[73091]:     <iommu support='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     <migration_features>
Aug 09 16:29:02 user nova-compute[73091]:       <live/>
Aug 09 16:29:02 user nova-compute[73091]:       <uri_transports>
Aug 09 16:29:02 user nova-compute[73091]:         <uri_transport>tcp</uri_transport>
Aug 09 16:29:02 user nova-compute[73091]:         <uri_transport>rdma</uri_transport>
Aug 09 16:29:02 user nova-compute[73091]:       </uri_transports>
Aug 09 16:29:02 user nova-compute[73091]:     </migration_features>
Aug 09 16:29:02 user nova-compute[73091]:     <topology>
Aug 09 16:29:02 user nova-compute[73091]:       <cells num='2'>
Aug 09 16:29:02 user nova-compute[73091]:         <cell id='0'>
Aug 09 16:29:02 user nova-compute[73091]:           <memory unit='KiB'>8189224</memory>
Aug 09 16:29:02 user nova-compute[73091]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 09 16:29:02 user nova-compute[73091]:           <pages unit='KiB' size='2048'>0</pages>
Aug 09 16:29:02 user nova-compute[73091]:           <distances>
Aug 09 16:29:02 user nova-compute[73091]:             <sibling id='0' value='10'/>
Aug 09 16:29:02 user nova-compute[73091]:             <sibling id='1' value='20'/>
Aug 09 16:29:02 user nova-compute[73091]:           </distances>
Aug 09 16:29:02 user nova-compute[73091]:           <cpus num='6'>
Aug 09 16:29:02 user nova-compute[73091]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 09 16:29:02 user nova-compute[73091]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 09 16:29:02 user nova-compute[73091]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 09 16:29:02 user nova-compute[73091]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 09 16:29:02 user nova-compute[73091]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 09 16:29:02 user nova-compute[73091]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 09 16:29:02 user nova-compute[73091]:           </cpus>
Aug 09 16:29:02 user nova-compute[73091]:         </cell>
Aug 09 16:29:02 user nova-compute[73091]:         <cell id='1'>
Aug 09 16:29:02 user nova-compute[73091]:           <memory unit='KiB'>8206460</memory>
Aug 09 16:29:02 user nova-compute[73091]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 09 16:29:02 user nova-compute[73091]:           <pages unit='KiB' size='2048'>0</pages>
Aug 09 16:29:02 user nova-compute[73091]:           <distances>
Aug 09 16:29:02 user nova-compute[73091]:             <sibling id='0' value='20'/>
Aug 09 16:29:02 user nova-compute[73091]:             <sibling id='1' value='10'/>
Aug 09 16:29:02 user nova-compute[73091]:           </distances>
Aug 09 16:29:02 user nova-compute[73091]:           <cpus num='6'>
Aug 09 16:29:02 user nova-compute[73091]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 09 16:29:02 user nova-compute[73091]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 09 16:29:02 user nova-compute[73091]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 09 16:29:02 user nova-compute[73091]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 09 16:29:02 user nova-compute[73091]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 09 16:29:02 user nova-compute[73091]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 09 16:29:02 user nova-compute[73091]:           </cpus>
Aug 09 16:29:02 user nova-compute[73091]:         </cell>
Aug 09 16:29:02 user nova-compute[73091]:       </cells>
Aug 09 16:29:02 user nova-compute[73091]:     </topology>
Aug 09 16:29:02 user nova-compute[73091]:     <cache>
Aug 09 16:29:02 user nova-compute[73091]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 09 16:29:02 user nova-compute[73091]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 09 16:29:02 user nova-compute[73091]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 09 16:29:02 user nova-compute[73091]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 09 16:29:02 user nova-compute[73091]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 09 16:29:02 user nova-compute[73091]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 09 16:29:02 user nova-compute[73091]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 09 16:29:02 user nova-compute[73091]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 09 16:29:02 user nova-compute[73091]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 09 16:29:02 user nova-compute[73091]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 09 16:29:02 user nova-compute[73091]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 09 16:29:02 user nova-compute[73091]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 09 16:29:02 user nova-compute[73091]:     </cache>
Aug 09 16:29:02 user nova-compute[73091]:     <secmodel>
Aug 09 16:29:02 user nova-compute[73091]:       <model>apparmor</model>
Aug 09 16:29:02 user nova-compute[73091]:       <doi>0</doi>
Aug 09 16:29:02 user nova-compute[73091]:     </secmodel>
Aug 09 16:29:02 user nova-compute[73091]:     <secmodel>
Aug 09 16:29:02 user nova-compute[73091]:       <model>dac</model>
Aug 09 16:29:02 user nova-compute[73091]:       <doi>0</doi>
Aug 09 16:29:02 user nova-compute[73091]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 09 16:29:02 user nova-compute[73091]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 09 16:29:02 user nova-compute[73091]:     </secmodel>
Aug 09 16:29:02 user nova-compute[73091]:   </host>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='alpha'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>clipper</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='armv6l'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>spitz</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>nuri</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>kzm</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>sx1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>z2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>tosa</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>n810</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>n800</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>terrier</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>midway</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>microbit</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>verdex</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>highbank</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>akita</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>connex</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>collie</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='armv7l'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>spitz</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>nuri</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>kzm</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>sx1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>z2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>tosa</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>n810</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>n800</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>terrier</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>midway</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>microbit</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>verdex</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>highbank</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>akita</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>connex</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>collie</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='aarch64'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>spitz</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>nuri</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>kzm</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>sx1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>z2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>tosa</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>n810</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>n800</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>terrier</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>midway</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>microbit</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>verdex</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>raspi3b</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>highbank</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>akita</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>connex</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>collie</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <acpi default='on' toggle='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='cris'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='i686'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>x-remote</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>isapc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>microvm</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='kvm'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <pae/>
Aug 09 16:29:02 user nova-compute[73091]:       <nonpae/>
Aug 09 16:29:02 user nova-compute[73091]:       <acpi default='on' toggle='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:       <apic default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='m68k'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>an5206</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>q800</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>next-cube</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='microblaze'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='microblazeel'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='mips'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='16'>malta</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='mipsel'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='16'>malta</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='mips64'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='16'>malta</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>pica61</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>magnum</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='mips64el'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='16'>malta</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>pica61</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>magnum</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='16'>boston</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='ppc'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mac99</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>40p</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>taihu</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='ppc64'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2048'>powernv9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>taihu</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2048'>powernv10</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>40p</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mac99</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2048'>powernv8</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='ppc64le'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2048'>powernv9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>taihu</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2048'>powernv10</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>40p</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>mac99</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2048'>powernv8</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='riscv32'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='8'>spike</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>opentitan</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='5'>sifive_u</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>sifive_e</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='8'>virt</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='riscv64'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='8'>spike</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='5'>sifive_u</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>shakti_c</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>sifive_e</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='8'>virt</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='s390x'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='sh4'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>shix</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>r2d</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='sh4eb'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>shix</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>r2d</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='sparc'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>SS-5</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>SS-20</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>LX</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>SS-4</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>SS-10</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>Voyager</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='sparc64'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>sun4u</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>niagara</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>sun4v</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='x86_64'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>x-remote</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='1'>isapc</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>microvm</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='kvm'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <acpi default='on' toggle='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:       <apic default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='xtensa'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>sim</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>kc705</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>ml605</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>virt</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>lx200</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>lx60</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]:   <guest>
Aug 09 16:29:02 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 09 16:29:02 user nova-compute[73091]:     <arch name='xtensaeb'>
Aug 09 16:29:02 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 09 16:29:02 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='4'>sim</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>kc705</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>ml605</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>virt</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>lx200</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>lx60</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 09 16:29:02 user nova-compute[73091]:       <domain type='qemu'/>
Aug 09 16:29:02 user nova-compute[73091]:     </arch>
Aug 09 16:29:02 user nova-compute[73091]:     <features>
Aug 09 16:29:02 user nova-compute[73091]:       <cpuselection/>
Aug 09 16:29:02 user nova-compute[73091]:       <deviceboot/>
Aug 09 16:29:02 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     </features>
Aug 09 16:29:02 user nova-compute[73091]:   </guest>
Aug 09 16:29:02 user nova-compute[73091]: </capabilities>
Aug 09 16:29:02 user nova-compute[73091]: 
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 09 16:29:02 user nova-compute[73091]: <domainCapabilities>
Aug 09 16:29:02 user nova-compute[73091]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 16:29:02 user nova-compute[73091]:   <domain>kvm</domain>
Aug 09 16:29:02 user nova-compute[73091]:   <machine>pc-q35-6.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:   <arch>i686</arch>
Aug 09 16:29:02 user nova-compute[73091]:   <vcpu max='288'/>
Aug 09 16:29:02 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:   <os supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:     <enum name='firmware'/>
Aug 09 16:29:02 user nova-compute[73091]:     <loader supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='type'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>rom</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>pflash</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='readonly'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>yes</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>no</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='secure'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>no</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </loader>
Aug 09 16:29:02 user nova-compute[73091]:   </os>
Aug 09 16:29:02 user nova-compute[73091]:   <cpu>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>off</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>on</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>off</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='disable' name='lm'/>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>kvm64</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>core2duo</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Westmere</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Penryn</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G1</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Nehalem</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Conroe</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:   </cpu>
Aug 09 16:29:02 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:     <enum name='sourceType'>
Aug 09 16:29:02 user nova-compute[73091]:       <value>file</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>anonymous</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>memfd</value>
Aug 09 16:29:02 user nova-compute[73091]:     </enum>
Aug 09 16:29:02 user nova-compute[73091]:   </memoryBacking>
Aug 09 16:29:02 user nova-compute[73091]:   <devices>
Aug 09 16:29:02 user nova-compute[73091]:     <disk supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>disk</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>cdrom</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>floppy</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>lun</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='bus'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>fdc</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>scsi</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>usb</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>sata</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </disk>
Aug 09 16:29:02 user nova-compute[73091]:     <graphics supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='type'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>sdl</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vnc</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>spice</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>egl-headless</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </graphics>
Aug 09 16:29:02 user nova-compute[73091]:     <video supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='modelType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vga</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>cirrus</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vmvga</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>qxl</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>none</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>bochs</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>ramfb</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </video>
Aug 09 16:29:02 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='mode'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>subsystem</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>default</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>mandatory</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>requisite</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>optional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='subsysType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>usb</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>pci</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>scsi</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='capsType'/>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 09 16:29:02 user nova-compute[73091]:     </hostdev>
Aug 09 16:29:02 user nova-compute[73091]:     <rng supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>random</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>egd</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>builtin</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </rng>
Aug 09 16:29:02 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='driverType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>path</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>handle</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtiofs</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </filesystem>
Aug 09 16:29:02 user nova-compute[73091]:     <tpm supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>passthrough</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>emulator</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </tpm>
Aug 09 16:29:02 user nova-compute[73091]:   </devices>
Aug 09 16:29:02 user nova-compute[73091]:   <features>
Aug 09 16:29:02 user nova-compute[73091]:     <gic supported='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <genid supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <backup supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <sev supported='no'/>
Aug 09 16:29:02 user nova-compute[73091]:   </features>
Aug 09 16:29:02 user nova-compute[73091]: </domainCapabilities>
Aug 09 16:29:02 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 09 16:29:02 user nova-compute[73091]: <domainCapabilities>
Aug 09 16:29:02 user nova-compute[73091]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 16:29:02 user nova-compute[73091]:   <domain>kvm</domain>
Aug 09 16:29:02 user nova-compute[73091]:   <machine>pc-q35-jammy</machine>
Aug 09 16:29:02 user nova-compute[73091]:   <arch>i686</arch>
Aug 09 16:29:02 user nova-compute[73091]:   <vcpu max='288'/>
Aug 09 16:29:02 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:   <os supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:     <enum name='firmware'/>
Aug 09 16:29:02 user nova-compute[73091]:     <loader supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='type'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>rom</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>pflash</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='readonly'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>yes</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>no</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='secure'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>no</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </loader>
Aug 09 16:29:02 user nova-compute[73091]:   </os>
Aug 09 16:29:02 user nova-compute[73091]:   <cpu>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>off</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>on</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>off</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='disable' name='lm'/>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>kvm64</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>core2duo</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Westmere</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Penryn</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G1</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Nehalem</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Conroe</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:   </cpu>
Aug 09 16:29:02 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:     <enum name='sourceType'>
Aug 09 16:29:02 user nova-compute[73091]:       <value>file</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>anonymous</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>memfd</value>
Aug 09 16:29:02 user nova-compute[73091]:     </enum>
Aug 09 16:29:02 user nova-compute[73091]:   </memoryBacking>
Aug 09 16:29:02 user nova-compute[73091]:   <devices>
Aug 09 16:29:02 user nova-compute[73091]:     <disk supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>disk</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>cdrom</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>floppy</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>lun</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='bus'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>fdc</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>scsi</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>usb</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>sata</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </disk>
Aug 09 16:29:02 user nova-compute[73091]:     <graphics supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='type'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>sdl</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vnc</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>spice</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>egl-headless</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </graphics>
Aug 09 16:29:02 user nova-compute[73091]:     <video supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='modelType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vga</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>cirrus</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vmvga</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>qxl</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>none</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>bochs</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>ramfb</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </video>
Aug 09 16:29:02 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='mode'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>subsystem</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>default</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>mandatory</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>requisite</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>optional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='subsysType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>usb</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>pci</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>scsi</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='capsType'/>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 09 16:29:02 user nova-compute[73091]:     </hostdev>
Aug 09 16:29:02 user nova-compute[73091]:     <rng supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>random</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>egd</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>builtin</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </rng>
Aug 09 16:29:02 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='driverType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>path</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>handle</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtiofs</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </filesystem>
Aug 09 16:29:02 user nova-compute[73091]:     <tpm supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>passthrough</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>emulator</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </tpm>
Aug 09 16:29:02 user nova-compute[73091]:   </devices>
Aug 09 16:29:02 user nova-compute[73091]:   <features>
Aug 09 16:29:02 user nova-compute[73091]:     <gic supported='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <genid supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <backup supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <sev supported='no'/>
Aug 09 16:29:02 user nova-compute[73091]:   </features>
Aug 09 16:29:02 user nova-compute[73091]: </domainCapabilities>
Aug 09 16:29:02 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 09 16:29:02 user nova-compute[73091]: <domainCapabilities>
Aug 09 16:29:02 user nova-compute[73091]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 16:29:02 user nova-compute[73091]:   <domain>kvm</domain>
Aug 09 16:29:02 user nova-compute[73091]:   <machine>pc-i440fx-6.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:   <arch>i686</arch>
Aug 09 16:29:02 user nova-compute[73091]:   <vcpu max='255'/>
Aug 09 16:29:02 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:   <os supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:     <enum name='firmware'/>
Aug 09 16:29:02 user nova-compute[73091]:     <loader supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='type'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>rom</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>pflash</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='readonly'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>yes</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>no</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='secure'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>no</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </loader>
Aug 09 16:29:02 user nova-compute[73091]:   </os>
Aug 09 16:29:02 user nova-compute[73091]:   <cpu>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>off</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>on</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>off</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='disable' name='lm'/>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>kvm64</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>core2duo</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Westmere</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Penryn</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G1</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Nehalem</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Conroe</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:   </cpu>
Aug 09 16:29:02 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:     <enum name='sourceType'>
Aug 09 16:29:02 user nova-compute[73091]:       <value>file</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>anonymous</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>memfd</value>
Aug 09 16:29:02 user nova-compute[73091]:     </enum>
Aug 09 16:29:02 user nova-compute[73091]:   </memoryBacking>
Aug 09 16:29:02 user nova-compute[73091]:   <devices>
Aug 09 16:29:02 user nova-compute[73091]:     <disk supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>disk</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>cdrom</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>floppy</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>lun</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='bus'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>ide</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>fdc</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>scsi</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>usb</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>sata</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </disk>
Aug 09 16:29:02 user nova-compute[73091]:     <graphics supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='type'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>sdl</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vnc</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>spice</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>egl-headless</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </graphics>
Aug 09 16:29:02 user nova-compute[73091]:     <video supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='modelType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vga</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>cirrus</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vmvga</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>qxl</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>none</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>bochs</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>ramfb</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </video>
Aug 09 16:29:02 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='mode'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>subsystem</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>default</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>mandatory</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>requisite</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>optional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='subsysType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>usb</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>pci</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>scsi</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='capsType'/>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 09 16:29:02 user nova-compute[73091]:     </hostdev>
Aug 09 16:29:02 user nova-compute[73091]:     <rng supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>random</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>egd</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>builtin</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </rng>
Aug 09 16:29:02 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='driverType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>path</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>handle</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtiofs</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </filesystem>
Aug 09 16:29:02 user nova-compute[73091]:     <tpm supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>passthrough</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>emulator</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </tpm>
Aug 09 16:29:02 user nova-compute[73091]:   </devices>
Aug 09 16:29:02 user nova-compute[73091]:   <features>
Aug 09 16:29:02 user nova-compute[73091]:     <gic supported='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <genid supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <backup supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <sev supported='no'/>
Aug 09 16:29:02 user nova-compute[73091]:   </features>
Aug 09 16:29:02 user nova-compute[73091]: </domainCapabilities>
Aug 09 16:29:02 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 09 16:29:02 user nova-compute[73091]: <domainCapabilities>
Aug 09 16:29:02 user nova-compute[73091]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 16:29:02 user nova-compute[73091]:   <domain>kvm</domain>
Aug 09 16:29:02 user nova-compute[73091]:   <machine>pc-i440fx-jammy</machine>
Aug 09 16:29:02 user nova-compute[73091]:   <arch>i686</arch>
Aug 09 16:29:02 user nova-compute[73091]:   <vcpu max='255'/>
Aug 09 16:29:02 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:   <os supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:     <enum name='firmware'/>
Aug 09 16:29:02 user nova-compute[73091]:     <loader supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='type'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>rom</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>pflash</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='readonly'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>yes</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>no</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='secure'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>no</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </loader>
Aug 09 16:29:02 user nova-compute[73091]:   </os>
Aug 09 16:29:02 user nova-compute[73091]:   <cpu>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>off</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>on</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>off</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='disable' name='lm'/>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>kvm64</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>core2duo</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Westmere</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Penryn</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G1</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Nehalem</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Conroe</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:   </cpu>
Aug 09 16:29:02 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:     <enum name='sourceType'>
Aug 09 16:29:02 user nova-compute[73091]:       <value>file</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>anonymous</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>memfd</value>
Aug 09 16:29:02 user nova-compute[73091]:     </enum>
Aug 09 16:29:02 user nova-compute[73091]:   </memoryBacking>
Aug 09 16:29:02 user nova-compute[73091]:   <devices>
Aug 09 16:29:02 user nova-compute[73091]:     <disk supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>disk</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>cdrom</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>floppy</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>lun</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='bus'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>ide</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>fdc</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>scsi</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>usb</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>sata</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </disk>
Aug 09 16:29:02 user nova-compute[73091]:     <graphics supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='type'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>sdl</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vnc</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>spice</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>egl-headless</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </graphics>
Aug 09 16:29:02 user nova-compute[73091]:     <video supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='modelType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vga</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>cirrus</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vmvga</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>qxl</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>none</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>bochs</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>ramfb</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </video>
Aug 09 16:29:02 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='mode'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>subsystem</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>default</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>mandatory</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>requisite</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>optional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='subsysType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>usb</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>pci</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>scsi</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='capsType'/>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 09 16:29:02 user nova-compute[73091]:     </hostdev>
Aug 09 16:29:02 user nova-compute[73091]:     <rng supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>random</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>egd</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>builtin</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </rng>
Aug 09 16:29:02 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='driverType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>path</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>handle</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtiofs</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </filesystem>
Aug 09 16:29:02 user nova-compute[73091]:     <tpm supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>passthrough</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>emulator</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </tpm>
Aug 09 16:29:02 user nova-compute[73091]:   </devices>
Aug 09 16:29:02 user nova-compute[73091]:   <features>
Aug 09 16:29:02 user nova-compute[73091]:     <gic supported='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <genid supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <backup supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <sev supported='no'/>
Aug 09 16:29:02 user nova-compute[73091]:   </features>
Aug 09 16:29:02 user nova-compute[73091]: </domainCapabilities>
Aug 09 16:29:02 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 09 16:29:02 user nova-compute[73091]: <domainCapabilities>
Aug 09 16:29:02 user nova-compute[73091]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 16:29:02 user nova-compute[73091]:   <domain>kvm</domain>
Aug 09 16:29:02 user nova-compute[73091]:   <machine>pc-q35-6.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:   <arch>x86_64</arch>
Aug 09 16:29:02 user nova-compute[73091]:   <vcpu max='288'/>
Aug 09 16:29:02 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:   <os supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:     <enum name='firmware'>
Aug 09 16:29:02 user nova-compute[73091]:       <value>efi</value>
Aug 09 16:29:02 user nova-compute[73091]:     </enum>
Aug 09 16:29:02 user nova-compute[73091]:     <loader supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='type'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>rom</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>pflash</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='readonly'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>yes</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>no</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='secure'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>yes</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>no</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </loader>
Aug 09 16:29:02 user nova-compute[73091]:   </os>
Aug 09 16:29:02 user nova-compute[73091]:   <cpu>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>on</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>off</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>on</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>off</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='invtsc'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='rsba'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>kvm64</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>core2duo</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Westmere</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Penryn</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Opteron_G1</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Nehalem</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Conroe</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:   </cpu>
Aug 09 16:29:02 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:     <enum name='sourceType'>
Aug 09 16:29:02 user nova-compute[73091]:       <value>file</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>anonymous</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>memfd</value>
Aug 09 16:29:02 user nova-compute[73091]:     </enum>
Aug 09 16:29:02 user nova-compute[73091]:   </memoryBacking>
Aug 09 16:29:02 user nova-compute[73091]:   <devices>
Aug 09 16:29:02 user nova-compute[73091]:     <disk supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>disk</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>cdrom</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>floppy</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>lun</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='bus'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>fdc</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>scsi</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>usb</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>sata</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </disk>
Aug 09 16:29:02 user nova-compute[73091]:     <graphics supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='type'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>sdl</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vnc</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>spice</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>egl-headless</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </graphics>
Aug 09 16:29:02 user nova-compute[73091]:     <video supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='modelType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vga</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>cirrus</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vmvga</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>qxl</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>none</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>bochs</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>ramfb</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </video>
Aug 09 16:29:02 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='mode'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>subsystem</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>default</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>mandatory</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>requisite</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>optional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='subsysType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>usb</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>pci</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>scsi</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='capsType'/>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 09 16:29:02 user nova-compute[73091]:     </hostdev>
Aug 09 16:29:02 user nova-compute[73091]:     <rng supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>random</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>egd</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>builtin</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </rng>
Aug 09 16:29:02 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='driverType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>path</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>handle</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtiofs</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </filesystem>
Aug 09 16:29:02 user nova-compute[73091]:     <tpm supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>passthrough</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>emulator</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </tpm>
Aug 09 16:29:02 user nova-compute[73091]:   </devices>
Aug 09 16:29:02 user nova-compute[73091]:   <features>
Aug 09 16:29:02 user nova-compute[73091]:     <gic supported='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <genid supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <backup supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <sev supported='no'/>
Aug 09 16:29:02 user nova-compute[73091]:   </features>
Aug 09 16:29:02 user nova-compute[73091]: </domainCapabilities>
Aug 09 16:29:02 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 09 16:29:02 user nova-compute[73091]: <domainCapabilities>
Aug 09 16:29:02 user nova-compute[73091]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 16:29:02 user nova-compute[73091]:   <domain>kvm</domain>
Aug 09 16:29:02 user nova-compute[73091]:   <machine>pc-q35-jammy</machine>
Aug 09 16:29:02 user nova-compute[73091]:   <arch>x86_64</arch>
Aug 09 16:29:02 user nova-compute[73091]:   <vcpu max='288'/>
Aug 09 16:29:02 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:   <os supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:     <enum name='firmware'>
Aug 09 16:29:02 user nova-compute[73091]:       <value>efi</value>
Aug 09 16:29:02 user nova-compute[73091]:     </enum>
Aug 09 16:29:02 user nova-compute[73091]:     <loader supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='type'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>rom</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>pflash</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='readonly'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>yes</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>no</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='secure'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>yes</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>no</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </loader>
Aug 09 16:29:02 user nova-compute[73091]:   </os>
Aug 09 16:29:02 user nova-compute[73091]:   <cpu>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>on</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>off</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>on</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>off</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='invtsc'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='rsba'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>kvm64</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>core2duo</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Westmere</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Penryn</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Opteron_G1</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Nehalem</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Conroe</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:   </cpu>
Aug 09 16:29:02 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:     <enum name='sourceType'>
Aug 09 16:29:02 user nova-compute[73091]:       <value>file</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>anonymous</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>memfd</value>
Aug 09 16:29:02 user nova-compute[73091]:     </enum>
Aug 09 16:29:02 user nova-compute[73091]:   </memoryBacking>
Aug 09 16:29:02 user nova-compute[73091]:   <devices>
Aug 09 16:29:02 user nova-compute[73091]:     <disk supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>disk</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>cdrom</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>floppy</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>lun</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='bus'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>fdc</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>scsi</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>usb</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>sata</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </disk>
Aug 09 16:29:02 user nova-compute[73091]:     <graphics supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='type'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>sdl</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vnc</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>spice</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>egl-headless</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </graphics>
Aug 09 16:29:02 user nova-compute[73091]:     <video supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='modelType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vga</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>cirrus</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vmvga</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>qxl</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>none</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>bochs</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>ramfb</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </video>
Aug 09 16:29:02 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='mode'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>subsystem</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>default</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>mandatory</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>requisite</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>optional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='subsysType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>usb</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>pci</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>scsi</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='capsType'/>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 09 16:29:02 user nova-compute[73091]:     </hostdev>
Aug 09 16:29:02 user nova-compute[73091]:     <rng supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>random</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>egd</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>builtin</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </rng>
Aug 09 16:29:02 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='driverType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>path</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>handle</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtiofs</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </filesystem>
Aug 09 16:29:02 user nova-compute[73091]:     <tpm supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>passthrough</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>emulator</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </tpm>
Aug 09 16:29:02 user nova-compute[73091]:   </devices>
Aug 09 16:29:02 user nova-compute[73091]:   <features>
Aug 09 16:29:02 user nova-compute[73091]:     <gic supported='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <genid supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <backup supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <sev supported='no'/>
Aug 09 16:29:02 user nova-compute[73091]:   </features>
Aug 09 16:29:02 user nova-compute[73091]: </domainCapabilities>
Aug 09 16:29:02 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 09 16:29:02 user nova-compute[73091]: <domainCapabilities>
Aug 09 16:29:02 user nova-compute[73091]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 16:29:02 user nova-compute[73091]:   <domain>kvm</domain>
Aug 09 16:29:02 user nova-compute[73091]:   <machine>pc-i440fx-6.2</machine>
Aug 09 16:29:02 user nova-compute[73091]:   <arch>x86_64</arch>
Aug 09 16:29:02 user nova-compute[73091]:   <vcpu max='255'/>
Aug 09 16:29:02 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:   <os supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:     <enum name='firmware'>
Aug 09 16:29:02 user nova-compute[73091]:       <value>efi</value>
Aug 09 16:29:02 user nova-compute[73091]:     </enum>
Aug 09 16:29:02 user nova-compute[73091]:     <loader supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='type'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>rom</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>pflash</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='readonly'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>yes</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>no</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='secure'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>no</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </loader>
Aug 09 16:29:02 user nova-compute[73091]:   </os>
Aug 09 16:29:02 user nova-compute[73091]:   <cpu>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>on</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>off</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>on</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>off</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='invtsc'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='rsba'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>kvm64</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>core2duo</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Westmere</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Penryn</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Opteron_G1</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Nehalem</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Conroe</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:   </cpu>
Aug 09 16:29:02 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:     <enum name='sourceType'>
Aug 09 16:29:02 user nova-compute[73091]:       <value>file</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>anonymous</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>memfd</value>
Aug 09 16:29:02 user nova-compute[73091]:     </enum>
Aug 09 16:29:02 user nova-compute[73091]:   </memoryBacking>
Aug 09 16:29:02 user nova-compute[73091]:   <devices>
Aug 09 16:29:02 user nova-compute[73091]:     <disk supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>disk</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>cdrom</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>floppy</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>lun</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='bus'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>ide</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>fdc</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>scsi</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>usb</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>sata</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </disk>
Aug 09 16:29:02 user nova-compute[73091]:     <graphics supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='type'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>sdl</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vnc</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>spice</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>egl-headless</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </graphics>
Aug 09 16:29:02 user nova-compute[73091]:     <video supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='modelType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vga</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>cirrus</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vmvga</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>qxl</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>none</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>bochs</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>ramfb</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </video>
Aug 09 16:29:02 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='mode'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>subsystem</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>default</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>mandatory</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>requisite</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>optional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='subsysType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>usb</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>pci</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>scsi</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='capsType'/>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 09 16:29:02 user nova-compute[73091]:     </hostdev>
Aug 09 16:29:02 user nova-compute[73091]:     <rng supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>random</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>egd</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>builtin</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </rng>
Aug 09 16:29:02 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='driverType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>path</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>handle</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtiofs</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </filesystem>
Aug 09 16:29:02 user nova-compute[73091]:     <tpm supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>passthrough</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>emulator</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </tpm>
Aug 09 16:29:02 user nova-compute[73091]:   </devices>
Aug 09 16:29:02 user nova-compute[73091]:   <features>
Aug 09 16:29:02 user nova-compute[73091]:     <gic supported='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <genid supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <backup supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <sev supported='no'/>
Aug 09 16:29:02 user nova-compute[73091]:   </features>
Aug 09 16:29:02 user nova-compute[73091]: </domainCapabilities>
Aug 09 16:29:02 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 09 16:29:02 user nova-compute[73091]: <domainCapabilities>
Aug 09 16:29:02 user nova-compute[73091]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 16:29:02 user nova-compute[73091]:   <domain>kvm</domain>
Aug 09 16:29:02 user nova-compute[73091]:   <machine>pc-i440fx-jammy</machine>
Aug 09 16:29:02 user nova-compute[73091]:   <arch>x86_64</arch>
Aug 09 16:29:02 user nova-compute[73091]:   <vcpu max='255'/>
Aug 09 16:29:02 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:   <os supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:     <enum name='firmware'>
Aug 09 16:29:02 user nova-compute[73091]:       <value>efi</value>
Aug 09 16:29:02 user nova-compute[73091]:     </enum>
Aug 09 16:29:02 user nova-compute[73091]:     <loader supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='type'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>rom</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>pflash</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='readonly'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>yes</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>no</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='secure'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>no</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </loader>
Aug 09 16:29:02 user nova-compute[73091]:   </os>
Aug 09 16:29:02 user nova-compute[73091]:   <cpu>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>on</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>off</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>on</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>off</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='invtsc'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='rsba'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 09 16:29:02 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>kvm64</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>core2duo</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Westmere</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Penryn</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Opteron_G1</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Nehalem</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>Conroe</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 09 16:29:02 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 09 16:29:02 user nova-compute[73091]:     </mode>
Aug 09 16:29:02 user nova-compute[73091]:   </cpu>
Aug 09 16:29:02 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:     <enum name='sourceType'>
Aug 09 16:29:02 user nova-compute[73091]:       <value>file</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>anonymous</value>
Aug 09 16:29:02 user nova-compute[73091]:       <value>memfd</value>
Aug 09 16:29:02 user nova-compute[73091]:     </enum>
Aug 09 16:29:02 user nova-compute[73091]:   </memoryBacking>
Aug 09 16:29:02 user nova-compute[73091]:   <devices>
Aug 09 16:29:02 user nova-compute[73091]:     <disk supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>disk</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>cdrom</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>floppy</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>lun</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='bus'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>ide</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>fdc</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>scsi</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>usb</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>sata</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </disk>
Aug 09 16:29:02 user nova-compute[73091]:     <graphics supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='type'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>sdl</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vnc</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>spice</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>egl-headless</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </graphics>
Aug 09 16:29:02 user nova-compute[73091]:     <video supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='modelType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vga</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>cirrus</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>vmvga</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>qxl</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>none</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>bochs</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>ramfb</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </video>
Aug 09 16:29:02 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='mode'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>subsystem</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>default</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>mandatory</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>requisite</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>optional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='subsysType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>usb</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>pci</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>scsi</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='capsType'/>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 09 16:29:02 user nova-compute[73091]:     </hostdev>
Aug 09 16:29:02 user nova-compute[73091]:     <rng supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>random</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>egd</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>builtin</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </rng>
Aug 09 16:29:02 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='driverType'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>path</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>handle</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>virtiofs</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </filesystem>
Aug 09 16:29:02 user nova-compute[73091]:     <tpm supported='yes'>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='model'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:       <enum name='backendModel'>
Aug 09 16:29:02 user nova-compute[73091]:         <value>passthrough</value>
Aug 09 16:29:02 user nova-compute[73091]:         <value>emulator</value>
Aug 09 16:29:02 user nova-compute[73091]:       </enum>
Aug 09 16:29:02 user nova-compute[73091]:     </tpm>
Aug 09 16:29:02 user nova-compute[73091]:   </devices>
Aug 09 16:29:02 user nova-compute[73091]:   <features>
Aug 09 16:29:02 user nova-compute[73091]:     <gic supported='no'/>
Aug 09 16:29:02 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <genid supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <backup supported='yes'/>
Aug 09 16:29:02 user nova-compute[73091]:     <sev supported='no'/>
Aug 09 16:29:02 user nova-compute[73091]:   </features>
Aug 09 16:29:02 user nova-compute[73091]: </domainCapabilities>
Aug 09 16:29:02 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Checking secure boot support for host arch (x86_64) {{(pid=73091) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 09 16:29:02 user nova-compute[73091]: INFO nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Secure Boot support detected
Aug 09 16:29:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] cpu compare xml: <cpu match="exact">
Aug 09 16:29:02 user nova-compute[73091]:   <model>Nehalem</model>
Aug 09 16:29:02 user nova-compute[73091]: </cpu>
Aug 09 16:29:02 user nova-compute[73091]:  {{(pid=73091) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 09 16:29:02 user nova-compute[73091]: INFO nova.virt.node [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Generated node identity acad0a00-fc5f-4423-bdc7-4d5877e83b16
Aug 09 16:29:02 user nova-compute[73091]: INFO nova.virt.node [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Wrote node identity acad0a00-fc5f-4423-bdc7-4d5877e83b16 to /opt/stack/data/nova/compute_id
Aug 09 16:29:02 user nova-compute[73091]: WARNING nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Compute nodes ['acad0a00-fc5f-4423-bdc7-4d5877e83b16'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 09 16:29:03 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 09 16:29:03 user nova-compute[73091]: WARNING nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 09 16:29:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:29:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:29:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:29:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:29:03 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:29:03 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:29:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Hypervisor/Node resource view: name=user free_ram=10861MB free_disk=26.229595184326172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:29:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:29:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:29:03 user nova-compute[73091]: WARNING nova.compute.resource_tracker [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] No compute node record for user:acad0a00-fc5f-4423-bdc7-4d5877e83b16: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host acad0a00-fc5f-4423-bdc7-4d5877e83b16 could not be found.
Aug 09 16:29:03 user nova-compute[73091]: INFO nova.compute.resource_tracker [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Compute node record created for user:user with uuid: acad0a00-fc5f-4423-bdc7-4d5877e83b16
Aug 09 16:29:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:29:03 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:29:03 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [req-f994f7cb-aed5-47c2-bdc8-348c3e0e9d7d] Created resource provider record via placement API for resource provider with UUID acad0a00-fc5f-4423-bdc7-4d5877e83b16 and name user.
Aug 09 16:29:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73091) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 09 16:29:03 user nova-compute[73091]: INFO nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] kernel doesn't support AMD SEV
Aug 09 16:29:03 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Updating inventory in ProviderTree for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 16:29:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:29:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Libvirt baseline CPU <cpu>
Aug 09 16:29:03 user nova-compute[73091]:   <arch>x86_64</arch>
Aug 09 16:29:03 user nova-compute[73091]:   <model>Nehalem</model>
Aug 09 16:29:03 user nova-compute[73091]:   <vendor>Intel</vendor>
Aug 09 16:29:03 user nova-compute[73091]:   <topology sockets="6" cores="1" threads="1"/>
Aug 09 16:29:03 user nova-compute[73091]: </cpu>
Aug 09 16:29:03 user nova-compute[73091]:  {{(pid=73091) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 09 16:29:03 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Updated inventory for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 09 16:29:03 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Updating resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 generation from 0 to 1 during operation: update_inventory {{(pid=73091) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 09 16:29:03 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Updating inventory in ProviderTree for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 16:29:03 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Updating resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 generation from 1 to 2 during operation: update_traits {{(pid=73091) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 09 16:29:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:29:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.633s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:29:04 user nova-compute[73091]: DEBUG nova.service [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Creating RPC server for service compute {{(pid=73091) start /opt/stack/nova/nova/service.py:182}}
Aug 09 16:29:04 user nova-compute[73091]: DEBUG nova.service [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Join ServiceGroup membership for this service compute {{(pid=73091) start /opt/stack/nova/nova/service.py:199}}
Aug 09 16:29:04 user nova-compute[73091]: DEBUG nova.servicegroup.drivers.db [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73091) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 09 16:29:10 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_power_states {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:29:10 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:29:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:29:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:29:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:29:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 16:29:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 16:29:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:29:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:29:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:29:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:29:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:29:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:29:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:29:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:29:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:29:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:29:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:29:54 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:29:55 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:29:55 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:29:55 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=10275MB free_disk=26.133350372314453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:29:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:29:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:29:55 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:29:55 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:29:55 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:29:55 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:29:55 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:29:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:30:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:30:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:30:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:30:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:30:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:30:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:30:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 16:30:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 16:30:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:30:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:30:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:30:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:30:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:30:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:30:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:30:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:30:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:30:56 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:30:57 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:30:57 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:30:57 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=10191MB free_disk=26.17852020263672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:30:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:30:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:30:57 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:30:57 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:30:57 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:30:57 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:30:57 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:30:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:31:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:31:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:31:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:31:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:31:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:31:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:31:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 16:31:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 16:31:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:31:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:31:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:31:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:31:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:31:57 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:31:58 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:31:58 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:31:58 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=10221MB free_disk=25.95245361328125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:31:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:31:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:31:58 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:31:58 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:31:58 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:31:58 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:31:58 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:31:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.124s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:31:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:31:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:31:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:32:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:32:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:32:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:32:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:32:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:32:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:32:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 16:32:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 16:32:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:32:58 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:32:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:32:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:32:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:32:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:32:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:32:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:32:59 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:33:00 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:33:00 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:33:00 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=9453MB free_disk=25.97496795654297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:33:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:00 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:33:00 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:33:00 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:33:00 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:33:00 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:33:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:33:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquiring lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:33:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:33:04 user nova-compute[73091]: INFO nova.compute.claims [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Claim successful on node user
Aug 09 16:33:04 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:33:04 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:33:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:33:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:33:05 user nova-compute[73091]: DEBUG nova.network.neutron [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:33:05 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:33:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:33:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:33:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:33:05 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Creating image(s)
Aug 09 16:33:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "/opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "/opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:05 user nova-compute[73091]: DEBUG nova.policy [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2bcb694325ff4b6ab46c3b26f625ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e547803499e4aa59f4ec4c4af9bd4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:33:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff.part --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff.part --force-share --output=json" returned: 0 in 0.147s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:06 user nova-compute[73091]: DEBUG nova.virt.images [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] bb270def-cd6e-4463-89d8-f4240c9cb724 was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 16:33:06 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 16:33:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff.part /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff.converted {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff.part /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff.converted" returned: 0 in 0.466s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff.converted --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.268s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:07 user nova-compute[73091]: INFO oslo.privsep.daemon [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkh293rzc/privsep.sock']
Aug 09 16:33:07 user sudo[82226]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkh293rzc/privsep.sock
Aug 09 16:33:07 user sudo[82226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 16:33:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Successfully created port: 795c9edc-7b1f-4c8b-aed6-f9f9e8192759 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:33:09 user sudo[82226]: pam_unix(sudo:session): session closed for user root
Aug 09 16:33:09 user nova-compute[73091]: INFO oslo.privsep.daemon [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Spawned new privsep daemon via rootwrap
Aug 09 16:33:09 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 16:33:09 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 16:33:09 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 09 16:33:09 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82230
Aug 09 16:33:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.168s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.144s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk 1073741824" returned: 0 in 0.047s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Acquiring lock "e4ec0db9-740e-4047-8cab-ac60a1681483" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "e4ec0db9-740e-4047-8cab-ac60a1681483" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Cannot resize image /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG nova.objects.instance [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lazy-loading 'migration_context' on Instance uuid fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:33:10 user nova-compute[73091]: INFO nova.compute.claims [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Claim successful on node user
Aug 09 16:33:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Ensure instance console log exists: /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:33:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:33:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:33:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Creating image(s)
Aug 09 16:33:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "/opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "/opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.163s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.161s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483/disk 1073741824" returned: 0 in 0.162s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG nova.policy [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '414e511356854600889f4ee30f925eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cf3e438de4946aeaa9899d1fcc865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Cannot resize image /opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lazy-loading 'migration_context' on Instance uuid e4ec0db9-740e-4047-8cab-ac60a1681483 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Ensure instance console log exists: /opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Successfully updated port: 795c9edc-7b1f-4c8b-aed6-f9f9e8192759 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquiring lock "refresh_cache-fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquired lock "refresh_cache-fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-15f3d322-3b53-44bd-96a3-01b8af90f3b0 req-595c8217-696b-4d91-8ba6-44f54d824c21 service nova] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Received event network-changed-795c9edc-7b1f-4c8b-aed6-f9f9e8192759 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-15f3d322-3b53-44bd-96a3-01b8af90f3b0 req-595c8217-696b-4d91-8ba6-44f54d824c21 service nova] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Refreshing instance network info cache due to event network-changed-795c9edc-7b1f-4c8b-aed6-f9f9e8192759. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15f3d322-3b53-44bd-96a3-01b8af90f3b0 req-595c8217-696b-4d91-8ba6-44f54d824c21 service nova] Acquiring lock "refresh_cache-fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Updating instance_info_cache with network_info: [{"id": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "address": "fa:16:3e:c2:25:04", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795c9edc-7b", "ovs_interfaceid": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Releasing lock "refresh_cache-fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Instance network_info: |[{"id": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "address": "fa:16:3e:c2:25:04", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795c9edc-7b", "ovs_interfaceid": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15f3d322-3b53-44bd-96a3-01b8af90f3b0 req-595c8217-696b-4d91-8ba6-44f54d824c21 service nova] Acquired lock "refresh_cache-fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.network.neutron [req-15f3d322-3b53-44bd-96a3-01b8af90f3b0 req-595c8217-696b-4d91-8ba6-44f54d824c21 service nova] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Refreshing network info cache for port 795c9edc-7b1f-4c8b-aed6-f9f9e8192759 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Start _get_guest_xml network_info=[{"id": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "address": "fa:16:3e:c2:25:04", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795c9edc-7b", "ovs_interfaceid": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:33:12 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:33:12 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1181497092',display_name='tempest-ServersNegativeTestJSON-server-1181497092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1181497092',id=1,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e547803499e4aa59f4ec4c4af9bd4da',ramdisk_id='',reservation_id='r-zkwqlwcr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-484230207',owner_user_name='tempest-ServersNegativeTestJSON-484230207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:33:05Z,user_data=None,user_id='2bcb694325ff4b6ab46c3b26f625ef1f',uuid=fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "address": "fa:16:3e:c2:25:04", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795c9edc-7b", "ovs_interfaceid": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Converting VIF {"id": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "address": "fa:16:3e:c2:25:04", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795c9edc-7b", "ovs_interfaceid": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:25:04,bridge_name='br-int',has_traffic_filtering=True,id=795c9edc-7b1f-4c8b-aed6-f9f9e8192759,network=Network(450122ab-0e98-4dd4-9f52-82aa1bfaa561),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795c9edc-7b') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.objects.instance [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lazy-loading 'pci_devices' on Instance uuid fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:33:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:33:12 user nova-compute[73091]:   <uuid>fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714</uuid>
Aug 09 16:33:12 user nova-compute[73091]:   <name>instance-00000001</name>
Aug 09 16:33:12 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:33:12 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:33:12 user nova-compute[73091]:   <metadata>
Aug 09 16:33:12 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:33:12 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:33:12 user nova-compute[73091]:       <nova:name>tempest-ServersNegativeTestJSON-server-1181497092</nova:name>
Aug 09 16:33:12 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:33:12</nova:creationTime>
Aug 09 16:33:12 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:33:12 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:33:12 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:33:12 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:33:12 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:33:12 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:33:12 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:33:12 user nova-compute[73091]:       <nova:owner>
Aug 09 16:33:12 user nova-compute[73091]:         <nova:user uuid="2bcb694325ff4b6ab46c3b26f625ef1f">tempest-ServersNegativeTestJSON-484230207-project-member</nova:user>
Aug 09 16:33:12 user nova-compute[73091]:         <nova:project uuid="7e547803499e4aa59f4ec4c4af9bd4da">tempest-ServersNegativeTestJSON-484230207</nova:project>
Aug 09 16:33:12 user nova-compute[73091]:       </nova:owner>
Aug 09 16:33:12 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:33:12 user nova-compute[73091]:       <nova:ports>
Aug 09 16:33:12 user nova-compute[73091]:         <nova:port uuid="795c9edc-7b1f-4c8b-aed6-f9f9e8192759">
Aug 09 16:33:12 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 16:33:12 user nova-compute[73091]:         </nova:port>
Aug 09 16:33:12 user nova-compute[73091]:       </nova:ports>
Aug 09 16:33:12 user nova-compute[73091]:     </nova:instance>
Aug 09 16:33:12 user nova-compute[73091]:   </metadata>
Aug 09 16:33:12 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:33:12 user nova-compute[73091]:     <system>
Aug 09 16:33:12 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:33:12 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:33:12 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:33:12 user nova-compute[73091]:       <entry name="serial">fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714</entry>
Aug 09 16:33:12 user nova-compute[73091]:       <entry name="uuid">fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714</entry>
Aug 09 16:33:12 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:33:12 user nova-compute[73091]:     </system>
Aug 09 16:33:12 user nova-compute[73091]:   </sysinfo>
Aug 09 16:33:12 user nova-compute[73091]:   <os>
Aug 09 16:33:12 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:33:12 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:33:12 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:33:12 user nova-compute[73091]:   </os>
Aug 09 16:33:12 user nova-compute[73091]:   <features>
Aug 09 16:33:12 user nova-compute[73091]:     <acpi/>
Aug 09 16:33:12 user nova-compute[73091]:     <apic/>
Aug 09 16:33:12 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:33:12 user nova-compute[73091]:   </features>
Aug 09 16:33:12 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:33:12 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:33:12 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:33:12 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:33:12 user nova-compute[73091]:   </clock>
Aug 09 16:33:12 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:33:12 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:33:12 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:33:12 user nova-compute[73091]:   </cpu>
Aug 09 16:33:12 user nova-compute[73091]:   <devices>
Aug 09 16:33:12 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:33:12 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:33:12 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk"/>
Aug 09 16:33:12 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:33:12 user nova-compute[73091]:     </disk>
Aug 09 16:33:12 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:33:12 user nova-compute[73091]:       <mac address="fa:16:3e:c2:25:04"/>
Aug 09 16:33:12 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:33:12 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:33:12 user nova-compute[73091]:       <target dev="tap795c9edc-7b"/>
Aug 09 16:33:12 user nova-compute[73091]:     </interface>
Aug 09 16:33:12 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:33:12 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/console.log" append="off"/>
Aug 09 16:33:12 user nova-compute[73091]:     </serial>
Aug 09 16:33:12 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:33:12 user nova-compute[73091]:     <video>
Aug 09 16:33:12 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:33:12 user nova-compute[73091]:     </video>
Aug 09 16:33:12 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:33:12 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:33:12 user nova-compute[73091]:     </rng>
Aug 09 16:33:12 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:33:12 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:33:12 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:33:12 user nova-compute[73091]:     </memballoon>
Aug 09 16:33:12 user nova-compute[73091]:   </devices>
Aug 09 16:33:12 user nova-compute[73091]: </domain>
Aug 09 16:33:12 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:33:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1181497092',display_name='tempest-ServersNegativeTestJSON-server-1181497092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1181497092',id=1,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e547803499e4aa59f4ec4c4af9bd4da',ramdisk_id='',reservation_id='r-zkwqlwcr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-484230207',owner_user_name='tempest-ServersNegativeTestJSON-484230207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:33:05Z,user_data=None,user_id='2bcb694325ff4b6ab46c3b26f625ef1f',uuid=fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "address": "fa:16:3e:c2:25:04", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795c9edc-7b", "ovs_interfaceid": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:33:13 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Converting VIF {"id": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "address": "fa:16:3e:c2:25:04", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795c9edc-7b", "ovs_interfaceid": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:33:13 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:25:04,bridge_name='br-int',has_traffic_filtering=True,id=795c9edc-7b1f-4c8b-aed6-f9f9e8192759,network=Network(450122ab-0e98-4dd4-9f52-82aa1bfaa561),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795c9edc-7b') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:33:13 user nova-compute[73091]: DEBUG os_vif [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:25:04,bridge_name='br-int',has_traffic_filtering=True,id=795c9edc-7b1f-4c8b-aed6-f9f9e8192759,network=Network(450122ab-0e98-4dd4-9f52-82aa1bfaa561),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795c9edc-7b') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:33:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Created schema index Interface.name {{(pid=73091) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 16:33:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Created schema index Port.name {{(pid=73091) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 16:33:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Created schema index Bridge.name {{(pid=73091) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 16:33:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:33:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [POLLOUT] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:33:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:33:13 user nova-compute[73091]: INFO oslo.privsep.daemon [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmphu2ud59z/privsep.sock']
Aug 09 16:33:13 user sudo[82321]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmphu2ud59z/privsep.sock
Aug 09 16:33:13 user sudo[82321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 16:33:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Successfully created port: 0e3f420c-de38-4d22-a167-fdca07babd17 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:33:13 user nova-compute[73091]: DEBUG nova.network.neutron [req-15f3d322-3b53-44bd-96a3-01b8af90f3b0 req-595c8217-696b-4d91-8ba6-44f54d824c21 service nova] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Updated VIF entry in instance network info cache for port 795c9edc-7b1f-4c8b-aed6-f9f9e8192759. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:33:13 user nova-compute[73091]: DEBUG nova.network.neutron [req-15f3d322-3b53-44bd-96a3-01b8af90f3b0 req-595c8217-696b-4d91-8ba6-44f54d824c21 service nova] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Updating instance_info_cache with network_info: [{"id": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "address": "fa:16:3e:c2:25:04", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795c9edc-7b", "ovs_interfaceid": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:33:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15f3d322-3b53-44bd-96a3-01b8af90f3b0 req-595c8217-696b-4d91-8ba6-44f54d824c21 service nova] Releasing lock "refresh_cache-fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:33:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:14 user sudo[82321]: pam_unix(sudo:session): session closed for user root
Aug 09 16:33:14 user nova-compute[73091]: INFO oslo.privsep.daemon [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Spawned new privsep daemon via rootwrap
Aug 09 16:33:14 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 16:33:14 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 16:33:14 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 09 16:33:14 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82325
Aug 09 16:33:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap795c9edc-7b, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap795c9edc-7b, col_values=(('external_ids', {'iface-id': '795c9edc-7b1f-4c8b-aed6-f9f9e8192759', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:25:04', 'vm-uuid': 'fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:33:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:15 user nova-compute[73091]: INFO os_vif [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:25:04,bridge_name='br-int',has_traffic_filtering=True,id=795c9edc-7b1f-4c8b-aed6-f9f9e8192759,network=Network(450122ab-0e98-4dd4-9f52-82aa1bfaa561),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795c9edc-7b')
Aug 09 16:33:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:33:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] No VIF found with MAC fa:16:3e:c2:25:04, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:33:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Successfully updated port: 0e3f420c-de38-4d22-a167-fdca07babd17 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:33:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Acquiring lock "refresh_cache-e4ec0db9-740e-4047-8cab-ac60a1681483" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:33:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Acquired lock "refresh_cache-e4ec0db9-740e-4047-8cab-ac60a1681483" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:33:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:33:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:33:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-151a7157-8829-4f4b-ba63-289ac3db5ace req-062db249-ce4b-470e-9909-a6a29589defa service nova] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Received event network-changed-0e3f420c-de38-4d22-a167-fdca07babd17 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-151a7157-8829-4f4b-ba63-289ac3db5ace req-062db249-ce4b-470e-9909-a6a29589defa service nova] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Refreshing instance network info cache due to event network-changed-0e3f420c-de38-4d22-a167-fdca07babd17. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:33:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-151a7157-8829-4f4b-ba63-289ac3db5ace req-062db249-ce4b-470e-9909-a6a29589defa service nova] Acquiring lock "refresh_cache-e4ec0db9-740e-4047-8cab-ac60a1681483" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:33:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:33:17 user nova-compute[73091]: INFO nova.compute.claims [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Claim successful on node user
Aug 09 16:33:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:33:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Updating instance_info_cache with network_info: [{"id": "0e3f420c-de38-4d22-a167-fdca07babd17", "address": "fa:16:3e:34:44:1f", "network": {"id": "e19cb2bb-1445-4ff3-babe-23d0e2c23362", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2077372665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a17cf3e438de4946aeaa9899d1fcc865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3f420c-de", "ovs_interfaceid": "0e3f420c-de38-4d22-a167-fdca07babd17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Releasing lock "refresh_cache-e4ec0db9-740e-4047-8cab-ac60a1681483" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Instance network_info: |[{"id": "0e3f420c-de38-4d22-a167-fdca07babd17", "address": "fa:16:3e:34:44:1f", "network": {"id": "e19cb2bb-1445-4ff3-babe-23d0e2c23362", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2077372665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a17cf3e438de4946aeaa9899d1fcc865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3f420c-de", "ovs_interfaceid": "0e3f420c-de38-4d22-a167-fdca07babd17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-151a7157-8829-4f4b-ba63-289ac3db5ace req-062db249-ce4b-470e-9909-a6a29589defa service nova] Acquired lock "refresh_cache-e4ec0db9-740e-4047-8cab-ac60a1681483" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-151a7157-8829-4f4b-ba63-289ac3db5ace req-062db249-ce4b-470e-9909-a6a29589defa service nova] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Refreshing network info cache for port 0e3f420c-de38-4d22-a167-fdca07babd17 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Start _get_guest_xml network_info=[{"id": "0e3f420c-de38-4d22-a167-fdca07babd17", "address": "fa:16:3e:34:44:1f", "network": {"id": "e19cb2bb-1445-4ff3-babe-23d0e2c23362", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2077372665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a17cf3e438de4946aeaa9899d1fcc865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3f420c-de", "ovs_interfaceid": "0e3f420c-de38-4d22-a167-fdca07babd17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:33:17 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:33:17 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:33:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Creating image(s)
Aug 09 16:33:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "/opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "/opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-d8ead97d-9e4f-4402-8c6f-2dd817843fee req-2d29a2d7-f0d9-4d61-b08c-f4aa6916cfbd service nova] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Received event network-vif-plugged-795c9edc-7b1f-4c8b-aed6-f9f9e8192759 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d8ead97d-9e4f-4402-8c6f-2dd817843fee req-2d29a2d7-f0d9-4d61-b08c-f4aa6916cfbd service nova] Acquiring lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d8ead97d-9e4f-4402-8c6f-2dd817843fee req-2d29a2d7-f0d9-4d61-b08c-f4aa6916cfbd service nova] Lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d8ead97d-9e4f-4402-8c6f-2dd817843fee req-2d29a2d7-f0d9-4d61-b08c-f4aa6916cfbd service nova] Lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-d8ead97d-9e4f-4402-8c6f-2dd817843fee req-2d29a2d7-f0d9-4d61-b08c-f4aa6916cfbd service nova] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] No waiting events found dispatching network-vif-plugged-795c9edc-7b1f-4c8b-aed6-f9f9e8192759 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:33:17 user nova-compute[73091]: WARNING nova.compute.manager [req-d8ead97d-9e4f-4402-8c6f-2dd817843fee req-2d29a2d7-f0d9-4d61-b08c-f4aa6916cfbd service nova] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Received unexpected event network-vif-plugged-795c9edc-7b1f-4c8b-aed6-f9f9e8192759 for instance with vm_state building and task_state spawning.
Aug 09 16:33:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:33:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1840367609',display_name='tempest-DeleteServersTestJSON-server-1840367609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1840367609',id=2,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a17cf3e438de4946aeaa9899d1fcc865',ramdisk_id='',reservation_id='r-0r9mjncr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1124556085',owner_user_name='tempest-DeleteServersTestJSON-1124556085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:33:11Z,user_data=None,user_id='414e511356854600889f4ee30f925eaf',uuid=e4ec0db9-740e-4047-8cab-ac60a1681483,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e3f420c-de38-4d22-a167-fdca07babd17", "address": "fa:16:3e:34:44:1f", "network": {"id": "e19cb2bb-1445-4ff3-babe-23d0e2c23362", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2077372665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a17cf3e438de4946aeaa9899d1fcc865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3f420c-de", "ovs_interfaceid": "0e3f420c-de38-4d22-a167-fdca07babd17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Converting VIF {"id": "0e3f420c-de38-4d22-a167-fdca07babd17", "address": "fa:16:3e:34:44:1f", "network": {"id": "e19cb2bb-1445-4ff3-babe-23d0e2c23362", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2077372665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a17cf3e438de4946aeaa9899d1fcc865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3f420c-de", "ovs_interfaceid": "0e3f420c-de38-4d22-a167-fdca07babd17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:44:1f,bridge_name='br-int',has_traffic_filtering=True,id=0e3f420c-de38-4d22-a167-fdca07babd17,network=Network(e19cb2bb-1445-4ff3-babe-23d0e2c23362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e3f420c-de') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lazy-loading 'pci_devices' on Instance uuid e4ec0db9-740e-4047-8cab-ac60a1681483 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:33:17 user nova-compute[73091]:   <uuid>e4ec0db9-740e-4047-8cab-ac60a1681483</uuid>
Aug 09 16:33:17 user nova-compute[73091]:   <name>instance-00000002</name>
Aug 09 16:33:17 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:33:17 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:33:17 user nova-compute[73091]:   <metadata>
Aug 09 16:33:17 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:33:17 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:33:17 user nova-compute[73091]:       <nova:name>tempest-DeleteServersTestJSON-server-1840367609</nova:name>
Aug 09 16:33:17 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:33:17</nova:creationTime>
Aug 09 16:33:17 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:33:17 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:33:17 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:33:17 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:33:17 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:33:17 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:33:17 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:33:17 user nova-compute[73091]:       <nova:owner>
Aug 09 16:33:17 user nova-compute[73091]:         <nova:user uuid="414e511356854600889f4ee30f925eaf">tempest-DeleteServersTestJSON-1124556085-project-member</nova:user>
Aug 09 16:33:17 user nova-compute[73091]:         <nova:project uuid="a17cf3e438de4946aeaa9899d1fcc865">tempest-DeleteServersTestJSON-1124556085</nova:project>
Aug 09 16:33:17 user nova-compute[73091]:       </nova:owner>
Aug 09 16:33:17 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:33:17 user nova-compute[73091]:       <nova:ports>
Aug 09 16:33:17 user nova-compute[73091]:         <nova:port uuid="0e3f420c-de38-4d22-a167-fdca07babd17">
Aug 09 16:33:17 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 16:33:17 user nova-compute[73091]:         </nova:port>
Aug 09 16:33:17 user nova-compute[73091]:       </nova:ports>
Aug 09 16:33:17 user nova-compute[73091]:     </nova:instance>
Aug 09 16:33:17 user nova-compute[73091]:   </metadata>
Aug 09 16:33:17 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:33:17 user nova-compute[73091]:     <system>
Aug 09 16:33:17 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:33:17 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:33:17 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:33:17 user nova-compute[73091]:       <entry name="serial">e4ec0db9-740e-4047-8cab-ac60a1681483</entry>
Aug 09 16:33:17 user nova-compute[73091]:       <entry name="uuid">e4ec0db9-740e-4047-8cab-ac60a1681483</entry>
Aug 09 16:33:17 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:33:17 user nova-compute[73091]:     </system>
Aug 09 16:33:17 user nova-compute[73091]:   </sysinfo>
Aug 09 16:33:17 user nova-compute[73091]:   <os>
Aug 09 16:33:17 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:33:17 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:33:17 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:33:17 user nova-compute[73091]:   </os>
Aug 09 16:33:17 user nova-compute[73091]:   <features>
Aug 09 16:33:17 user nova-compute[73091]:     <acpi/>
Aug 09 16:33:17 user nova-compute[73091]:     <apic/>
Aug 09 16:33:17 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:33:17 user nova-compute[73091]:   </features>
Aug 09 16:33:17 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:33:17 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:33:17 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:33:17 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:33:17 user nova-compute[73091]:   </clock>
Aug 09 16:33:17 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:33:17 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:33:17 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:33:17 user nova-compute[73091]:   </cpu>
Aug 09 16:33:17 user nova-compute[73091]:   <devices>
Aug 09 16:33:17 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:33:17 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:33:17 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483/disk"/>
Aug 09 16:33:17 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:33:17 user nova-compute[73091]:     </disk>
Aug 09 16:33:17 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:33:17 user nova-compute[73091]:       <mac address="fa:16:3e:34:44:1f"/>
Aug 09 16:33:17 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:33:17 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:33:17 user nova-compute[73091]:       <target dev="tap0e3f420c-de"/>
Aug 09 16:33:17 user nova-compute[73091]:     </interface>
Aug 09 16:33:17 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:33:17 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483/console.log" append="off"/>
Aug 09 16:33:17 user nova-compute[73091]:     </serial>
Aug 09 16:33:17 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:33:17 user nova-compute[73091]:     <video>
Aug 09 16:33:17 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:33:17 user nova-compute[73091]:     </video>
Aug 09 16:33:17 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:33:17 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:33:17 user nova-compute[73091]:     </rng>
Aug 09 16:33:17 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:33:17 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:33:17 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:33:17 user nova-compute[73091]:     </memballoon>
Aug 09 16:33:17 user nova-compute[73091]:   </devices>
Aug 09 16:33:17 user nova-compute[73091]: </domain>
Aug 09 16:33:17 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:33:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1840367609',display_name='tempest-DeleteServersTestJSON-server-1840367609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1840367609',id=2,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a17cf3e438de4946aeaa9899d1fcc865',ramdisk_id='',reservation_id='r-0r9mjncr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1124556085',owner_user_name='tempest-DeleteServersTestJSON-1124556085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:33:11Z,user_data=None,user_id='414e511356854600889f4ee30f925eaf',uuid=e4ec0db9-740e-4047-8cab-ac60a1681483,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e3f420c-de38-4d22-a167-fdca07babd17", "address": "fa:16:3e:34:44:1f", "network": {"id": "e19cb2bb-1445-4ff3-babe-23d0e2c23362", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2077372665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a17cf3e438de4946aeaa9899d1fcc865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3f420c-de", "ovs_interfaceid": "0e3f420c-de38-4d22-a167-fdca07babd17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Converting VIF {"id": "0e3f420c-de38-4d22-a167-fdca07babd17", "address": "fa:16:3e:34:44:1f", "network": {"id": "e19cb2bb-1445-4ff3-babe-23d0e2c23362", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2077372665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a17cf3e438de4946aeaa9899d1fcc865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3f420c-de", "ovs_interfaceid": "0e3f420c-de38-4d22-a167-fdca07babd17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:44:1f,bridge_name='br-int',has_traffic_filtering=True,id=0e3f420c-de38-4d22-a167-fdca07babd17,network=Network(e19cb2bb-1445-4ff3-babe-23d0e2c23362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e3f420c-de') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG os_vif [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:44:1f,bridge_name='br-int',has_traffic_filtering=True,id=0e3f420c-de38-4d22-a167-fdca07babd17,network=Network(e19cb2bb-1445-4ff3-babe-23d0e2c23362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e3f420c-de') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e3f420c-de, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e3f420c-de, col_values=(('external_ids', {'iface-id': '0e3f420c-de38-4d22-a167-fdca07babd17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:44:1f', 'vm-uuid': 'e4ec0db9-740e-4047-8cab-ac60a1681483'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:17 user nova-compute[73091]: INFO os_vif [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:44:1f,bridge_name='br-int',has_traffic_filtering=True,id=0e3f420c-de38-4d22-a167-fdca07babd17,network=Network(e19cb2bb-1445-4ff3-babe-23d0e2c23362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e3f420c-de')
Aug 09 16:33:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] No VIF found with MAC fa:16:3e:34:44:1f, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG nova.policy [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '343ec5734ef547f292ee631dbb272359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8000a47d82748ce8d43d306682d62c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk 1073741824" returned: 0 in 0.081s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Cannot resize image /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'migration_context' on Instance uuid f3e2ea27-5fa4-4437-83d0-2eeda59506a9 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Ensure instance console log exists: /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Successfully created port: 93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598799.077464, fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:33:19 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] VM Resumed (Lifecycle Event)
Aug 09 16:33:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:33:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Instance spawned successfully.
Aug 09 16:33:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:19 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:33:19 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598799.0838525, fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:33:19 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] VM Started (Lifecycle Event)
Aug 09 16:33:19 user nova-compute[73091]: INFO nova.compute.manager [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Took 13.95 seconds to spawn the instance on the hypervisor.
Aug 09 16:33:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-151a7157-8829-4f4b-ba63-289ac3db5ace req-062db249-ce4b-470e-9909-a6a29589defa service nova] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Updated VIF entry in instance network info cache for port 0e3f420c-de38-4d22-a167-fdca07babd17. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-151a7157-8829-4f4b-ba63-289ac3db5ace req-062db249-ce4b-470e-9909-a6a29589defa service nova] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Updating instance_info_cache with network_info: [{"id": "0e3f420c-de38-4d22-a167-fdca07babd17", "address": "fa:16:3e:34:44:1f", "network": {"id": "e19cb2bb-1445-4ff3-babe-23d0e2c23362", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2077372665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a17cf3e438de4946aeaa9899d1fcc865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3f420c-de", "ovs_interfaceid": "0e3f420c-de38-4d22-a167-fdca07babd17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-151a7157-8829-4f4b-ba63-289ac3db5ace req-062db249-ce4b-470e-9909-a6a29589defa service nova] Releasing lock "refresh_cache-e4ec0db9-740e-4047-8cab-ac60a1681483" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:33:19 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:33:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:19 user nova-compute[73091]: INFO nova.compute.manager [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Took 14.94 seconds to build instance.
Aug 09 16:33:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-be4b9b57-9be5-4dc7-9ab7-d63215f2745f tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.167s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-38f1ea60-6060-40a7-87b4-a78d2eaec055 req-4da73ce4-62b9-407c-bc4f-20be3c8a809e service nova] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Received event network-vif-plugged-795c9edc-7b1f-4c8b-aed6-f9f9e8192759 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-38f1ea60-6060-40a7-87b4-a78d2eaec055 req-4da73ce4-62b9-407c-bc4f-20be3c8a809e service nova] Acquiring lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-38f1ea60-6060-40a7-87b4-a78d2eaec055 req-4da73ce4-62b9-407c-bc4f-20be3c8a809e service nova] Lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-38f1ea60-6060-40a7-87b4-a78d2eaec055 req-4da73ce4-62b9-407c-bc4f-20be3c8a809e service nova] Lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-38f1ea60-6060-40a7-87b4-a78d2eaec055 req-4da73ce4-62b9-407c-bc4f-20be3c8a809e service nova] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] No waiting events found dispatching network-vif-plugged-795c9edc-7b1f-4c8b-aed6-f9f9e8192759 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:33:19 user nova-compute[73091]: WARNING nova.compute.manager [req-38f1ea60-6060-40a7-87b4-a78d2eaec055 req-4da73ce4-62b9-407c-bc4f-20be3c8a809e service nova] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Received unexpected event network-vif-plugged-795c9edc-7b1f-4c8b-aed6-f9f9e8192759 for instance with vm_state active and task_state None.
Aug 09 16:33:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:20 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Successfully updated port: 93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:33:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:33:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquired lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:33:20 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:33:21 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:33:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-23c04686-6cf9-4530-99eb-a83f0ba26809 req-6caf1793-f072-41ff-ba8d-b8585de0049c service nova] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Received event network-vif-plugged-0e3f420c-de38-4d22-a167-fdca07babd17 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-23c04686-6cf9-4530-99eb-a83f0ba26809 req-6caf1793-f072-41ff-ba8d-b8585de0049c service nova] Acquiring lock "e4ec0db9-740e-4047-8cab-ac60a1681483-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-23c04686-6cf9-4530-99eb-a83f0ba26809 req-6caf1793-f072-41ff-ba8d-b8585de0049c service nova] Lock "e4ec0db9-740e-4047-8cab-ac60a1681483-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-23c04686-6cf9-4530-99eb-a83f0ba26809 req-6caf1793-f072-41ff-ba8d-b8585de0049c service nova] Lock "e4ec0db9-740e-4047-8cab-ac60a1681483-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-23c04686-6cf9-4530-99eb-a83f0ba26809 req-6caf1793-f072-41ff-ba8d-b8585de0049c service nova] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] No waiting events found dispatching network-vif-plugged-0e3f420c-de38-4d22-a167-fdca07babd17 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:33:22 user nova-compute[73091]: WARNING nova.compute.manager [req-23c04686-6cf9-4530-99eb-a83f0ba26809 req-6caf1793-f072-41ff-ba8d-b8585de0049c service nova] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Received unexpected event network-vif-plugged-0e3f420c-de38-4d22-a167-fdca07babd17 for instance with vm_state building and task_state spawning.
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-23c04686-6cf9-4530-99eb-a83f0ba26809 req-6caf1793-f072-41ff-ba8d-b8585de0049c service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received event network-changed-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-23c04686-6cf9-4530-99eb-a83f0ba26809 req-6caf1793-f072-41ff-ba8d-b8585de0049c service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Refreshing instance network info cache due to event network-changed-93308f09-a0e7-49b6-8b29-dc0999acbfc1. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-23c04686-6cf9-4530-99eb-a83f0ba26809 req-6caf1793-f072-41ff-ba8d-b8585de0049c service nova] Acquiring lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598802.1114938, e4ec0db9-740e-4047-8cab-ac60a1681483 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:33:22 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] VM Resumed (Lifecycle Event)
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:33:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Instance spawned successfully.
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:33:22 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598802.1241527, e4ec0db9-740e-4047-8cab-ac60a1681483 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:33:22 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] VM Started (Lifecycle Event)
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Updating instance_info_cache with network_info: [{"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:33:22 user nova-compute[73091]: INFO nova.compute.manager [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Took 11.44 seconds to spawn the instance on the hypervisor.
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:22 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:33:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Releasing lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Instance network_info: |[{"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-23c04686-6cf9-4530-99eb-a83f0ba26809 req-6caf1793-f072-41ff-ba8d-b8585de0049c service nova] Acquired lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.network.neutron [req-23c04686-6cf9-4530-99eb-a83f0ba26809 req-6caf1793-f072-41ff-ba8d-b8585de0049c service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Refreshing network info cache for port 93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Start _get_guest_xml network_info=[{"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:33:22 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:33:22 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1616872134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1616872134',id=3,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAITbZ0bekUUaQcD9JG/a45LmgmiGDqXNdBL8us/+D3kEuK3lX64SC3DS9c5RvpZzIppm7AwxfGpJ8le2Ng0oRqLADK98z9cmOu+DwcKkC/ohl31CHyQco0JJV2LY0z1qQ==',key_name='tempest-keypair-2075151971',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8000a47d82748ce8d43d306682d62c6',ramdisk_id='',reservation_id='r-3yoej5re',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1451982310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1451982310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:33:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343ec5734ef547f292ee631dbb272359',uuid=f3e2ea27-5fa4-4437-83d0-2eeda59506a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converting VIF {"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:62:67,bridge_name='br-int',has_traffic_filtering=True,id=93308f09-a0e7-49b6-8b29-dc0999acbfc1,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93308f09-a0') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'pci_devices' on Instance uuid f3e2ea27-5fa4-4437-83d0-2eeda59506a9 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:33:22 user nova-compute[73091]:   <uuid>f3e2ea27-5fa4-4437-83d0-2eeda59506a9</uuid>
Aug 09 16:33:22 user nova-compute[73091]:   <name>instance-00000003</name>
Aug 09 16:33:22 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:33:22 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:33:22 user nova-compute[73091]:   <metadata>
Aug 09 16:33:22 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:33:22 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:33:22 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1616872134</nova:name>
Aug 09 16:33:22 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:33:22</nova:creationTime>
Aug 09 16:33:22 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:33:22 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:33:22 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:33:22 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:33:22 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:33:22 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:33:22 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:33:22 user nova-compute[73091]:       <nova:owner>
Aug 09 16:33:22 user nova-compute[73091]:         <nova:user uuid="343ec5734ef547f292ee631dbb272359">tempest-AttachVolumeShelveTestJSON-1451982310-project-member</nova:user>
Aug 09 16:33:22 user nova-compute[73091]:         <nova:project uuid="b8000a47d82748ce8d43d306682d62c6">tempest-AttachVolumeShelveTestJSON-1451982310</nova:project>
Aug 09 16:33:22 user nova-compute[73091]:       </nova:owner>
Aug 09 16:33:22 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:33:22 user nova-compute[73091]:       <nova:ports>
Aug 09 16:33:22 user nova-compute[73091]:         <nova:port uuid="93308f09-a0e7-49b6-8b29-dc0999acbfc1">
Aug 09 16:33:22 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 16:33:22 user nova-compute[73091]:         </nova:port>
Aug 09 16:33:22 user nova-compute[73091]:       </nova:ports>
Aug 09 16:33:22 user nova-compute[73091]:     </nova:instance>
Aug 09 16:33:22 user nova-compute[73091]:   </metadata>
Aug 09 16:33:22 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:33:22 user nova-compute[73091]:     <system>
Aug 09 16:33:22 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:33:22 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:33:22 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:33:22 user nova-compute[73091]:       <entry name="serial">f3e2ea27-5fa4-4437-83d0-2eeda59506a9</entry>
Aug 09 16:33:22 user nova-compute[73091]:       <entry name="uuid">f3e2ea27-5fa4-4437-83d0-2eeda59506a9</entry>
Aug 09 16:33:22 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:33:22 user nova-compute[73091]:     </system>
Aug 09 16:33:22 user nova-compute[73091]:   </sysinfo>
Aug 09 16:33:22 user nova-compute[73091]:   <os>
Aug 09 16:33:22 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:33:22 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:33:22 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:33:22 user nova-compute[73091]:   </os>
Aug 09 16:33:22 user nova-compute[73091]:   <features>
Aug 09 16:33:22 user nova-compute[73091]:     <acpi/>
Aug 09 16:33:22 user nova-compute[73091]:     <apic/>
Aug 09 16:33:22 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:33:22 user nova-compute[73091]:   </features>
Aug 09 16:33:22 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:33:22 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:33:22 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:33:22 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:33:22 user nova-compute[73091]:   </clock>
Aug 09 16:33:22 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:33:22 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:33:22 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:33:22 user nova-compute[73091]:   </cpu>
Aug 09 16:33:22 user nova-compute[73091]:   <devices>
Aug 09 16:33:22 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:33:22 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:33:22 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk"/>
Aug 09 16:33:22 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:33:22 user nova-compute[73091]:     </disk>
Aug 09 16:33:22 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:33:22 user nova-compute[73091]:       <mac address="fa:16:3e:dd:62:67"/>
Aug 09 16:33:22 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:33:22 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:33:22 user nova-compute[73091]:       <target dev="tap93308f09-a0"/>
Aug 09 16:33:22 user nova-compute[73091]:     </interface>
Aug 09 16:33:22 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:33:22 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/console.log" append="off"/>
Aug 09 16:33:22 user nova-compute[73091]:     </serial>
Aug 09 16:33:22 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:33:22 user nova-compute[73091]:     <video>
Aug 09 16:33:22 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:33:22 user nova-compute[73091]:     </video>
Aug 09 16:33:22 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:33:22 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:33:22 user nova-compute[73091]:     </rng>
Aug 09 16:33:22 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:33:22 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:33:22 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:33:22 user nova-compute[73091]:     </memballoon>
Aug 09 16:33:22 user nova-compute[73091]:   </devices>
Aug 09 16:33:22 user nova-compute[73091]: </domain>
Aug 09 16:33:22 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1616872134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1616872134',id=3,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAITbZ0bekUUaQcD9JG/a45LmgmiGDqXNdBL8us/+D3kEuK3lX64SC3DS9c5RvpZzIppm7AwxfGpJ8le2Ng0oRqLADK98z9cmOu+DwcKkC/ohl31CHyQco0JJV2LY0z1qQ==',key_name='tempest-keypair-2075151971',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8000a47d82748ce8d43d306682d62c6',ramdisk_id='',reservation_id='r-3yoej5re',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1451982310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1451982310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:33:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343ec5734ef547f292ee631dbb272359',uuid=f3e2ea27-5fa4-4437-83d0-2eeda59506a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converting VIF {"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:62:67,bridge_name='br-int',has_traffic_filtering=True,id=93308f09-a0e7-49b6-8b29-dc0999acbfc1,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93308f09-a0') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG os_vif [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:62:67,bridge_name='br-int',has_traffic_filtering=True,id=93308f09-a0e7-49b6-8b29-dc0999acbfc1,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93308f09-a0') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:33:22 user nova-compute[73091]: INFO nova.compute.manager [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Took 12.23 seconds to build instance.
Aug 09 16:33:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93308f09-a0, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap93308f09-a0, col_values=(('external_ids', {'iface-id': '93308f09-a0e7-49b6-8b29-dc0999acbfc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:62:67', 'vm-uuid': 'f3e2ea27-5fa4-4437-83d0-2eeda59506a9'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:22 user nova-compute[73091]: INFO os_vif [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:62:67,bridge_name='br-int',has_traffic_filtering=True,id=93308f09-a0e7-49b6-8b29-dc0999acbfc1,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93308f09-a0')
Aug 09 16:33:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e6f08d67-9450-4615-8944-39dafe0d5d41 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "e4ec0db9-740e-4047-8cab-ac60a1681483" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.474s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:33:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] No VIF found with MAC fa:16:3e:dd:62:67, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:33:23 user nova-compute[73091]: DEBUG nova.network.neutron [req-23c04686-6cf9-4530-99eb-a83f0ba26809 req-6caf1793-f072-41ff-ba8d-b8585de0049c service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Updated VIF entry in instance network info cache for port 93308f09-a0e7-49b6-8b29-dc0999acbfc1. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:33:23 user nova-compute[73091]: DEBUG nova.network.neutron [req-23c04686-6cf9-4530-99eb-a83f0ba26809 req-6caf1793-f072-41ff-ba8d-b8585de0049c service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Updating instance_info_cache with network_info: [{"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:33:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-23c04686-6cf9-4530-99eb-a83f0ba26809 req-6caf1793-f072-41ff-ba8d-b8585de0049c service nova] Releasing lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:33:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-23c04686-6cf9-4530-99eb-a83f0ba26809 req-6caf1793-f072-41ff-ba8d-b8585de0049c service nova] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Received event network-vif-plugged-0e3f420c-de38-4d22-a167-fdca07babd17 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-23c04686-6cf9-4530-99eb-a83f0ba26809 req-6caf1793-f072-41ff-ba8d-b8585de0049c service nova] Acquiring lock "e4ec0db9-740e-4047-8cab-ac60a1681483-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-23c04686-6cf9-4530-99eb-a83f0ba26809 req-6caf1793-f072-41ff-ba8d-b8585de0049c service nova] Lock "e4ec0db9-740e-4047-8cab-ac60a1681483-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-23c04686-6cf9-4530-99eb-a83f0ba26809 req-6caf1793-f072-41ff-ba8d-b8585de0049c service nova] Lock "e4ec0db9-740e-4047-8cab-ac60a1681483-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-23c04686-6cf9-4530-99eb-a83f0ba26809 req-6caf1793-f072-41ff-ba8d-b8585de0049c service nova] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] No waiting events found dispatching network-vif-plugged-0e3f420c-de38-4d22-a167-fdca07babd17 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:33:23 user nova-compute[73091]: WARNING nova.compute.manager [req-23c04686-6cf9-4530-99eb-a83f0ba26809 req-6caf1793-f072-41ff-ba8d-b8585de0049c service nova] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Received unexpected event network-vif-plugged-0e3f420c-de38-4d22-a167-fdca07babd17 for instance with vm_state building and task_state spawning.
Aug 09 16:33:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-0c19f195-45e5-4c29-b1be-2f05f17a6b3e req-bd72c55e-bddd-4c7e-852b-0d004aca5c25 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received event network-vif-plugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0c19f195-45e5-4c29-b1be-2f05f17a6b3e req-bd72c55e-bddd-4c7e-852b-0d004aca5c25 service nova] Acquiring lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0c19f195-45e5-4c29-b1be-2f05f17a6b3e req-bd72c55e-bddd-4c7e-852b-0d004aca5c25 service nova] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0c19f195-45e5-4c29-b1be-2f05f17a6b3e req-bd72c55e-bddd-4c7e-852b-0d004aca5c25 service nova] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-0c19f195-45e5-4c29-b1be-2f05f17a6b3e req-bd72c55e-bddd-4c7e-852b-0d004aca5c25 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] No waiting events found dispatching network-vif-plugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:33:24 user nova-compute[73091]: WARNING nova.compute.manager [req-0c19f195-45e5-4c29-b1be-2f05f17a6b3e req-bd72c55e-bddd-4c7e-852b-0d004aca5c25 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received unexpected event network-vif-plugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 for instance with vm_state building and task_state spawning.
Aug 09 16:33:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-bb31f7d6-e069-414b-b145-491187b75d24 req-5e282652-10eb-4e8b-aa05-590a3934ce9c service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received event network-vif-plugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bb31f7d6-e069-414b-b145-491187b75d24 req-5e282652-10eb-4e8b-aa05-590a3934ce9c service nova] Acquiring lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bb31f7d6-e069-414b-b145-491187b75d24 req-5e282652-10eb-4e8b-aa05-590a3934ce9c service nova] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bb31f7d6-e069-414b-b145-491187b75d24 req-5e282652-10eb-4e8b-aa05-590a3934ce9c service nova] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-bb31f7d6-e069-414b-b145-491187b75d24 req-5e282652-10eb-4e8b-aa05-590a3934ce9c service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] No waiting events found dispatching network-vif-plugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:33:27 user nova-compute[73091]: WARNING nova.compute.manager [req-bb31f7d6-e069-414b-b145-491187b75d24 req-5e282652-10eb-4e8b-aa05-590a3934ce9c service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received unexpected event network-vif-plugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 for instance with vm_state building and task_state spawning.
Aug 09 16:33:27 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598807.2162337, f3e2ea27-5fa4-4437-83d0-2eeda59506a9 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:33:27 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] VM Resumed (Lifecycle Event)
Aug 09 16:33:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:33:27 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Instance spawned successfully.
Aug 09 16:33:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:33:27 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:33:27 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598807.217777, f3e2ea27-5fa4-4437-83d0-2eeda59506a9 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:33:27 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] VM Started (Lifecycle Event)
Aug 09 16:33:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:27 user nova-compute[73091]: INFO nova.compute.manager [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Took 9.74 seconds to spawn the instance on the hypervisor.
Aug 09 16:33:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:27 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:33:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:27 user nova-compute[73091]: INFO nova.compute.manager [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Took 10.63 seconds to build instance.
Aug 09 16:33:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff694d3d-c86b-4d26-a24a-d81a35aa16f4 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.783s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Acquiring lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:33:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:33:39 user nova-compute[73091]: INFO nova.compute.claims [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Claim successful on node user
Aug 09 16:33:39 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:33:39 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:33:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:33:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:33:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:33:39 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:33:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:33:39 user nova-compute[73091]: DEBUG nova.policy [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0eed7686d5eb46b99f8872f4eabc1f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d63eb933f4d40cdb34d3a27c76c9720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:33:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:33:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:33:39 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Creating image(s)
Aug 09 16:33:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Acquiring lock "/opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Lock "/opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Lock "/opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.160s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.214s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk 1073741824" returned: 0 in 0.077s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.213s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Cannot resize image /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Lazy-loading 'migration_context' on Instance uuid 7bcc1e42-532f-4fb6-984e-cdf659cfef7c {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Ensure instance console log exists: /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Successfully created port: 0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:33:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Acquiring lock "b791bded-3eb5-4bf8-a14e-eae269ae2043" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "b791bded-3eb5-4bf8-a14e-eae269ae2043" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:33:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:33:41 user nova-compute[73091]: INFO nova.compute.claims [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Claim successful on node user
Aug 09 16:33:41 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:33:41 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:33:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:33:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:33:41 user nova-compute[73091]: DEBUG nova.network.neutron [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:33:41 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 09 16:33:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Successfully updated port: 0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Acquiring lock "refresh_cache-7bcc1e42-532f-4fb6-984e-cdf659cfef7c" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Acquired lock "refresh_cache-7bcc1e42-532f-4fb6-984e-cdf659cfef7c" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:33:42 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Creating image(s)
Aug 09 16:33:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Acquiring lock "/opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "/opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "/opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Acquiring lock "90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-8383ba77-1559-429a-a6e3-1196f2db3b96 req-e70edcb1-588b-43ec-99f0-c3f0f14c7f13 service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Received event network-changed-0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-8383ba77-1559-429a-a6e3-1196f2db3b96 req-e70edcb1-588b-43ec-99f0-c3f0f14c7f13 service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Refreshing instance network info cache due to event network-changed-0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8383ba77-1559-429a-a6e3-1196f2db3b96 req-e70edcb1-588b-43ec-99f0-c3f0f14c7f13 service nova] Acquiring lock "refresh_cache-7bcc1e42-532f-4fb6-984e-cdf659cfef7c" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG nova.policy [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19667f77ab164d97851ee7a334141bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea346b28dbcf4ba6b8de576c3326328e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552.part --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552.part --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG nova.virt.images [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] c965e1a3-11e6-4bd9-aeec-2895d651c85f was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 16:33:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552.part /opt/stack/data/nova/instances/_base/90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552.converted {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552.part /opt/stack/data/nova/instances/_base/90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552.converted" returned: 0 in 0.173s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552.converted --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552.converted --force-share --output=json" returned: 0 in 0.166s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.047s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552 --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552 --force-share --output=json" returned: 0 in 0.175s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Acquiring lock "90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552 --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Updating instance_info_cache with network_info: [{"id": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "address": "fa:16:3e:11:4b:40", "network": {"id": "4ec80c56-7d1a-4fbe-81a2-7d12e69c94e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5225565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d63eb933f4d40cdb34d3a27c76c9720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d2e6e-6d", "ovs_interfaceid": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Releasing lock "refresh_cache-7bcc1e42-532f-4fb6-984e-cdf659cfef7c" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Instance network_info: |[{"id": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "address": "fa:16:3e:11:4b:40", "network": {"id": "4ec80c56-7d1a-4fbe-81a2-7d12e69c94e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5225565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d63eb933f4d40cdb34d3a27c76c9720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d2e6e-6d", "ovs_interfaceid": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8383ba77-1559-429a-a6e3-1196f2db3b96 req-e70edcb1-588b-43ec-99f0-c3f0f14c7f13 service nova] Acquired lock "refresh_cache-7bcc1e42-532f-4fb6-984e-cdf659cfef7c" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-8383ba77-1559-429a-a6e3-1196f2db3b96 req-e70edcb1-588b-43ec-99f0-c3f0f14c7f13 service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Refreshing network info cache for port 0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Start _get_guest_xml network_info=[{"id": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "address": "fa:16:3e:11:4b:40", "network": {"id": "4ec80c56-7d1a-4fbe-81a2-7d12e69c94e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5225565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d63eb933f4d40cdb34d3a27c76c9720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d2e6e-6d", "ovs_interfaceid": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:33:43 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:33:43 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:33:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1861677714',display_name='tempest-VolumesAssistedSnapshotsTest-server-1861677714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1861677714',id=4,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAD6vhA8PO2oSAh8Sc4+JzGfPF/3zRcrYx4SD5pASLfp4jCpmm2+LJmv6VLZ/pZ6yoGGXgaMequpz4smViMr3Wn4oDksLo1C+sDYGxXE5OeUt8W8UyErllgE3kGe7X00iQ==',key_name='tempest-keypair-460922789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d63eb933f4d40cdb34d3a27c76c9720',ramdisk_id='',reservation_id='r-rttbas3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1035695306',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1035695306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:33:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0eed7686d5eb46b99f8872f4eabc1f72',uuid=7bcc1e42-532f-4fb6-984e-cdf659cfef7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "address": "fa:16:3e:11:4b:40", "network": {"id": "4ec80c56-7d1a-4fbe-81a2-7d12e69c94e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5225565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d63eb933f4d40cdb34d3a27c76c9720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d2e6e-6d", "ovs_interfaceid": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Converting VIF {"id": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "address": "fa:16:3e:11:4b:40", "network": {"id": "4ec80c56-7d1a-4fbe-81a2-7d12e69c94e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5225565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d63eb933f4d40cdb34d3a27c76c9720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d2e6e-6d", "ovs_interfaceid": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:4b:40,bridge_name='br-int',has_traffic_filtering=True,id=0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f,network=Network(4ec80c56-7d1a-4fbe-81a2-7d12e69c94e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9d2e6e-6d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bcc1e42-532f-4fb6-984e-cdf659cfef7c {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552 --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552,backing_fmt=raw /opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:33:43 user nova-compute[73091]:   <uuid>7bcc1e42-532f-4fb6-984e-cdf659cfef7c</uuid>
Aug 09 16:33:43 user nova-compute[73091]:   <name>instance-00000004</name>
Aug 09 16:33:43 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:33:43 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:33:43 user nova-compute[73091]:   <metadata>
Aug 09 16:33:43 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:33:43 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:33:43 user nova-compute[73091]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1861677714</nova:name>
Aug 09 16:33:43 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:33:43</nova:creationTime>
Aug 09 16:33:43 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:33:43 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:33:43 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:33:43 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:33:43 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:33:43 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:33:43 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:33:43 user nova-compute[73091]:       <nova:owner>
Aug 09 16:33:43 user nova-compute[73091]:         <nova:user uuid="0eed7686d5eb46b99f8872f4eabc1f72">tempest-VolumesAssistedSnapshotsTest-1035695306-project-member</nova:user>
Aug 09 16:33:43 user nova-compute[73091]:         <nova:project uuid="1d63eb933f4d40cdb34d3a27c76c9720">tempest-VolumesAssistedSnapshotsTest-1035695306</nova:project>
Aug 09 16:33:43 user nova-compute[73091]:       </nova:owner>
Aug 09 16:33:43 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:33:43 user nova-compute[73091]:       <nova:ports>
Aug 09 16:33:43 user nova-compute[73091]:         <nova:port uuid="0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f">
Aug 09 16:33:43 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 16:33:43 user nova-compute[73091]:         </nova:port>
Aug 09 16:33:43 user nova-compute[73091]:       </nova:ports>
Aug 09 16:33:43 user nova-compute[73091]:     </nova:instance>
Aug 09 16:33:43 user nova-compute[73091]:   </metadata>
Aug 09 16:33:43 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:33:43 user nova-compute[73091]:     <system>
Aug 09 16:33:43 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:33:43 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:33:43 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:33:43 user nova-compute[73091]:       <entry name="serial">7bcc1e42-532f-4fb6-984e-cdf659cfef7c</entry>
Aug 09 16:33:43 user nova-compute[73091]:       <entry name="uuid">7bcc1e42-532f-4fb6-984e-cdf659cfef7c</entry>
Aug 09 16:33:43 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:33:43 user nova-compute[73091]:     </system>
Aug 09 16:33:43 user nova-compute[73091]:   </sysinfo>
Aug 09 16:33:43 user nova-compute[73091]:   <os>
Aug 09 16:33:43 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:33:43 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:33:43 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:33:43 user nova-compute[73091]:   </os>
Aug 09 16:33:43 user nova-compute[73091]:   <features>
Aug 09 16:33:43 user nova-compute[73091]:     <acpi/>
Aug 09 16:33:43 user nova-compute[73091]:     <apic/>
Aug 09 16:33:43 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:33:43 user nova-compute[73091]:   </features>
Aug 09 16:33:43 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:33:43 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:33:43 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:33:43 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:33:43 user nova-compute[73091]:   </clock>
Aug 09 16:33:43 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:33:43 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:33:43 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:33:43 user nova-compute[73091]:   </cpu>
Aug 09 16:33:43 user nova-compute[73091]:   <devices>
Aug 09 16:33:43 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:33:43 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:33:43 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk"/>
Aug 09 16:33:43 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:33:43 user nova-compute[73091]:     </disk>
Aug 09 16:33:43 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:33:43 user nova-compute[73091]:       <mac address="fa:16:3e:11:4b:40"/>
Aug 09 16:33:43 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:33:43 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:33:43 user nova-compute[73091]:       <target dev="tap0c9d2e6e-6d"/>
Aug 09 16:33:43 user nova-compute[73091]:     </interface>
Aug 09 16:33:43 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:33:43 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/console.log" append="off"/>
Aug 09 16:33:43 user nova-compute[73091]:     </serial>
Aug 09 16:33:43 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:33:43 user nova-compute[73091]:     <video>
Aug 09 16:33:43 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:33:43 user nova-compute[73091]:     </video>
Aug 09 16:33:43 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:33:43 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:33:43 user nova-compute[73091]:     </rng>
Aug 09 16:33:43 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:33:43 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:33:43 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:33:43 user nova-compute[73091]:     </memballoon>
Aug 09 16:33:43 user nova-compute[73091]:   </devices>
Aug 09 16:33:43 user nova-compute[73091]: </domain>
Aug 09 16:33:43 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:33:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1861677714',display_name='tempest-VolumesAssistedSnapshotsTest-server-1861677714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1861677714',id=4,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAD6vhA8PO2oSAh8Sc4+JzGfPF/3zRcrYx4SD5pASLfp4jCpmm2+LJmv6VLZ/pZ6yoGGXgaMequpz4smViMr3Wn4oDksLo1C+sDYGxXE5OeUt8W8UyErllgE3kGe7X00iQ==',key_name='tempest-keypair-460922789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d63eb933f4d40cdb34d3a27c76c9720',ramdisk_id='',reservation_id='r-rttbas3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1035695306',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1035695306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:33:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0eed7686d5eb46b99f8872f4eabc1f72',uuid=7bcc1e42-532f-4fb6-984e-cdf659cfef7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "address": "fa:16:3e:11:4b:40", "network": {"id": "4ec80c56-7d1a-4fbe-81a2-7d12e69c94e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5225565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d63eb933f4d40cdb34d3a27c76c9720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d2e6e-6d", "ovs_interfaceid": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Converting VIF {"id": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "address": "fa:16:3e:11:4b:40", "network": {"id": "4ec80c56-7d1a-4fbe-81a2-7d12e69c94e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5225565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d63eb933f4d40cdb34d3a27c76c9720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d2e6e-6d", "ovs_interfaceid": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:4b:40,bridge_name='br-int',has_traffic_filtering=True,id=0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f,network=Network(4ec80c56-7d1a-4fbe-81a2-7d12e69c94e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9d2e6e-6d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG os_vif [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:4b:40,bridge_name='br-int',has_traffic_filtering=True,id=0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f,network=Network(4ec80c56-7d1a-4fbe-81a2-7d12e69c94e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9d2e6e-6d') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552,backing_fmt=raw /opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk 1073741824" returned: 0 in 0.060s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552 --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c9d2e6e-6d, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0c9d2e6e-6d, col_values=(('external_ids', {'iface-id': '0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:4b:40', 'vm-uuid': '7bcc1e42-532f-4fb6-984e-cdf659cfef7c'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:43 user nova-compute[73091]: INFO os_vif [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:4b:40,bridge_name='br-int',has_traffic_filtering=True,id=0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f,network=Network(4ec80c56-7d1a-4fbe-81a2-7d12e69c94e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9d2e6e-6d')
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] No VIF found with MAC fa:16:3e:11:4b:40, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552 --force-share --output=json" returned: 0 in 0.168s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:33:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:44 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Cannot resize image /opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:33:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lazy-loading 'migration_context' on Instance uuid b791bded-3eb5-4bf8-a14e-eae269ae2043 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:33:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:33:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Ensure instance console log exists: /opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:33:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:44 user nova-compute[73091]: DEBUG nova.network.neutron [req-8383ba77-1559-429a-a6e3-1196f2db3b96 req-e70edcb1-588b-43ec-99f0-c3f0f14c7f13 service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Updated VIF entry in instance network info cache for port 0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:33:44 user nova-compute[73091]: DEBUG nova.network.neutron [req-8383ba77-1559-429a-a6e3-1196f2db3b96 req-e70edcb1-588b-43ec-99f0-c3f0f14c7f13 service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Updating instance_info_cache with network_info: [{"id": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "address": "fa:16:3e:11:4b:40", "network": {"id": "4ec80c56-7d1a-4fbe-81a2-7d12e69c94e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5225565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d63eb933f4d40cdb34d3a27c76c9720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d2e6e-6d", "ovs_interfaceid": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:33:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8383ba77-1559-429a-a6e3-1196f2db3b96 req-e70edcb1-588b-43ec-99f0-c3f0f14c7f13 service nova] Releasing lock "refresh_cache-7bcc1e42-532f-4fb6-984e-cdf659cfef7c" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:33:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:44 user nova-compute[73091]: DEBUG nova.network.neutron [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Successfully created port: d368f4bb-4681-4152-b639-3be5601c73b9 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:33:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquiring lock "ec2187af-1b88-4c23-abba-2f09db3057d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:33:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-239111d0-519b-41b1-9d5d-de084202974b req-db4fec4b-ec5e-49ee-acd2-dc860e1f4c2f service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Received event network-vif-plugged-0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-239111d0-519b-41b1-9d5d-de084202974b req-db4fec4b-ec5e-49ee-acd2-dc860e1f4c2f service nova] Acquiring lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-239111d0-519b-41b1-9d5d-de084202974b req-db4fec4b-ec5e-49ee-acd2-dc860e1f4c2f service nova] Lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-239111d0-519b-41b1-9d5d-de084202974b req-db4fec4b-ec5e-49ee-acd2-dc860e1f4c2f service nova] Lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-239111d0-519b-41b1-9d5d-de084202974b req-db4fec4b-ec5e-49ee-acd2-dc860e1f4c2f service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] No waiting events found dispatching network-vif-plugged-0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:33:45 user nova-compute[73091]: WARNING nova.compute.manager [req-239111d0-519b-41b1-9d5d-de084202974b req-db4fec4b-ec5e-49ee-acd2-dc860e1f4c2f service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Received unexpected event network-vif-plugged-0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f for instance with vm_state building and task_state spawning.
Aug 09 16:33:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:33:45 user nova-compute[73091]: INFO nova.compute.claims [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Claim successful on node user
Aug 09 16:33:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:46 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:33:46 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:33:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.574s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:33:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:33:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:33:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:33:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:33:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Successfully updated port: d368f4bb-4681-4152-b639-3be5601c73b9 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:33:46 user nova-compute[73091]: DEBUG nova.policy [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc4caea945424320a1b8ed52721c0ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ef9b2241b143deb605e774ce34998e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:33:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Acquiring lock "refresh_cache-b791bded-3eb5-4bf8-a14e-eae269ae2043" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:33:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Acquired lock "refresh_cache-b791bded-3eb5-4bf8-a14e-eae269ae2043" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:33:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:33:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:33:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:33:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Creating image(s)
Aug 09 16:33:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "/opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "/opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk 1073741824" returned: 0 in 0.063s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.169s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Updating instance_info_cache with network_info: [{"id": "d368f4bb-4681-4152-b639-3be5601c73b9", "address": "fa:16:3e:8c:25:9d", "network": {"id": "9d0306b7-548e-47e5-b869-9d479e62278a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-633341944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea346b28dbcf4ba6b8de576c3326328e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd368f4bb-46", "ovs_interfaceid": "d368f4bb-4681-4152-b639-3be5601c73b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Releasing lock "refresh_cache-b791bded-3eb5-4bf8-a14e-eae269ae2043" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Instance network_info: |[{"id": "d368f4bb-4681-4152-b639-3be5601c73b9", "address": "fa:16:3e:8c:25:9d", "network": {"id": "9d0306b7-548e-47e5-b869-9d479e62278a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-633341944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea346b28dbcf4ba6b8de576c3326328e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd368f4bb-46", "ovs_interfaceid": "d368f4bb-4681-4152-b639-3be5601c73b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Start _get_guest_xml network_info=[{"id": "d368f4bb-4681-4152-b639-3be5601c73b9", "address": "fa:16:3e:8c:25:9d", "network": {"id": "9d0306b7-548e-47e5-b869-9d479e62278a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-633341944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea346b28dbcf4ba6b8de576c3326328e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd368f4bb-46", "ovs_interfaceid": "d368f4bb-4681-4152-b639-3be5601c73b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:33:34Z,direct_url=<?>,disk_format='qcow2',id=c965e1a3-11e6-4bd9-aeec-2895d651c85f,min_disk=0,min_ram=0,name='',owner='b409ac720889429cbe6cc2a34197f984',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:33:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/sda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'encrypted': False, 'encryption_format': None, 'image_id': 'c965e1a3-11e6-4bd9-aeec-2895d651c85f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:33:47 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:33:47 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:33:34Z,direct_url=<?>,disk_format='qcow2',id=c965e1a3-11e6-4bd9-aeec-2895d651c85f,min_disk=0,min_ram=0,name='',owner='b409ac720889429cbe6cc2a34197f984',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:33:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:33:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-546596736',display_name='tempest-AttachSCSIVolumeTestJSON-server-546596736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-546596736',id=5,image_ref='c965e1a3-11e6-4bd9-aeec-2895d651c85f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgjvs5xoAjoaV9QOLh1ZIEL6rn1q791A4u12WEh4x7I+6m7+bo8e97IPtgmDCfyJUMD1oEL3ZBw6EWmi6Piovl3eBwkbALerIWZWni2x2r7gmcJLseLnvlbOFysVwQJ0w==',key_name='tempest-keypair-1544024463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea346b28dbcf4ba6b8de576c3326328e',ramdisk_id='',reservation_id='r-7izc9bze',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c965e1a3-11e6-4bd9-aeec-2895d651c85f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1618710579',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1618710579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:33:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19667f77ab164d97851ee7a334141bf5',uuid=b791bded-3eb5-4bf8-a14e-eae269ae2043,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d368f4bb-4681-4152-b639-3be5601c73b9", "address": "fa:16:3e:8c:25:9d", "network": {"id": "9d0306b7-548e-47e5-b869-9d479e62278a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-633341944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea346b28dbcf4ba6b8de576c3326328e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd368f4bb-46", "ovs_interfaceid": "d368f4bb-4681-4152-b639-3be5601c73b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Converting VIF {"id": "d368f4bb-4681-4152-b639-3be5601c73b9", "address": "fa:16:3e:8c:25:9d", "network": {"id": "9d0306b7-548e-47e5-b869-9d479e62278a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-633341944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea346b28dbcf4ba6b8de576c3326328e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd368f4bb-46", "ovs_interfaceid": "d368f4bb-4681-4152-b639-3be5601c73b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:25:9d,bridge_name='br-int',has_traffic_filtering=True,id=d368f4bb-4681-4152-b639-3be5601c73b9,network=Network(9d0306b7-548e-47e5-b869-9d479e62278a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd368f4bb-46') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.objects.instance [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lazy-loading 'pci_devices' on Instance uuid b791bded-3eb5-4bf8-a14e-eae269ae2043 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Cannot resize image /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lazy-loading 'migration_context' on Instance uuid ec2187af-1b88-4c23-abba-2f09db3057d6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:33:47 user nova-compute[73091]:   <uuid>b791bded-3eb5-4bf8-a14e-eae269ae2043</uuid>
Aug 09 16:33:47 user nova-compute[73091]:   <name>instance-00000005</name>
Aug 09 16:33:47 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:33:47 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:33:47 user nova-compute[73091]:   <metadata>
Aug 09 16:33:47 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:33:47 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:33:47 user nova-compute[73091]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-546596736</nova:name>
Aug 09 16:33:47 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:33:47</nova:creationTime>
Aug 09 16:33:47 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:33:47 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:33:47 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:33:47 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:33:47 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:33:47 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:33:47 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:33:47 user nova-compute[73091]:       <nova:owner>
Aug 09 16:33:47 user nova-compute[73091]:         <nova:user uuid="19667f77ab164d97851ee7a334141bf5">tempest-AttachSCSIVolumeTestJSON-1618710579-project-member</nova:user>
Aug 09 16:33:47 user nova-compute[73091]:         <nova:project uuid="ea346b28dbcf4ba6b8de576c3326328e">tempest-AttachSCSIVolumeTestJSON-1618710579</nova:project>
Aug 09 16:33:47 user nova-compute[73091]:       </nova:owner>
Aug 09 16:33:47 user nova-compute[73091]:       <nova:root type="image" uuid="c965e1a3-11e6-4bd9-aeec-2895d651c85f"/>
Aug 09 16:33:47 user nova-compute[73091]:       <nova:ports>
Aug 09 16:33:47 user nova-compute[73091]:         <nova:port uuid="d368f4bb-4681-4152-b639-3be5601c73b9">
Aug 09 16:33:47 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 16:33:47 user nova-compute[73091]:         </nova:port>
Aug 09 16:33:47 user nova-compute[73091]:       </nova:ports>
Aug 09 16:33:47 user nova-compute[73091]:     </nova:instance>
Aug 09 16:33:47 user nova-compute[73091]:   </metadata>
Aug 09 16:33:47 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:33:47 user nova-compute[73091]:     <system>
Aug 09 16:33:47 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:33:47 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:33:47 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:33:47 user nova-compute[73091]:       <entry name="serial">b791bded-3eb5-4bf8-a14e-eae269ae2043</entry>
Aug 09 16:33:47 user nova-compute[73091]:       <entry name="uuid">b791bded-3eb5-4bf8-a14e-eae269ae2043</entry>
Aug 09 16:33:47 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:33:47 user nova-compute[73091]:     </system>
Aug 09 16:33:47 user nova-compute[73091]:   </sysinfo>
Aug 09 16:33:47 user nova-compute[73091]:   <os>
Aug 09 16:33:47 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:33:47 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:33:47 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:33:47 user nova-compute[73091]:   </os>
Aug 09 16:33:47 user nova-compute[73091]:   <features>
Aug 09 16:33:47 user nova-compute[73091]:     <acpi/>
Aug 09 16:33:47 user nova-compute[73091]:     <apic/>
Aug 09 16:33:47 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:33:47 user nova-compute[73091]:   </features>
Aug 09 16:33:47 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:33:47 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:33:47 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:33:47 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:33:47 user nova-compute[73091]:   </clock>
Aug 09 16:33:47 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:33:47 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:33:47 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:33:47 user nova-compute[73091]:   </cpu>
Aug 09 16:33:47 user nova-compute[73091]:   <devices>
Aug 09 16:33:47 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:33:47 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:33:47 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk"/>
Aug 09 16:33:47 user nova-compute[73091]:       <target dev="sda" bus="scsi"/>
Aug 09 16:33:47 user nova-compute[73091]:       <address type="drive" controller="0" unit="0"/>
Aug 09 16:33:47 user nova-compute[73091]:     </disk>
Aug 09 16:33:47 user nova-compute[73091]:     <disk type="file" device="cdrom">
Aug 09 16:33:47 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 16:33:47 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk.config"/>
Aug 09 16:33:47 user nova-compute[73091]:       <target dev="sdb" bus="scsi"/>
Aug 09 16:33:47 user nova-compute[73091]:       <address type="drive" controller="0" unit="1"/>
Aug 09 16:33:47 user nova-compute[73091]:     </disk>
Aug 09 16:33:47 user nova-compute[73091]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 09 16:33:47 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:33:47 user nova-compute[73091]:       <mac address="fa:16:3e:8c:25:9d"/>
Aug 09 16:33:47 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:33:47 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:33:47 user nova-compute[73091]:       <target dev="tapd368f4bb-46"/>
Aug 09 16:33:47 user nova-compute[73091]:     </interface>
Aug 09 16:33:47 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:33:47 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/console.log" append="off"/>
Aug 09 16:33:47 user nova-compute[73091]:     </serial>
Aug 09 16:33:47 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:33:47 user nova-compute[73091]:     <video>
Aug 09 16:33:47 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:33:47 user nova-compute[73091]:     </video>
Aug 09 16:33:47 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:33:47 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:33:47 user nova-compute[73091]:     </rng>
Aug 09 16:33:47 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:33:47 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:33:47 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:33:47 user nova-compute[73091]:     </memballoon>
Aug 09 16:33:47 user nova-compute[73091]:   </devices>
Aug 09 16:33:47 user nova-compute[73091]: </domain>
Aug 09 16:33:47 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:33:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-546596736',display_name='tempest-AttachSCSIVolumeTestJSON-server-546596736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-546596736',id=5,image_ref='c965e1a3-11e6-4bd9-aeec-2895d651c85f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgjvs5xoAjoaV9QOLh1ZIEL6rn1q791A4u12WEh4x7I+6m7+bo8e97IPtgmDCfyJUMD1oEL3ZBw6EWmi6Piovl3eBwkbALerIWZWni2x2r7gmcJLseLnvlbOFysVwQJ0w==',key_name='tempest-keypair-1544024463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea346b28dbcf4ba6b8de576c3326328e',ramdisk_id='',reservation_id='r-7izc9bze',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c965e1a3-11e6-4bd9-aeec-2895d651c85f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1618710579',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1618710579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:33:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19667f77ab164d97851ee7a334141bf5',uuid=b791bded-3eb5-4bf8-a14e-eae269ae2043,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d368f4bb-4681-4152-b639-3be5601c73b9", "address": "fa:16:3e:8c:25:9d", "network": {"id": "9d0306b7-548e-47e5-b869-9d479e62278a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-633341944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea346b28dbcf4ba6b8de576c3326328e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd368f4bb-46", "ovs_interfaceid": "d368f4bb-4681-4152-b639-3be5601c73b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Converting VIF {"id": "d368f4bb-4681-4152-b639-3be5601c73b9", "address": "fa:16:3e:8c:25:9d", "network": {"id": "9d0306b7-548e-47e5-b869-9d479e62278a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-633341944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea346b28dbcf4ba6b8de576c3326328e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd368f4bb-46", "ovs_interfaceid": "d368f4bb-4681-4152-b639-3be5601c73b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:25:9d,bridge_name='br-int',has_traffic_filtering=True,id=d368f4bb-4681-4152-b639-3be5601c73b9,network=Network(9d0306b7-548e-47e5-b869-9d479e62278a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd368f4bb-46') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG os_vif [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:25:9d,bridge_name='br-int',has_traffic_filtering=True,id=d368f4bb-4681-4152-b639-3be5601c73b9,network=Network(9d0306b7-548e-47e5-b869-9d479e62278a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd368f4bb-46') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Ensure instance console log exists: /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Successfully created port: 416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd368f4bb-46, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd368f4bb-46, col_values=(('external_ids', {'iface-id': 'd368f4bb-4681-4152-b639-3be5601c73b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:25:9d', 'vm-uuid': 'b791bded-3eb5-4bf8-a14e-eae269ae2043'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:47 user nova-compute[73091]: INFO os_vif [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:25:9d,bridge_name='br-int',has_traffic_filtering=True,id=d368f4bb-4681-4152-b639-3be5601c73b9,network=Network(9d0306b7-548e-47e5-b869-9d479e62278a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd368f4bb-46')
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] No BDM found with device name sda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] No VIF found with MAC fa:16:3e:8c:25:9d, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:33:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Using config drive
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598827.8823555, 7bcc1e42-532f-4fb6-984e-cdf659cfef7c => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:33:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] VM Resumed (Lifecycle Event)
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:33:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Instance spawned successfully.
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-43a396ab-28df-4e08-99ec-2c4f749b1c6e req-5f26e97d-88c7-4722-a6be-c6aecffbb922 service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Received event network-vif-plugged-0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-43a396ab-28df-4e08-99ec-2c4f749b1c6e req-5f26e97d-88c7-4722-a6be-c6aecffbb922 service nova] Acquiring lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-43a396ab-28df-4e08-99ec-2c4f749b1c6e req-5f26e97d-88c7-4722-a6be-c6aecffbb922 service nova] Lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-43a396ab-28df-4e08-99ec-2c4f749b1c6e req-5f26e97d-88c7-4722-a6be-c6aecffbb922 service nova] Lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-43a396ab-28df-4e08-99ec-2c4f749b1c6e req-5f26e97d-88c7-4722-a6be-c6aecffbb922 service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] No waiting events found dispatching network-vif-plugged-0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:33:47 user nova-compute[73091]: WARNING nova.compute.manager [req-43a396ab-28df-4e08-99ec-2c4f749b1c6e req-5f26e97d-88c7-4722-a6be-c6aecffbb922 service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Received unexpected event network-vif-plugged-0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f for instance with vm_state building and task_state spawning.
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-43a396ab-28df-4e08-99ec-2c4f749b1c6e req-5f26e97d-88c7-4722-a6be-c6aecffbb922 service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Received event network-changed-d368f4bb-4681-4152-b639-3be5601c73b9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-43a396ab-28df-4e08-99ec-2c4f749b1c6e req-5f26e97d-88c7-4722-a6be-c6aecffbb922 service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Refreshing instance network info cache due to event network-changed-d368f4bb-4681-4152-b639-3be5601c73b9. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-43a396ab-28df-4e08-99ec-2c4f749b1c6e req-5f26e97d-88c7-4722-a6be-c6aecffbb922 service nova] Acquiring lock "refresh_cache-b791bded-3eb5-4bf8-a14e-eae269ae2043" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-43a396ab-28df-4e08-99ec-2c4f749b1c6e req-5f26e97d-88c7-4722-a6be-c6aecffbb922 service nova] Acquired lock "refresh_cache-b791bded-3eb5-4bf8-a14e-eae269ae2043" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.network.neutron [req-43a396ab-28df-4e08-99ec-2c4f749b1c6e req-5f26e97d-88c7-4722-a6be-c6aecffbb922 service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Refreshing network info cache for port d368f4bb-4681-4152-b639-3be5601c73b9 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:33:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:33:47 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598827.8833835, 7bcc1e42-532f-4fb6-984e-cdf659cfef7c => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:33:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] VM Started (Lifecycle Event)
Aug 09 16:33:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:33:48 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:33:48 user nova-compute[73091]: INFO nova.compute.manager [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Took 8.20 seconds to spawn the instance on the hypervisor.
Aug 09 16:33:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:48 user nova-compute[73091]: INFO nova.compute.manager [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Took 9.16 seconds to build instance.
Aug 09 16:33:48 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Creating config drive at /opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk.config
Aug 09 16:33:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkplounnp {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b43c4c01-ab5f-4ca4-8295-db99f3a9906e tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.457s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkplounnp" returned: 0 in 0.053s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-43a396ab-28df-4e08-99ec-2c4f749b1c6e req-5f26e97d-88c7-4722-a6be-c6aecffbb922 service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Updated VIF entry in instance network info cache for port d368f4bb-4681-4152-b639-3be5601c73b9. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:33:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-43a396ab-28df-4e08-99ec-2c4f749b1c6e req-5f26e97d-88c7-4722-a6be-c6aecffbb922 service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Updating instance_info_cache with network_info: [{"id": "d368f4bb-4681-4152-b639-3be5601c73b9", "address": "fa:16:3e:8c:25:9d", "network": {"id": "9d0306b7-548e-47e5-b869-9d479e62278a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-633341944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea346b28dbcf4ba6b8de576c3326328e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd368f4bb-46", "ovs_interfaceid": "d368f4bb-4681-4152-b639-3be5601c73b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:33:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-43a396ab-28df-4e08-99ec-2c4f749b1c6e req-5f26e97d-88c7-4722-a6be-c6aecffbb922 service nova] Releasing lock "refresh_cache-b791bded-3eb5-4bf8-a14e-eae269ae2043" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:33:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Successfully updated port: 416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:33:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Acquiring lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquiring lock "refresh_cache-ec2187af-1b88-4c23-abba-2f09db3057d6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:33:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquired lock "refresh_cache-ec2187af-1b88-4c23-abba-2f09db3057d6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:33:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:33:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:33:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-e57ab627-6561-4b26-8925-a7eed0e09c19 req-7b61897c-39fa-4244-8e19-e1a9615c48a3 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received event network-changed-416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-e57ab627-6561-4b26-8925-a7eed0e09c19 req-7b61897c-39fa-4244-8e19-e1a9615c48a3 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Refreshing instance network info cache due to event network-changed-416fe3a2-a0ea-4c8e-81c6-7374e6205456. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:33:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e57ab627-6561-4b26-8925-a7eed0e09c19 req-7b61897c-39fa-4244-8e19-e1a9615c48a3 service nova] Acquiring lock "refresh_cache-ec2187af-1b88-4c23-abba-2f09db3057d6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:33:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:33:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:33:49 user nova-compute[73091]: INFO nova.compute.claims [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Claim successful on node user
Aug 09 16:33:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:49 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.603s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Updating instance_info_cache with network_info: [{"id": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "address": "fa:16:3e:f3:65:dc", "network": {"id": "4d26b33a-b351-4595-a0c5-788f2ecb7732", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-549846585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe3a2-a0", "ovs_interfaceid": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Releasing lock "refresh_cache-ec2187af-1b88-4c23-abba-2f09db3057d6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Instance network_info: |[{"id": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "address": "fa:16:3e:f3:65:dc", "network": {"id": "4d26b33a-b351-4595-a0c5-788f2ecb7732", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-549846585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe3a2-a0", "ovs_interfaceid": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e57ab627-6561-4b26-8925-a7eed0e09c19 req-7b61897c-39fa-4244-8e19-e1a9615c48a3 service nova] Acquired lock "refresh_cache-ec2187af-1b88-4c23-abba-2f09db3057d6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.network.neutron [req-e57ab627-6561-4b26-8925-a7eed0e09c19 req-7b61897c-39fa-4244-8e19-e1a9615c48a3 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Refreshing network info cache for port 416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Start _get_guest_xml network_info=[{"id": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "address": "fa:16:3e:f3:65:dc", "network": {"id": "4d26b33a-b351-4595-a0c5-788f2ecb7732", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-549846585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe3a2-a0", "ovs_interfaceid": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:33:50 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:33:50 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:33:50 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:33:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-232794309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-232794309',id=6,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKvUekvW9eV5PNFmOyGiNtiOlJk5szt6jF7Nn2Cjo8H7lw7fn57Jt1UoYyP8a1MRbAqNPdKj8VAN21vacR3qFtYUOYtrJGDNRvt4Yzt0u8rIA+SenASC0Z9S6AJgV5gFw==',key_name='tempest-keypair-1792812162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3ef9b2241b143deb605e774ce34998e',ramdisk_id='',reservation_id='r-yr1ytpcl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-357169138',owner_user_name='tempest-TaggedAttachmentsTest-357169138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc4caea945424320a1b8ed52721c0ccf',uuid=ec2187af-1b88-4c23-abba-2f09db3057d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "address": "fa:16:3e:f3:65:dc", "network": {"id": "4d26b33a-b351-4595-a0c5-788f2ecb7732", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-549846585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe3a2-a0", "ovs_interfaceid": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Converting VIF {"id": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "address": "fa:16:3e:f3:65:dc", "network": {"id": "4d26b33a-b351-4595-a0c5-788f2ecb7732", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-549846585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe3a2-a0", "ovs_interfaceid": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:65:dc,bridge_name='br-int',has_traffic_filtering=True,id=416fe3a2-a0ea-4c8e-81c6-7374e6205456,network=Network(4d26b33a-b351-4595-a0c5-788f2ecb7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416fe3a2-a0') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lazy-loading 'pci_devices' on Instance uuid ec2187af-1b88-4c23-abba-2f09db3057d6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:33:50 user nova-compute[73091]:   <uuid>ec2187af-1b88-4c23-abba-2f09db3057d6</uuid>
Aug 09 16:33:50 user nova-compute[73091]:   <name>instance-00000006</name>
Aug 09 16:33:50 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:33:50 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:33:50 user nova-compute[73091]:   <metadata>
Aug 09 16:33:50 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:33:50 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:33:50 user nova-compute[73091]:       <nova:name>tempest-device-tagging-server-232794309</nova:name>
Aug 09 16:33:50 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:33:50</nova:creationTime>
Aug 09 16:33:50 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:33:50 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:33:50 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:33:50 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:33:50 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:33:50 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:33:50 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:33:50 user nova-compute[73091]:       <nova:owner>
Aug 09 16:33:50 user nova-compute[73091]:         <nova:user uuid="bc4caea945424320a1b8ed52721c0ccf">tempest-TaggedAttachmentsTest-357169138-project-member</nova:user>
Aug 09 16:33:50 user nova-compute[73091]:         <nova:project uuid="a3ef9b2241b143deb605e774ce34998e">tempest-TaggedAttachmentsTest-357169138</nova:project>
Aug 09 16:33:50 user nova-compute[73091]:       </nova:owner>
Aug 09 16:33:50 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:33:50 user nova-compute[73091]:       <nova:ports>
Aug 09 16:33:50 user nova-compute[73091]:         <nova:port uuid="416fe3a2-a0ea-4c8e-81c6-7374e6205456">
Aug 09 16:33:50 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 16:33:50 user nova-compute[73091]:         </nova:port>
Aug 09 16:33:50 user nova-compute[73091]:       </nova:ports>
Aug 09 16:33:50 user nova-compute[73091]:     </nova:instance>
Aug 09 16:33:50 user nova-compute[73091]:   </metadata>
Aug 09 16:33:50 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:33:50 user nova-compute[73091]:     <system>
Aug 09 16:33:50 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:33:50 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:33:50 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:33:50 user nova-compute[73091]:       <entry name="serial">ec2187af-1b88-4c23-abba-2f09db3057d6</entry>
Aug 09 16:33:50 user nova-compute[73091]:       <entry name="uuid">ec2187af-1b88-4c23-abba-2f09db3057d6</entry>
Aug 09 16:33:50 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:33:50 user nova-compute[73091]:     </system>
Aug 09 16:33:50 user nova-compute[73091]:   </sysinfo>
Aug 09 16:33:50 user nova-compute[73091]:   <os>
Aug 09 16:33:50 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:33:50 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:33:50 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:33:50 user nova-compute[73091]:   </os>
Aug 09 16:33:50 user nova-compute[73091]:   <features>
Aug 09 16:33:50 user nova-compute[73091]:     <acpi/>
Aug 09 16:33:50 user nova-compute[73091]:     <apic/>
Aug 09 16:33:50 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:33:50 user nova-compute[73091]:   </features>
Aug 09 16:33:50 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:33:50 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:33:50 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:33:50 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:33:50 user nova-compute[73091]:   </clock>
Aug 09 16:33:50 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:33:50 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:33:50 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:33:50 user nova-compute[73091]:   </cpu>
Aug 09 16:33:50 user nova-compute[73091]:   <devices>
Aug 09 16:33:50 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:33:50 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:33:50 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk"/>
Aug 09 16:33:50 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:33:50 user nova-compute[73091]:     </disk>
Aug 09 16:33:50 user nova-compute[73091]:     <disk type="file" device="cdrom">
Aug 09 16:33:50 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 16:33:50 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk.config"/>
Aug 09 16:33:50 user nova-compute[73091]:       <target dev="hda" bus="ide"/>
Aug 09 16:33:50 user nova-compute[73091]:     </disk>
Aug 09 16:33:50 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:33:50 user nova-compute[73091]:       <mac address="fa:16:3e:f3:65:dc"/>
Aug 09 16:33:50 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:33:50 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:33:50 user nova-compute[73091]:       <target dev="tap416fe3a2-a0"/>
Aug 09 16:33:50 user nova-compute[73091]:     </interface>
Aug 09 16:33:50 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:33:50 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/console.log" append="off"/>
Aug 09 16:33:50 user nova-compute[73091]:     </serial>
Aug 09 16:33:50 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:33:50 user nova-compute[73091]:     <video>
Aug 09 16:33:50 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:33:50 user nova-compute[73091]:     </video>
Aug 09 16:33:50 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:33:50 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:33:50 user nova-compute[73091]:     </rng>
Aug 09 16:33:50 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:33:50 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:33:50 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:33:50 user nova-compute[73091]:     </memballoon>
Aug 09 16:33:50 user nova-compute[73091]:   </devices>
Aug 09 16:33:50 user nova-compute[73091]: </domain>
Aug 09 16:33:50 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:33:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-232794309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-232794309',id=6,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKvUekvW9eV5PNFmOyGiNtiOlJk5szt6jF7Nn2Cjo8H7lw7fn57Jt1UoYyP8a1MRbAqNPdKj8VAN21vacR3qFtYUOYtrJGDNRvt4Yzt0u8rIA+SenASC0Z9S6AJgV5gFw==',key_name='tempest-keypair-1792812162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3ef9b2241b143deb605e774ce34998e',ramdisk_id='',reservation_id='r-yr1ytpcl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-357169138',owner_user_name='tempest-TaggedAttachmentsTest-357169138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc4caea945424320a1b8ed52721c0ccf',uuid=ec2187af-1b88-4c23-abba-2f09db3057d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "address": "fa:16:3e:f3:65:dc", "network": {"id": "4d26b33a-b351-4595-a0c5-788f2ecb7732", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-549846585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe3a2-a0", "ovs_interfaceid": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Converting VIF {"id": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "address": "fa:16:3e:f3:65:dc", "network": {"id": "4d26b33a-b351-4595-a0c5-788f2ecb7732", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-549846585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe3a2-a0", "ovs_interfaceid": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:65:dc,bridge_name='br-int',has_traffic_filtering=True,id=416fe3a2-a0ea-4c8e-81c6-7374e6205456,network=Network(4d26b33a-b351-4595-a0c5-788f2ecb7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416fe3a2-a0') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG os_vif [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:65:dc,bridge_name='br-int',has_traffic_filtering=True,id=416fe3a2-a0ea-4c8e-81c6-7374e6205456,network=Network(4d26b33a-b351-4595-a0c5-788f2ecb7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416fe3a2-a0') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap416fe3a2-a0, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap416fe3a2-a0, col_values=(('external_ids', {'iface-id': '416fe3a2-a0ea-4c8e-81c6-7374e6205456', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:65:dc', 'vm-uuid': 'ec2187af-1b88-4c23-abba-2f09db3057d6'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:33:50 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Creating image(s)
Aug 09 16:33:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Acquiring lock "/opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "/opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "/opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:50 user nova-compute[73091]: INFO os_vif [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:65:dc,bridge_name='br-int',has_traffic_filtering=True,id=416fe3a2-a0ea-4c8e-81c6-7374e6205456,network=Network(4d26b33a-b351-4595-a0c5-788f2ecb7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416fe3a2-a0')
Aug 09 16:33:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.policy [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '867774990bd24469b81a99659005ccae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7167f5fdba4476783c578e63f388618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-3d645476-79db-4ad6-a399-59ec5213f122 req-ee06e88c-daa4-4ef2-871c-e8ae13e19a6b service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Received event network-vif-plugged-d368f4bb-4681-4152-b639-3be5601c73b9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3d645476-79db-4ad6-a399-59ec5213f122 req-ee06e88c-daa4-4ef2-871c-e8ae13e19a6b service nova] Acquiring lock "b791bded-3eb5-4bf8-a14e-eae269ae2043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3d645476-79db-4ad6-a399-59ec5213f122 req-ee06e88c-daa4-4ef2-871c-e8ae13e19a6b service nova] Lock "b791bded-3eb5-4bf8-a14e-eae269ae2043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3d645476-79db-4ad6-a399-59ec5213f122 req-ee06e88c-daa4-4ef2-871c-e8ae13e19a6b service nova] Lock "b791bded-3eb5-4bf8-a14e-eae269ae2043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-3d645476-79db-4ad6-a399-59ec5213f122 req-ee06e88c-daa4-4ef2-871c-e8ae13e19a6b service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] No waiting events found dispatching network-vif-plugged-d368f4bb-4681-4152-b639-3be5601c73b9 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:33:50 user nova-compute[73091]: WARNING nova.compute.manager [req-3d645476-79db-4ad6-a399-59ec5213f122 req-ee06e88c-daa4-4ef2-871c-e8ae13e19a6b service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Received unexpected event network-vif-plugged-d368f4bb-4681-4152-b639-3be5601c73b9 for instance with vm_state building and task_state spawning.
Aug 09 16:33:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] No BDM found with device name hda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] No VIF found with MAC fa:16:3e:f3:65:dc, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:33:50 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Using config drive
Aug 09 16:33:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk 1073741824" returned: 0 in 0.074s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:51 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Checking if we can resize image /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:33:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:51 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Creating config drive at /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk.config
Aug 09 16:33:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpa_bj3pjm {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:33:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpa_bj3pjm" returned: 0 in 0.106s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:33:51 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Cannot resize image /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:33:51 user nova-compute[73091]: DEBUG nova.objects.instance [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lazy-loading 'migration_context' on Instance uuid 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:33:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:33:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Ensure instance console log exists: /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:33:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:51 user nova-compute[73091]: DEBUG nova.network.neutron [req-e57ab627-6561-4b26-8925-a7eed0e09c19 req-7b61897c-39fa-4244-8e19-e1a9615c48a3 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Updated VIF entry in instance network info cache for port 416fe3a2-a0ea-4c8e-81c6-7374e6205456. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:33:51 user nova-compute[73091]: DEBUG nova.network.neutron [req-e57ab627-6561-4b26-8925-a7eed0e09c19 req-7b61897c-39fa-4244-8e19-e1a9615c48a3 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Updating instance_info_cache with network_info: [{"id": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "address": "fa:16:3e:f3:65:dc", "network": {"id": "4d26b33a-b351-4595-a0c5-788f2ecb7732", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-549846585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe3a2-a0", "ovs_interfaceid": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:33:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e57ab627-6561-4b26-8925-a7eed0e09c19 req-7b61897c-39fa-4244-8e19-e1a9615c48a3 service nova] Releasing lock "refresh_cache-ec2187af-1b88-4c23-abba-2f09db3057d6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:33:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Successfully created port: 218c7585-7957-41e4-88d8-6f04e4d4a9bc {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:33:52 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598832.6702092, b791bded-3eb5-4bf8-a14e-eae269ae2043 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:33:52 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] VM Resumed (Lifecycle Event)
Aug 09 16:33:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:33:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:33:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:52 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Instance spawned successfully.
Aug 09 16:33:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:33:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:33:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:52 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:33:52 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598832.673933, b791bded-3eb5-4bf8-a14e-eae269ae2043 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:33:52 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] VM Started (Lifecycle Event)
Aug 09 16:33:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-81f7ba4d-f4f9-4f9f-ae46-0fe94ff68eec req-2ba0817f-3329-4854-b037-f65814827341 service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Received event network-vif-plugged-d368f4bb-4681-4152-b639-3be5601c73b9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-81f7ba4d-f4f9-4f9f-ae46-0fe94ff68eec req-2ba0817f-3329-4854-b037-f65814827341 service nova] Acquiring lock "b791bded-3eb5-4bf8-a14e-eae269ae2043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-81f7ba4d-f4f9-4f9f-ae46-0fe94ff68eec req-2ba0817f-3329-4854-b037-f65814827341 service nova] Lock "b791bded-3eb5-4bf8-a14e-eae269ae2043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-81f7ba4d-f4f9-4f9f-ae46-0fe94ff68eec req-2ba0817f-3329-4854-b037-f65814827341 service nova] Lock "b791bded-3eb5-4bf8-a14e-eae269ae2043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-81f7ba4d-f4f9-4f9f-ae46-0fe94ff68eec req-2ba0817f-3329-4854-b037-f65814827341 service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] No waiting events found dispatching network-vif-plugged-d368f4bb-4681-4152-b639-3be5601c73b9 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:33:52 user nova-compute[73091]: WARNING nova.compute.manager [req-81f7ba4d-f4f9-4f9f-ae46-0fe94ff68eec req-2ba0817f-3329-4854-b037-f65814827341 service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Received unexpected event network-vif-plugged-d368f4bb-4681-4152-b639-3be5601c73b9 for instance with vm_state building and task_state spawning.
Aug 09 16:33:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:33:52 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:33:52 user nova-compute[73091]: INFO nova.compute.manager [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Took 10.72 seconds to spawn the instance on the hypervisor.
Aug 09 16:33:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:53 user nova-compute[73091]: INFO nova.compute.manager [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Took 11.80 seconds to build instance.
Aug 09 16:33:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-692760b6-b197-41e3-8de7-0ff17ce56643 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "b791bded-3eb5-4bf8-a14e-eae269ae2043" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.999s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Successfully updated port: 218c7585-7957-41e4-88d8-6f04e4d4a9bc {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:33:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Acquiring lock "refresh_cache-50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:33:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Acquired lock "refresh_cache-50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:33:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:33:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:33:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-0f5b880a-cefa-43c7-971e-ed34067a8916 req-a9aff6eb-9e38-4c07-99ee-c9dbb77b4ef0 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received event network-vif-plugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0f5b880a-cefa-43c7-971e-ed34067a8916 req-a9aff6eb-9e38-4c07-99ee-c9dbb77b4ef0 service nova] Acquiring lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0f5b880a-cefa-43c7-971e-ed34067a8916 req-a9aff6eb-9e38-4c07-99ee-c9dbb77b4ef0 service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0f5b880a-cefa-43c7-971e-ed34067a8916 req-a9aff6eb-9e38-4c07-99ee-c9dbb77b4ef0 service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-0f5b880a-cefa-43c7-971e-ed34067a8916 req-a9aff6eb-9e38-4c07-99ee-c9dbb77b4ef0 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] No waiting events found dispatching network-vif-plugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:33:53 user nova-compute[73091]: WARNING nova.compute.manager [req-0f5b880a-cefa-43c7-971e-ed34067a8916 req-a9aff6eb-9e38-4c07-99ee-c9dbb77b4ef0 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received unexpected event network-vif-plugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 for instance with vm_state building and task_state spawning.
Aug 09 16:33:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Updating instance_info_cache with network_info: [{"id": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "address": "fa:16:3e:fa:39:24", "network": {"id": "a2babb7a-2af8-4453-abd7-e1a3f193d026", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1066415352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7167f5fdba4476783c578e63f388618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218c7585-79", "ovs_interfaceid": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Releasing lock "refresh_cache-50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Instance network_info: |[{"id": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "address": "fa:16:3e:fa:39:24", "network": {"id": "a2babb7a-2af8-4453-abd7-e1a3f193d026", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1066415352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7167f5fdba4476783c578e63f388618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218c7585-79", "ovs_interfaceid": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Start _get_guest_xml network_info=[{"id": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "address": "fa:16:3e:fa:39:24", "network": {"id": "a2babb7a-2af8-4453-abd7-e1a3f193d026", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1066415352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7167f5fdba4476783c578e63f388618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218c7585-79", "ovs_interfaceid": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:33:54 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:33:54 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:33:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1119243345',display_name='tempest-TestVolumeSwap-server-1119243345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1119243345',id=7,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyOF+6YPIUctROxJ8417kT3zjDt4XMssIHYRDfo+ZMlQzPjEx+gAxLHcSacNEX32mWYkzxel7DdimHJGaZ5mtD2x7rOxhc5OHH9EzFPQnKmpQ0jZ0TpT7V5Sm2xVQH2xg==',key_name='tempest-keypair-1473931332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7167f5fdba4476783c578e63f388618',ramdisk_id='',reservation_id='r-zce9mhw3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1621108182',owner_user_name='tempest-TestVolumeSwap-1621108182-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:33:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='867774990bd24469b81a99659005ccae',uuid=50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "address": "fa:16:3e:fa:39:24", "network": {"id": "a2babb7a-2af8-4453-abd7-e1a3f193d026", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1066415352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7167f5fdba4476783c578e63f388618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218c7585-79", "ovs_interfaceid": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Converting VIF {"id": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "address": "fa:16:3e:fa:39:24", "network": {"id": "a2babb7a-2af8-4453-abd7-e1a3f193d026", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1066415352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7167f5fdba4476783c578e63f388618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218c7585-79", "ovs_interfaceid": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:39:24,bridge_name='br-int',has_traffic_filtering=True,id=218c7585-7957-41e4-88d8-6f04e4d4a9bc,network=Network(a2babb7a-2af8-4453-abd7-e1a3f193d026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap218c7585-79') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.objects.instance [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lazy-loading 'pci_devices' on Instance uuid 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:33:54 user nova-compute[73091]:   <uuid>50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb</uuid>
Aug 09 16:33:54 user nova-compute[73091]:   <name>instance-00000007</name>
Aug 09 16:33:54 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:33:54 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:33:54 user nova-compute[73091]:   <metadata>
Aug 09 16:33:54 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:33:54 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:33:54 user nova-compute[73091]:       <nova:name>tempest-TestVolumeSwap-server-1119243345</nova:name>
Aug 09 16:33:54 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:33:54</nova:creationTime>
Aug 09 16:33:54 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:33:54 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:33:54 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:33:54 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:33:54 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:33:54 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:33:54 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:33:54 user nova-compute[73091]:       <nova:owner>
Aug 09 16:33:54 user nova-compute[73091]:         <nova:user uuid="867774990bd24469b81a99659005ccae">tempest-TestVolumeSwap-1621108182-project-member</nova:user>
Aug 09 16:33:54 user nova-compute[73091]:         <nova:project uuid="c7167f5fdba4476783c578e63f388618">tempest-TestVolumeSwap-1621108182</nova:project>
Aug 09 16:33:54 user nova-compute[73091]:       </nova:owner>
Aug 09 16:33:54 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:33:54 user nova-compute[73091]:       <nova:ports>
Aug 09 16:33:54 user nova-compute[73091]:         <nova:port uuid="218c7585-7957-41e4-88d8-6f04e4d4a9bc">
Aug 09 16:33:54 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 16:33:54 user nova-compute[73091]:         </nova:port>
Aug 09 16:33:54 user nova-compute[73091]:       </nova:ports>
Aug 09 16:33:54 user nova-compute[73091]:     </nova:instance>
Aug 09 16:33:54 user nova-compute[73091]:   </metadata>
Aug 09 16:33:54 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:33:54 user nova-compute[73091]:     <system>
Aug 09 16:33:54 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:33:54 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:33:54 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:33:54 user nova-compute[73091]:       <entry name="serial">50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb</entry>
Aug 09 16:33:54 user nova-compute[73091]:       <entry name="uuid">50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb</entry>
Aug 09 16:33:54 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:33:54 user nova-compute[73091]:     </system>
Aug 09 16:33:54 user nova-compute[73091]:   </sysinfo>
Aug 09 16:33:54 user nova-compute[73091]:   <os>
Aug 09 16:33:54 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:33:54 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:33:54 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:33:54 user nova-compute[73091]:   </os>
Aug 09 16:33:54 user nova-compute[73091]:   <features>
Aug 09 16:33:54 user nova-compute[73091]:     <acpi/>
Aug 09 16:33:54 user nova-compute[73091]:     <apic/>
Aug 09 16:33:54 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:33:54 user nova-compute[73091]:   </features>
Aug 09 16:33:54 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:33:54 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:33:54 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:33:54 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:33:54 user nova-compute[73091]:   </clock>
Aug 09 16:33:54 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:33:54 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:33:54 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:33:54 user nova-compute[73091]:   </cpu>
Aug 09 16:33:54 user nova-compute[73091]:   <devices>
Aug 09 16:33:54 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:33:54 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:33:54 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk"/>
Aug 09 16:33:54 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:33:54 user nova-compute[73091]:     </disk>
Aug 09 16:33:54 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:33:54 user nova-compute[73091]:       <mac address="fa:16:3e:fa:39:24"/>
Aug 09 16:33:54 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:33:54 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:33:54 user nova-compute[73091]:       <target dev="tap218c7585-79"/>
Aug 09 16:33:54 user nova-compute[73091]:     </interface>
Aug 09 16:33:54 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:33:54 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/console.log" append="off"/>
Aug 09 16:33:54 user nova-compute[73091]:     </serial>
Aug 09 16:33:54 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:33:54 user nova-compute[73091]:     <video>
Aug 09 16:33:54 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:33:54 user nova-compute[73091]:     </video>
Aug 09 16:33:54 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:33:54 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:33:54 user nova-compute[73091]:     </rng>
Aug 09 16:33:54 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:33:54 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:33:54 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:33:54 user nova-compute[73091]:     </memballoon>
Aug 09 16:33:54 user nova-compute[73091]:   </devices>
Aug 09 16:33:54 user nova-compute[73091]: </domain>
Aug 09 16:33:54 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:33:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1119243345',display_name='tempest-TestVolumeSwap-server-1119243345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1119243345',id=7,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyOF+6YPIUctROxJ8417kT3zjDt4XMssIHYRDfo+ZMlQzPjEx+gAxLHcSacNEX32mWYkzxel7DdimHJGaZ5mtD2x7rOxhc5OHH9EzFPQnKmpQ0jZ0TpT7V5Sm2xVQH2xg==',key_name='tempest-keypair-1473931332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7167f5fdba4476783c578e63f388618',ramdisk_id='',reservation_id='r-zce9mhw3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1621108182',owner_user_name='tempest-TestVolumeSwap-1621108182-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:33:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='867774990bd24469b81a99659005ccae',uuid=50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "address": "fa:16:3e:fa:39:24", "network": {"id": "a2babb7a-2af8-4453-abd7-e1a3f193d026", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1066415352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7167f5fdba4476783c578e63f388618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218c7585-79", "ovs_interfaceid": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Converting VIF {"id": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "address": "fa:16:3e:fa:39:24", "network": {"id": "a2babb7a-2af8-4453-abd7-e1a3f193d026", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1066415352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7167f5fdba4476783c578e63f388618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218c7585-79", "ovs_interfaceid": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:39:24,bridge_name='br-int',has_traffic_filtering=True,id=218c7585-7957-41e4-88d8-6f04e4d4a9bc,network=Network(a2babb7a-2af8-4453-abd7-e1a3f193d026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap218c7585-79') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG os_vif [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:39:24,bridge_name='br-int',has_traffic_filtering=True,id=218c7585-7957-41e4-88d8-6f04e4d4a9bc,network=Network(a2babb7a-2af8-4453-abd7-e1a3f193d026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap218c7585-79') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap218c7585-79, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap218c7585-79, col_values=(('external_ids', {'iface-id': '218c7585-7957-41e4-88d8-6f04e4d4a9bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:39:24', 'vm-uuid': '50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:54 user nova-compute[73091]: INFO os_vif [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:39:24,bridge_name='br-int',has_traffic_filtering=True,id=218c7585-7957-41e4-88d8-6f04e4d4a9bc,network=Network(a2babb7a-2af8-4453-abd7-e1a3f193d026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap218c7585-79')
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] No VIF found with MAC fa:16:3e:fa:39:24, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-6e46ccb6-0264-4f20-975d-1fd55a89db39 req-dff8dc3b-f70f-4da2-b3fc-7216a39dd5dc service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Received event network-changed-218c7585-7957-41e4-88d8-6f04e4d4a9bc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-6e46ccb6-0264-4f20-975d-1fd55a89db39 req-dff8dc3b-f70f-4da2-b3fc-7216a39dd5dc service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Refreshing instance network info cache due to event network-changed-218c7585-7957-41e4-88d8-6f04e4d4a9bc. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6e46ccb6-0264-4f20-975d-1fd55a89db39 req-dff8dc3b-f70f-4da2-b3fc-7216a39dd5dc service nova] Acquiring lock "refresh_cache-50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6e46ccb6-0264-4f20-975d-1fd55a89db39 req-dff8dc3b-f70f-4da2-b3fc-7216a39dd5dc service nova] Acquired lock "refresh_cache-50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.network.neutron [req-6e46ccb6-0264-4f20-975d-1fd55a89db39 req-dff8dc3b-f70f-4da2-b3fc-7216a39dd5dc service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Refreshing network info cache for port 218c7585-7957-41e4-88d8-6f04e4d4a9bc {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 16:33:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-6e46ccb6-0264-4f20-975d-1fd55a89db39 req-dff8dc3b-f70f-4da2-b3fc-7216a39dd5dc service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Updated VIF entry in instance network info cache for port 218c7585-7957-41e4-88d8-6f04e4d4a9bc. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-6e46ccb6-0264-4f20-975d-1fd55a89db39 req-dff8dc3b-f70f-4da2-b3fc-7216a39dd5dc service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Updating instance_info_cache with network_info: [{"id": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "address": "fa:16:3e:fa:39:24", "network": {"id": "a2babb7a-2af8-4453-abd7-e1a3f193d026", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1066415352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7167f5fdba4476783c578e63f388618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218c7585-79", "ovs_interfaceid": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6e46ccb6-0264-4f20-975d-1fd55a89db39 req-dff8dc3b-f70f-4da2-b3fc-7216a39dd5dc service nova] Releasing lock "refresh_cache-50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-09ed6f71-7664-4de9-b0d8-1d3620e994c8 req-6d7b0bc7-ee16-4dd3-8a2a-02649f3e5435 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received event network-vif-plugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-09ed6f71-7664-4de9-b0d8-1d3620e994c8 req-6d7b0bc7-ee16-4dd3-8a2a-02649f3e5435 service nova] Acquiring lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-09ed6f71-7664-4de9-b0d8-1d3620e994c8 req-6d7b0bc7-ee16-4dd3-8a2a-02649f3e5435 service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-09ed6f71-7664-4de9-b0d8-1d3620e994c8 req-6d7b0bc7-ee16-4dd3-8a2a-02649f3e5435 service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-09ed6f71-7664-4de9-b0d8-1d3620e994c8 req-6d7b0bc7-ee16-4dd3-8a2a-02649f3e5435 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] No waiting events found dispatching network-vif-plugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:33:55 user nova-compute[73091]: WARNING nova.compute.manager [req-09ed6f71-7664-4de9-b0d8-1d3620e994c8 req-6d7b0bc7-ee16-4dd3-8a2a-02649f3e5435 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received unexpected event network-vif-plugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 for instance with vm_state building and task_state spawning.
Aug 09 16:33:55 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598835.836866, ec2187af-1b88-4c23-abba-2f09db3057d6 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:33:55 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] VM Resumed (Lifecycle Event)
Aug 09 16:33:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:33:55 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Instance spawned successfully.
Aug 09 16:33:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:33:55 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:33:55 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598835.8393016, ec2187af-1b88-4c23-abba-2f09db3057d6 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:33:55 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] VM Started (Lifecycle Event)
Aug 09 16:33:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:33:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:56 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:33:56 user nova-compute[73091]: INFO nova.compute.manager [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Took 9.20 seconds to spawn the instance on the hypervisor.
Aug 09 16:33:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:56 user nova-compute[73091]: INFO nova.compute.manager [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Took 10.69 seconds to build instance.
Aug 09 16:33:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d16032f8-562b-4084-a40f-e2b6e5ef88d2 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.868s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:33:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:33:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-5ef019b5-485f-4c8b-8559-f94193114bf5 req-3b4cae07-78a2-4f02-b4c2-da1f5499355e service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Received event network-vif-plugged-218c7585-7957-41e4-88d8-6f04e4d4a9bc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5ef019b5-485f-4c8b-8559-f94193114bf5 req-3b4cae07-78a2-4f02-b4c2-da1f5499355e service nova] Acquiring lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5ef019b5-485f-4c8b-8559-f94193114bf5 req-3b4cae07-78a2-4f02-b4c2-da1f5499355e service nova] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5ef019b5-485f-4c8b-8559-f94193114bf5 req-3b4cae07-78a2-4f02-b4c2-da1f5499355e service nova] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-5ef019b5-485f-4c8b-8559-f94193114bf5 req-3b4cae07-78a2-4f02-b4c2-da1f5499355e service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] No waiting events found dispatching network-vif-plugged-218c7585-7957-41e4-88d8-6f04e4d4a9bc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:33:57 user nova-compute[73091]: WARNING nova.compute.manager [req-5ef019b5-485f-4c8b-8559-f94193114bf5 req-3b4cae07-78a2-4f02-b4c2-da1f5499355e service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Received unexpected event network-vif-plugged-218c7585-7957-41e4-88d8-6f04e4d4a9bc for instance with vm_state building and task_state spawning.
Aug 09 16:33:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:33:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:33:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 16:33:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Skipping network cache update for instance because it is Building. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 09 16:33:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:33:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:33:57 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:33:57 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:33:58 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Updating instance_info_cache with network_info: [{"id": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "address": "fa:16:3e:c2:25:04", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795c9edc-7b", "ovs_interfaceid": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:33:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:33:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:33:58 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598838.7162132, 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:33:58 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] VM Resumed (Lifecycle Event)
Aug 09 16:33:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:33:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:33:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Instance spawned successfully.
Aug 09 16:33:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:33:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:33:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:33:58 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:33:58 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598838.723135, 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:33:58 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] VM Started (Lifecycle Event)
Aug 09 16:33:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:33:58 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:33:58 user nova-compute[73091]: INFO nova.compute.manager [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Took 8.36 seconds to spawn the instance on the hypervisor.
Aug 09 16:33:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:33:58 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:33:58 user nova-compute[73091]: INFO nova.compute.manager [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Took 9.53 seconds to build instance.
Aug 09 16:33:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-128c38bf-989d-4a3a-a36c-ed4c0a64dcf1 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.659s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-ac89476b-bd3f-440d-a32d-343cbf86252b req-779e13db-c317-43ad-8a57-4ebde42e20d1 service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Received event network-vif-plugged-218c7585-7957-41e4-88d8-6f04e4d4a9bc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:33:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ac89476b-bd3f-440d-a32d-343cbf86252b req-779e13db-c317-43ad-8a57-4ebde42e20d1 service nova] Acquiring lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:33:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ac89476b-bd3f-440d-a32d-343cbf86252b req-779e13db-c317-43ad-8a57-4ebde42e20d1 service nova] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:33:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ac89476b-bd3f-440d-a32d-343cbf86252b req-779e13db-c317-43ad-8a57-4ebde42e20d1 service nova] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:33:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-ac89476b-bd3f-440d-a32d-343cbf86252b req-779e13db-c317-43ad-8a57-4ebde42e20d1 service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] No waiting events found dispatching network-vif-plugged-218c7585-7957-41e4-88d8-6f04e4d4a9bc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:33:59 user nova-compute[73091]: WARNING nova.compute.manager [req-ac89476b-bd3f-440d-a32d-343cbf86252b req-779e13db-c317-43ad-8a57-4ebde42e20d1 service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Received unexpected event network-vif-plugged-218c7585-7957-41e4-88d8-6f04e4d4a9bc for instance with vm_state active and task_state None.
Aug 09 16:33:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:33:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:34:00 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:34:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:34:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:34:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:34:01 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:34:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:05 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:34:05 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:34:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7779MB free_disk=25.755268096923828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:34:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:34:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance e4ec0db9-740e-4047-8cab-ac60a1681483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:34:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f3e2ea27-5fa4-4437-83d0-2eeda59506a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:34:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 7bcc1e42-532f-4fb6-984e-cdf659cfef7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:34:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance b791bded-3eb5-4bf8-a14e-eae269ae2043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:34:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance ec2187af-1b88-4c23-abba-2f09db3057d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:34:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:34:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:34:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:34:05 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing inventories for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 16:34:05 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Updating ProviderTree inventory for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 16:34:05 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Updating inventory in ProviderTree for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 16:34:06 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing aggregate associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 16:34:06 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing trait associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, traits: HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 16:34:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Acquiring lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:34:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:06 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:34:06 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:34:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:34:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.297s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:34:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.204s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:06 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:34:06 user nova-compute[73091]: INFO nova.compute.claims [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Claim successful on node user
Aug 09 16:34:07 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:34:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:34:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG nova.policy [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f3685faa4ed244e7b8e6ac55ba8289b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e278f46f2e84bb9ab3024f296069bb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:34:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Creating image(s)
Aug 09 16:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Lock "/opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Lock "/opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.148s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.173s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857/disk 1073741824" returned: 0 in 0.059s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:34:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:08 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:34:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:08 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Cannot resize image /opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:34:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Lazy-loading 'migration_context' on Instance uuid 7e75e099-39c8-4cc4-b3dd-50c67e1b4857 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:34:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:34:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Ensure instance console log exists: /opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:34:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:34:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Successfully created port: 930e8561-36ee-4a9b-b084-5ace1f7d155f {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Successfully updated port: 930e8561-36ee-4a9b-b084-5ace1f7d155f {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Acquiring lock "refresh_cache-7e75e099-39c8-4cc4-b3dd-50c67e1b4857" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Acquired lock "refresh_cache-7e75e099-39c8-4cc4-b3dd-50c67e1b4857" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-0e5facd0-5720-48db-959b-e0a9e0fbaf11 req-1fe5db77-f710-4df3-819f-bd5aa5551a82 service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Received event network-changed-930e8561-36ee-4a9b-b084-5ace1f7d155f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-0e5facd0-5720-48db-959b-e0a9e0fbaf11 req-1fe5db77-f710-4df3-819f-bd5aa5551a82 service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Refreshing instance network info cache due to event network-changed-930e8561-36ee-4a9b-b084-5ace1f7d155f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0e5facd0-5720-48db-959b-e0a9e0fbaf11 req-1fe5db77-f710-4df3-819f-bd5aa5551a82 service nova] Acquiring lock "refresh_cache-7e75e099-39c8-4cc4-b3dd-50c67e1b4857" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Updating instance_info_cache with network_info: [{"id": "930e8561-36ee-4a9b-b084-5ace1f7d155f", "address": "fa:16:3e:0b:c6:dd", "network": {"id": "6cb7f365-bee2-404f-b559-84f622cdafaf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-653553987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e278f46f2e84bb9ab3024f296069bb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap930e8561-36", "ovs_interfaceid": "930e8561-36ee-4a9b-b084-5ace1f7d155f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Releasing lock "refresh_cache-7e75e099-39c8-4cc4-b3dd-50c67e1b4857" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Instance network_info: |[{"id": "930e8561-36ee-4a9b-b084-5ace1f7d155f", "address": "fa:16:3e:0b:c6:dd", "network": {"id": "6cb7f365-bee2-404f-b559-84f622cdafaf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-653553987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e278f46f2e84bb9ab3024f296069bb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap930e8561-36", "ovs_interfaceid": "930e8561-36ee-4a9b-b084-5ace1f7d155f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0e5facd0-5720-48db-959b-e0a9e0fbaf11 req-1fe5db77-f710-4df3-819f-bd5aa5551a82 service nova] Acquired lock "refresh_cache-7e75e099-39c8-4cc4-b3dd-50c67e1b4857" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-0e5facd0-5720-48db-959b-e0a9e0fbaf11 req-1fe5db77-f710-4df3-819f-bd5aa5551a82 service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Refreshing network info cache for port 930e8561-36ee-4a9b-b084-5ace1f7d155f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Start _get_guest_xml network_info=[{"id": "930e8561-36ee-4a9b-b084-5ace1f7d155f", "address": "fa:16:3e:0b:c6:dd", "network": {"id": "6cb7f365-bee2-404f-b559-84f622cdafaf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-653553987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e278f46f2e84bb9ab3024f296069bb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap930e8561-36", "ovs_interfaceid": "930e8561-36ee-4a9b-b084-5ace1f7d155f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:34:09 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:34:09 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1007298400',display_name='tempest-VolumesActionsTest-instance-1007298400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1007298400',id=8,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e278f46f2e84bb9ab3024f296069bb2',ramdisk_id='',reservation_id='r-iy5vd3oh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-845829776',owner_user_name='tempest-VolumesActionsTest-845829776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:07Z,user_data=None,user_id='f3685faa4ed244e7b8e6ac55ba8289b7',uuid=7e75e099-39c8-4cc4-b3dd-50c67e1b4857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "930e8561-36ee-4a9b-b084-5ace1f7d155f", "address": "fa:16:3e:0b:c6:dd", "network": {"id": "6cb7f365-bee2-404f-b559-84f622cdafaf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-653553987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e278f46f2e84bb9ab3024f296069bb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap930e8561-36", "ovs_interfaceid": "930e8561-36ee-4a9b-b084-5ace1f7d155f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Converting VIF {"id": "930e8561-36ee-4a9b-b084-5ace1f7d155f", "address": "fa:16:3e:0b:c6:dd", "network": {"id": "6cb7f365-bee2-404f-b559-84f622cdafaf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-653553987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e278f46f2e84bb9ab3024f296069bb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap930e8561-36", "ovs_interfaceid": "930e8561-36ee-4a9b-b084-5ace1f7d155f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:dd,bridge_name='br-int',has_traffic_filtering=True,id=930e8561-36ee-4a9b-b084-5ace1f7d155f,network=Network(6cb7f365-bee2-404f-b559-84f622cdafaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap930e8561-36') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e75e099-39c8-4cc4-b3dd-50c67e1b4857 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:34:09 user nova-compute[73091]:   <uuid>7e75e099-39c8-4cc4-b3dd-50c67e1b4857</uuid>
Aug 09 16:34:09 user nova-compute[73091]:   <name>instance-00000008</name>
Aug 09 16:34:09 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:34:09 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:34:09 user nova-compute[73091]:   <metadata>
Aug 09 16:34:09 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:34:09 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:34:09 user nova-compute[73091]:       <nova:name>tempest-VolumesActionsTest-instance-1007298400</nova:name>
Aug 09 16:34:09 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:34:09</nova:creationTime>
Aug 09 16:34:09 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:34:09 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:34:09 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:34:09 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:34:09 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:34:09 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:34:09 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:34:09 user nova-compute[73091]:       <nova:owner>
Aug 09 16:34:09 user nova-compute[73091]:         <nova:user uuid="f3685faa4ed244e7b8e6ac55ba8289b7">tempest-VolumesActionsTest-845829776-project-member</nova:user>
Aug 09 16:34:09 user nova-compute[73091]:         <nova:project uuid="4e278f46f2e84bb9ab3024f296069bb2">tempest-VolumesActionsTest-845829776</nova:project>
Aug 09 16:34:09 user nova-compute[73091]:       </nova:owner>
Aug 09 16:34:09 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:34:09 user nova-compute[73091]:       <nova:ports>
Aug 09 16:34:09 user nova-compute[73091]:         <nova:port uuid="930e8561-36ee-4a9b-b084-5ace1f7d155f">
Aug 09 16:34:09 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 16:34:09 user nova-compute[73091]:         </nova:port>
Aug 09 16:34:09 user nova-compute[73091]:       </nova:ports>
Aug 09 16:34:09 user nova-compute[73091]:     </nova:instance>
Aug 09 16:34:09 user nova-compute[73091]:   </metadata>
Aug 09 16:34:09 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:34:09 user nova-compute[73091]:     <system>
Aug 09 16:34:09 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:34:09 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:34:09 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:34:09 user nova-compute[73091]:       <entry name="serial">7e75e099-39c8-4cc4-b3dd-50c67e1b4857</entry>
Aug 09 16:34:09 user nova-compute[73091]:       <entry name="uuid">7e75e099-39c8-4cc4-b3dd-50c67e1b4857</entry>
Aug 09 16:34:09 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:34:09 user nova-compute[73091]:     </system>
Aug 09 16:34:09 user nova-compute[73091]:   </sysinfo>
Aug 09 16:34:09 user nova-compute[73091]:   <os>
Aug 09 16:34:09 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:34:09 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:34:09 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:34:09 user nova-compute[73091]:   </os>
Aug 09 16:34:09 user nova-compute[73091]:   <features>
Aug 09 16:34:09 user nova-compute[73091]:     <acpi/>
Aug 09 16:34:09 user nova-compute[73091]:     <apic/>
Aug 09 16:34:09 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:34:09 user nova-compute[73091]:   </features>
Aug 09 16:34:09 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:34:09 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:34:09 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:34:09 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:34:09 user nova-compute[73091]:   </clock>
Aug 09 16:34:09 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:34:09 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:34:09 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:34:09 user nova-compute[73091]:   </cpu>
Aug 09 16:34:09 user nova-compute[73091]:   <devices>
Aug 09 16:34:09 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:34:09 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:34:09 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857/disk"/>
Aug 09 16:34:09 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:34:09 user nova-compute[73091]:     </disk>
Aug 09 16:34:09 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:34:09 user nova-compute[73091]:       <mac address="fa:16:3e:0b:c6:dd"/>
Aug 09 16:34:09 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:34:09 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:34:09 user nova-compute[73091]:       <target dev="tap930e8561-36"/>
Aug 09 16:34:09 user nova-compute[73091]:     </interface>
Aug 09 16:34:09 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:34:09 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857/console.log" append="off"/>
Aug 09 16:34:09 user nova-compute[73091]:     </serial>
Aug 09 16:34:09 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:34:09 user nova-compute[73091]:     <video>
Aug 09 16:34:09 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:34:09 user nova-compute[73091]:     </video>
Aug 09 16:34:09 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:34:09 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:34:09 user nova-compute[73091]:     </rng>
Aug 09 16:34:09 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:34:09 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:34:09 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:34:09 user nova-compute[73091]:     </memballoon>
Aug 09 16:34:09 user nova-compute[73091]:   </devices>
Aug 09 16:34:09 user nova-compute[73091]: </domain>
Aug 09 16:34:09 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1007298400',display_name='tempest-VolumesActionsTest-instance-1007298400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1007298400',id=8,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e278f46f2e84bb9ab3024f296069bb2',ramdisk_id='',reservation_id='r-iy5vd3oh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-845829776',owner_user_name='tempest-VolumesActionsTest-845829776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:07Z,user_data=None,user_id='f3685faa4ed244e7b8e6ac55ba8289b7',uuid=7e75e099-39c8-4cc4-b3dd-50c67e1b4857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "930e8561-36ee-4a9b-b084-5ace1f7d155f", "address": "fa:16:3e:0b:c6:dd", "network": {"id": "6cb7f365-bee2-404f-b559-84f622cdafaf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-653553987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e278f46f2e84bb9ab3024f296069bb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap930e8561-36", "ovs_interfaceid": "930e8561-36ee-4a9b-b084-5ace1f7d155f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Converting VIF {"id": "930e8561-36ee-4a9b-b084-5ace1f7d155f", "address": "fa:16:3e:0b:c6:dd", "network": {"id": "6cb7f365-bee2-404f-b559-84f622cdafaf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-653553987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e278f46f2e84bb9ab3024f296069bb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap930e8561-36", "ovs_interfaceid": "930e8561-36ee-4a9b-b084-5ace1f7d155f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:dd,bridge_name='br-int',has_traffic_filtering=True,id=930e8561-36ee-4a9b-b084-5ace1f7d155f,network=Network(6cb7f365-bee2-404f-b559-84f622cdafaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap930e8561-36') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG os_vif [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:dd,bridge_name='br-int',has_traffic_filtering=True,id=930e8561-36ee-4a9b-b084-5ace1f7d155f,network=Network(6cb7f365-bee2-404f-b559-84f622cdafaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap930e8561-36') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap930e8561-36, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap930e8561-36, col_values=(('external_ids', {'iface-id': '930e8561-36ee-4a9b-b084-5ace1f7d155f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:c6:dd', 'vm-uuid': '7e75e099-39c8-4cc4-b3dd-50c67e1b4857'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:09 user nova-compute[73091]: INFO os_vif [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:dd,bridge_name='br-int',has_traffic_filtering=True,id=930e8561-36ee-4a9b-b084-5ace1f7d155f,network=Network(6cb7f365-bee2-404f-b559-84f622cdafaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap930e8561-36')
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:34:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] No VIF found with MAC fa:16:3e:0b:c6:dd, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:34:10 user nova-compute[73091]: DEBUG nova.network.neutron [req-0e5facd0-5720-48db-959b-e0a9e0fbaf11 req-1fe5db77-f710-4df3-819f-bd5aa5551a82 service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Updated VIF entry in instance network info cache for port 930e8561-36ee-4a9b-b084-5ace1f7d155f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:34:10 user nova-compute[73091]: DEBUG nova.network.neutron [req-0e5facd0-5720-48db-959b-e0a9e0fbaf11 req-1fe5db77-f710-4df3-819f-bd5aa5551a82 service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Updating instance_info_cache with network_info: [{"id": "930e8561-36ee-4a9b-b084-5ace1f7d155f", "address": "fa:16:3e:0b:c6:dd", "network": {"id": "6cb7f365-bee2-404f-b559-84f622cdafaf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-653553987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e278f46f2e84bb9ab3024f296069bb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap930e8561-36", "ovs_interfaceid": "930e8561-36ee-4a9b-b084-5ace1f7d155f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:34:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0e5facd0-5720-48db-959b-e0a9e0fbaf11 req-1fe5db77-f710-4df3-819f-bd5aa5551a82 service nova] Releasing lock "refresh_cache-7e75e099-39c8-4cc4-b3dd-50c67e1b4857" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:34:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-24be6f58-98bd-4fb1-bdc7-2ddd3397f227 req-2192169f-9bcc-4976-b204-d809f98626c6 service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Received event network-vif-plugged-930e8561-36ee-4a9b-b084-5ace1f7d155f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:34:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-24be6f58-98bd-4fb1-bdc7-2ddd3397f227 req-2192169f-9bcc-4976-b204-d809f98626c6 service nova] Acquiring lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-24be6f58-98bd-4fb1-bdc7-2ddd3397f227 req-2192169f-9bcc-4976-b204-d809f98626c6 service nova] Lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-24be6f58-98bd-4fb1-bdc7-2ddd3397f227 req-2192169f-9bcc-4976-b204-d809f98626c6 service nova] Lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:34:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-24be6f58-98bd-4fb1-bdc7-2ddd3397f227 req-2192169f-9bcc-4976-b204-d809f98626c6 service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] No waiting events found dispatching network-vif-plugged-930e8561-36ee-4a9b-b084-5ace1f7d155f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:34:11 user nova-compute[73091]: WARNING nova.compute.manager [req-24be6f58-98bd-4fb1-bdc7-2ddd3397f227 req-2192169f-9bcc-4976-b204-d809f98626c6 service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Received unexpected event network-vif-plugged-930e8561-36ee-4a9b-b084-5ace1f7d155f for instance with vm_state building and task_state spawning.
Aug 09 16:34:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-f42f0487-9081-466d-873a-938963c0ba1f req-506803b9-726f-4481-a061-722aa9a2b595 service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Received event network-vif-plugged-930e8561-36ee-4a9b-b084-5ace1f7d155f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:34:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f42f0487-9081-466d-873a-938963c0ba1f req-506803b9-726f-4481-a061-722aa9a2b595 service nova] Acquiring lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f42f0487-9081-466d-873a-938963c0ba1f req-506803b9-726f-4481-a061-722aa9a2b595 service nova] Lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f42f0487-9081-466d-873a-938963c0ba1f req-506803b9-726f-4481-a061-722aa9a2b595 service nova] Lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:34:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-f42f0487-9081-466d-873a-938963c0ba1f req-506803b9-726f-4481-a061-722aa9a2b595 service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] No waiting events found dispatching network-vif-plugged-930e8561-36ee-4a9b-b084-5ace1f7d155f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:34:13 user nova-compute[73091]: WARNING nova.compute.manager [req-f42f0487-9081-466d-873a-938963c0ba1f req-506803b9-726f-4481-a061-722aa9a2b595 service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Received unexpected event network-vif-plugged-930e8561-36ee-4a9b-b084-5ace1f7d155f for instance with vm_state building and task_state spawning.
Aug 09 16:34:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:34:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:34:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Instance spawned successfully.
Aug 09 16:34:14 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598854.1553862, 7e75e099-39c8-4cc4-b3dd-50c67e1b4857 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:34:14 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] VM Resumed (Lifecycle Event)
Aug 09 16:34:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:34:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:34:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:34:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:34:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:34:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:34:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:34:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:34:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:34:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:14 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:34:14 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598854.1564295, 7e75e099-39c8-4cc4-b3dd-50c67e1b4857 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:34:14 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] VM Started (Lifecycle Event)
Aug 09 16:34:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:34:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:34:14 user nova-compute[73091]: INFO nova.compute.manager [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Took 6.79 seconds to spawn the instance on the hypervisor.
Aug 09 16:34:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:34:14 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:34:14 user nova-compute[73091]: INFO nova.compute.manager [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Took 7.97 seconds to build instance.
Aug 09 16:34:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a3d3a6fe-3843-4e3a-b4fe-00b76bad1726 tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.117s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:34:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:34:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:34:26 user nova-compute[73091]: INFO nova.compute.claims [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Claim successful on node user
Aug 09 16:34:26 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:34:26 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:34:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:34:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:34:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:34:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:34:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:34:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:34:26 user nova-compute[73091]: INFO nova.virt.block_device [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Booting with volume 5880d5fd-ede8-402d-9010-f7536acf6d33 at /dev/vda
Aug 09 16:34:26 user nova-compute[73091]: DEBUG os_brick.utils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:34:26 user nova-compute[73091]: INFO oslo.privsep.daemon [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpg665rckl/privsep.sock']
Aug 09 16:34:26 user sudo[83878]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpg665rckl/privsep.sock
Aug 09 16:34:26 user sudo[83878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 16:34:26 user nova-compute[73091]: DEBUG nova.policy [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f8ebe5c5921442db9b4ac5a7e0d6e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50caffcf74fb48dc9bb136c3fecc91c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:34:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Successfully created port: 2d404f54-5fe2-47d8-b036-955d05de1706 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:34:28 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Successfully created port: 9274af2c-557c-4b06-a375-5006f4792f69 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:34:28 user sudo[83878]: pam_unix(sudo:session): session closed for user root
Aug 09 16:34:28 user nova-compute[73091]: INFO oslo.privsep.daemon [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Spawned new privsep daemon via rootwrap
Aug 09 16:34:28 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 16:34:28 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 16:34:28 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 09 16:34:28 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83925
Aug 09 16:34:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee72385c-5a28-4ecb-b27a-01fe23f0e2a0]: (2,) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[24717b7e-32cd-464e-bfd2-004bd5f4a549]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:28 user nova-compute[73091]: WARNING os_brick.initiator.connectors.nvmeof [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 09 16:34:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[488c6042-45ae-466b-b4f6-e469e1e075b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee17195-5d53-4014-84d4-d3bb9e684716]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f21417-94f3-449a-a0a2-fa238372c478]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:34:29 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:34:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c21a81d-8ddb-42e8-9939-61eb48d2e5e9]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:34:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:34:29 user nova-compute[73091]: DEBUG os_brick.utils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] <== get_connector_properties: return (2177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:34:29 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Updating existing volume attachment record: 4f5b7494-2301-41ee-9703-88122e3537ed {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:34:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:29 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Successfully created port: 271512c1-1707-48da-84cf-978ab9e0d202 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:34:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Successfully created port: 652f5030-2075-40f8-ab87-f86f5dbb6e75 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:34:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Successfully created port: 9c7ee120-3c19-4ba4-8f87-de7384c64d7a {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:34:31 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Successfully updated port: 2d404f54-5fe2-47d8-b036-955d05de1706 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:34:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-5de0448b-8f25-4649-8e51-5d2664fe1d40 req-23f3ab01-ab98-40c8-9378-a4e8861fb9a3 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-changed-2d404f54-5fe2-47d8-b036-955d05de1706 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:34:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-5de0448b-8f25-4649-8e51-5d2664fe1d40 req-23f3ab01-ab98-40c8-9378-a4e8861fb9a3 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Refreshing instance network info cache due to event network-changed-2d404f54-5fe2-47d8-b036-955d05de1706. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:34:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5de0448b-8f25-4649-8e51-5d2664fe1d40 req-23f3ab01-ab98-40c8-9378-a4e8861fb9a3 service nova] Acquiring lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:34:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5de0448b-8f25-4649-8e51-5d2664fe1d40 req-23f3ab01-ab98-40c8-9378-a4e8861fb9a3 service nova] Acquired lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:34:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-5de0448b-8f25-4649-8e51-5d2664fe1d40 req-23f3ab01-ab98-40c8-9378-a4e8861fb9a3 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Refreshing network info cache for port 2d404f54-5fe2-47d8-b036-955d05de1706 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:34:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-5de0448b-8f25-4649-8e51-5d2664fe1d40 req-23f3ab01-ab98-40c8-9378-a4e8861fb9a3 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:34:32 user nova-compute[73091]: DEBUG nova.network.neutron [req-5de0448b-8f25-4649-8e51-5d2664fe1d40 req-23f3ab01-ab98-40c8-9378-a4e8861fb9a3 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:34:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5de0448b-8f25-4649-8e51-5d2664fe1d40 req-23f3ab01-ab98-40c8-9378-a4e8861fb9a3 service nova] Releasing lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:34:32 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Successfully updated port: 85a99727-150d-48a7-ba46-bce583a5353b {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:34:33 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Successfully updated port: 415c1381-e446-4743-8420-56093064c1cb {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:34:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-5f69a016-67be-43c9-a1df-dddc1567d2ed req-106d68c2-1aa0-46e8-9483-1073e6effcee service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-changed-85a99727-150d-48a7-ba46-bce583a5353b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:34:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-5f69a016-67be-43c9-a1df-dddc1567d2ed req-106d68c2-1aa0-46e8-9483-1073e6effcee service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Refreshing instance network info cache due to event network-changed-85a99727-150d-48a7-ba46-bce583a5353b. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:34:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5f69a016-67be-43c9-a1df-dddc1567d2ed req-106d68c2-1aa0-46e8-9483-1073e6effcee service nova] Acquiring lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:34:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5f69a016-67be-43c9-a1df-dddc1567d2ed req-106d68c2-1aa0-46e8-9483-1073e6effcee service nova] Acquired lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:34:33 user nova-compute[73091]: DEBUG nova.network.neutron [req-5f69a016-67be-43c9-a1df-dddc1567d2ed req-106d68c2-1aa0-46e8-9483-1073e6effcee service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Refreshing network info cache for port 85a99727-150d-48a7-ba46-bce583a5353b {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:34:33 user nova-compute[73091]: DEBUG nova.network.neutron [req-5f69a016-67be-43c9-a1df-dddc1567d2ed req-106d68c2-1aa0-46e8-9483-1073e6effcee service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:34:34 user nova-compute[73091]: DEBUG nova.network.neutron [req-5f69a016-67be-43c9-a1df-dddc1567d2ed req-106d68c2-1aa0-46e8-9483-1073e6effcee service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:34:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5f69a016-67be-43c9-a1df-dddc1567d2ed req-106d68c2-1aa0-46e8-9483-1073e6effcee service nova] Releasing lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:34:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-5f69a016-67be-43c9-a1df-dddc1567d2ed req-106d68c2-1aa0-46e8-9483-1073e6effcee service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-changed-415c1381-e446-4743-8420-56093064c1cb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:34:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-5f69a016-67be-43c9-a1df-dddc1567d2ed req-106d68c2-1aa0-46e8-9483-1073e6effcee service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Refreshing instance network info cache due to event network-changed-415c1381-e446-4743-8420-56093064c1cb. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:34:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5f69a016-67be-43c9-a1df-dddc1567d2ed req-106d68c2-1aa0-46e8-9483-1073e6effcee service nova] Acquiring lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:34:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5f69a016-67be-43c9-a1df-dddc1567d2ed req-106d68c2-1aa0-46e8-9483-1073e6effcee service nova] Acquired lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:34:34 user nova-compute[73091]: DEBUG nova.network.neutron [req-5f69a016-67be-43c9-a1df-dddc1567d2ed req-106d68c2-1aa0-46e8-9483-1073e6effcee service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Refreshing network info cache for port 415c1381-e446-4743-8420-56093064c1cb {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:34:34 user nova-compute[73091]: DEBUG nova.network.neutron [req-5f69a016-67be-43c9-a1df-dddc1567d2ed req-106d68c2-1aa0-46e8-9483-1073e6effcee service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:34:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:34 user nova-compute[73091]: DEBUG nova.network.neutron [req-5f69a016-67be-43c9-a1df-dddc1567d2ed req-106d68c2-1aa0-46e8-9483-1073e6effcee service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:34:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5f69a016-67be-43c9-a1df-dddc1567d2ed req-106d68c2-1aa0-46e8-9483-1073e6effcee service nova] Releasing lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:34:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Successfully updated port: 9274af2c-557c-4b06-a375-5006f4792f69 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:34:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:34:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:34:35 user nova-compute[73091]: INFO nova.compute.claims [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Claim successful on node user
Aug 09 16:34:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Successfully updated port: 271512c1-1707-48da-84cf-978ab9e0d202 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:34:35 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:34:35 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:34:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-f9cc7b57-9e89-45be-b44b-76c0f328912e req-b587a7a2-d488-400a-b726-6ed23f1e0f88 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-changed-9274af2c-557c-4b06-a375-5006f4792f69 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:34:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-f9cc7b57-9e89-45be-b44b-76c0f328912e req-b587a7a2-d488-400a-b726-6ed23f1e0f88 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Refreshing instance network info cache due to event network-changed-9274af2c-557c-4b06-a375-5006f4792f69. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:34:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f9cc7b57-9e89-45be-b44b-76c0f328912e req-b587a7a2-d488-400a-b726-6ed23f1e0f88 service nova] Acquiring lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:34:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f9cc7b57-9e89-45be-b44b-76c0f328912e req-b587a7a2-d488-400a-b726-6ed23f1e0f88 service nova] Acquired lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:34:35 user nova-compute[73091]: DEBUG nova.network.neutron [req-f9cc7b57-9e89-45be-b44b-76c0f328912e req-b587a7a2-d488-400a-b726-6ed23f1e0f88 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Refreshing network info cache for port 9274af2c-557c-4b06-a375-5006f4792f69 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:34:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:34:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:34:35 user nova-compute[73091]: DEBUG nova.network.neutron [req-f9cc7b57-9e89-45be-b44b-76c0f328912e req-b587a7a2-d488-400a-b726-6ed23f1e0f88 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:34:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:34:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:34:35 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:34:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:34:35 user nova-compute[73091]: INFO nova.virt.block_device [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Booting with volume 6bcd953f-ccea-4ad0-8470-2afa38d7e172 at /dev/vda
Aug 09 16:34:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-f9cc7b57-9e89-45be-b44b-76c0f328912e req-b587a7a2-d488-400a-b726-6ed23f1e0f88 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f9cc7b57-9e89-45be-b44b-76c0f328912e req-b587a7a2-d488-400a-b726-6ed23f1e0f88 service nova] Releasing lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-f9cc7b57-9e89-45be-b44b-76c0f328912e req-b587a7a2-d488-400a-b726-6ed23f1e0f88 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-changed-271512c1-1707-48da-84cf-978ab9e0d202 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-f9cc7b57-9e89-45be-b44b-76c0f328912e req-b587a7a2-d488-400a-b726-6ed23f1e0f88 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Refreshing instance network info cache due to event network-changed-271512c1-1707-48da-84cf-978ab9e0d202. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f9cc7b57-9e89-45be-b44b-76c0f328912e req-b587a7a2-d488-400a-b726-6ed23f1e0f88 service nova] Acquiring lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f9cc7b57-9e89-45be-b44b-76c0f328912e req-b587a7a2-d488-400a-b726-6ed23f1e0f88 service nova] Acquired lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-f9cc7b57-9e89-45be-b44b-76c0f328912e req-b587a7a2-d488-400a-b726-6ed23f1e0f88 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Refreshing network info cache for port 271512c1-1707-48da-84cf-978ab9e0d202 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG os_brick.utils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead62da8-60e4-491c-8fbc-2ff4e22a9682]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-f9cc7b57-9e89-45be-b44b-76c0f328912e req-b587a7a2-d488-400a-b726-6ed23f1e0f88 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d15201-a777-44a1-9f07-9782492bf663]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[df41d282-9d68-40dd-98f4-0395e013f4d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9e18a0-b462-4a22-82d6-517438d54f20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:34:36 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:34:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1ac65e-5e7a-4af8-ae17-3098be366c15]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG nova.policy [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed205e5075de4f48b629121cc0cce798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a0681774fe4557921515e98144b9d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG os_brick.utils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Updating existing volume attachment record: ab84f9c4-4fe8-49a2-8fd4-3dd4fb6ca8ba {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-f9cc7b57-9e89-45be-b44b-76c0f328912e req-b587a7a2-d488-400a-b726-6ed23f1e0f88 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f9cc7b57-9e89-45be-b44b-76c0f328912e req-b587a7a2-d488-400a-b726-6ed23f1e0f88 service nova] Releasing lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:34:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Successfully updated port: 652f5030-2075-40f8-ab87-f86f5dbb6e75 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:34:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-08eb970f-6b4e-4558-a760-e0c1ecbb4148 req-0f6aec1f-365f-4135-bbac-51f81310b432 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-changed-652f5030-2075-40f8-ab87-f86f5dbb6e75 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:34:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-08eb970f-6b4e-4558-a760-e0c1ecbb4148 req-0f6aec1f-365f-4135-bbac-51f81310b432 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Refreshing instance network info cache due to event network-changed-652f5030-2075-40f8-ab87-f86f5dbb6e75. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:34:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-08eb970f-6b4e-4558-a760-e0c1ecbb4148 req-0f6aec1f-365f-4135-bbac-51f81310b432 service nova] Acquiring lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:34:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-08eb970f-6b4e-4558-a760-e0c1ecbb4148 req-0f6aec1f-365f-4135-bbac-51f81310b432 service nova] Acquired lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:34:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-08eb970f-6b4e-4558-a760-e0c1ecbb4148 req-0f6aec1f-365f-4135-bbac-51f81310b432 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Refreshing network info cache for port 652f5030-2075-40f8-ab87-f86f5dbb6e75 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Successfully created port: 7f9e1fe5-ad99-4c58-9181-0caeb7675dab {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG nova.network.neutron [req-08eb970f-6b4e-4558-a760-e0c1ecbb4148 req-0f6aec1f-365f-4135-bbac-51f81310b432 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:34:38 user nova-compute[73091]: INFO nova.virt.block_device [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Booting with volume 44a02bc4-5692-436e-ac17-4e80de184f7f at /dev/vdb
Aug 09 16:34:38 user nova-compute[73091]: DEBUG os_brick.utils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7bb42a-a6e8-487a-9a54-c8748a5eed84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d4d436-c1bc-40ca-9474-63ee24852859]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG nova.network.neutron [req-08eb970f-6b4e-4558-a760-e0c1ecbb4148 req-0f6aec1f-365f-4135-bbac-51f81310b432 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-08eb970f-6b4e-4558-a760-e0c1ecbb4148 req-0f6aec1f-365f-4135-bbac-51f81310b432 service nova] Releasing lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[15eccc68-d031-4df6-b6f3-9309eb7c5092]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cba4816-42f4-4d5b-868b-3b7bad43df05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:34:38 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:34:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f28066-925e-4817-a619-786838b8a8c6]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG os_brick.utils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Updating existing volume attachment record: ad3a220f-b452-4ae7-a5e4-330ef59ffe87 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Successfully updated port: 9c7ee120-3c19-4ba4-8f87-de7384c64d7a {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Acquiring lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Acquired lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:34:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:34:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Successfully created port: 9f37bd5d-1587-4aad-9da4-892334eadaad {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:34:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-4c7a7f6b-2c11-434d-aba5-0b106115237e req-b0acfd0b-7d0f-4c95-9309-5dcbf6eb48bb service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-changed-9c7ee120-3c19-4ba4-8f87-de7384c64d7a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:34:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-4c7a7f6b-2c11-434d-aba5-0b106115237e req-b0acfd0b-7d0f-4c95-9309-5dcbf6eb48bb service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Refreshing instance network info cache due to event network-changed-9c7ee120-3c19-4ba4-8f87-de7384c64d7a. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:34:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4c7a7f6b-2c11-434d-aba5-0b106115237e req-b0acfd0b-7d0f-4c95-9309-5dcbf6eb48bb service nova] Acquiring lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:34:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Successfully created port: 09f12e06-60f3-4e4d-b8c0-929fb56b0afd {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:34:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Successfully created port: dc6e7056-4650-4973-be22-b1d98c14149f {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:34:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Updating instance_info_cache with network_info: [{"id": "2d404f54-5fe2-47d8-b036-955d05de1706", "address": "fa:16:3e:93:70:5b", "network": {"id": "288571f5-6f90-44a8-b1a7-5a66a9a3ed4e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-506239100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d404f54-5f", "ovs_interfaceid": "2d404f54-5fe2-47d8-b036-955d05de1706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85a99727-150d-48a7-ba46-bce583a5353b", "address": "fa:16:3e:15:52:2a", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a99727-15", "ovs_interfaceid": "85a99727-150d-48a7-ba46-bce583a5353b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "415c1381-e446-4743-8420-56093064c1cb", "address": "fa:16:3e:72:41:a4", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415c1381-e4", "ovs_interfaceid": "415c1381-e446-4743-8420-56093064c1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9274af2c-557c-4b06-a375-5006f4792f69", "address": "fa:16:3e:69:b1:a3", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9274af2c-55", "ovs_interfaceid": "9274af2c-557c-4b06-a375-5006f4792f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "271512c1-1707-48da-84cf-978ab9e0d202", "address": "fa:16:3e:45:f5:f7", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap271512c1-17", "ovs_interfaceid": "271512c1-1707-48da-84cf-978ab9e0d202", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "address": "fa:16:3e:83:c1:f4", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652f5030-20", "ovs_interfaceid": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "address": "fa:16:3e:02:41:b2", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ee120-3c", "ovs_interfaceid": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:34:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Releasing lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:34:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Instance network_info: |[{"id": "2d404f54-5fe2-47d8-b036-955d05de1706", "address": "fa:16:3e:93:70:5b", "network": {"id": "288571f5-6f90-44a8-b1a7-5a66a9a3ed4e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-506239100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d404f54-5f", "ovs_interfaceid": "2d404f54-5fe2-47d8-b036-955d05de1706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85a99727-150d-48a7-ba46-bce583a5353b", "address": "fa:16:3e:15:52:2a", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a99727-15", "ovs_interfaceid": "85a99727-150d-48a7-ba46-bce583a5353b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "415c1381-e446-4743-8420-56093064c1cb", "address": "fa:16:3e:72:41:a4", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415c1381-e4", "ovs_interfaceid": "415c1381-e446-4743-8420-56093064c1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9274af2c-557c-4b06-a375-5006f4792f69", "address": "fa:16:3e:69:b1:a3", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9274af2c-55", "ovs_interfaceid": "9274af2c-557c-4b06-a375-5006f4792f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "271512c1-1707-48da-84cf-978ab9e0d202", "address": "fa:16:3e:45:f5:f7", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap271512c1-17", "ovs_interfaceid": "271512c1-1707-48da-84cf-978ab9e0d202", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "address": "fa:16:3e:83:c1:f4", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652f5030-20", "ovs_interfaceid": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "address": "fa:16:3e:02:41:b2", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ee120-3c", "ovs_interfaceid": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:34:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4c7a7f6b-2c11-434d-aba5-0b106115237e req-b0acfd0b-7d0f-4c95-9309-5dcbf6eb48bb service nova] Acquired lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:34:42 user nova-compute[73091]: DEBUG nova.network.neutron [req-4c7a7f6b-2c11-434d-aba5-0b106115237e req-b0acfd0b-7d0f-4c95-9309-5dcbf6eb48bb service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Refreshing network info cache for port 9c7ee120-3c19-4ba4-8f87-de7384c64d7a {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:34:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Successfully created port: 1128f26c-215d-4940-8772-886149c34785 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:34:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-4c7a7f6b-2c11-434d-aba5-0b106115237e req-b0acfd0b-7d0f-4c95-9309-5dcbf6eb48bb service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Updated VIF entry in instance network info cache for port 9c7ee120-3c19-4ba4-8f87-de7384c64d7a. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:34:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-4c7a7f6b-2c11-434d-aba5-0b106115237e req-b0acfd0b-7d0f-4c95-9309-5dcbf6eb48bb service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Updating instance_info_cache with network_info: [{"id": "2d404f54-5fe2-47d8-b036-955d05de1706", "address": "fa:16:3e:93:70:5b", "network": {"id": "288571f5-6f90-44a8-b1a7-5a66a9a3ed4e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-506239100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d404f54-5f", "ovs_interfaceid": "2d404f54-5fe2-47d8-b036-955d05de1706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85a99727-150d-48a7-ba46-bce583a5353b", "address": "fa:16:3e:15:52:2a", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a99727-15", "ovs_interfaceid": "85a99727-150d-48a7-ba46-bce583a5353b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "415c1381-e446-4743-8420-56093064c1cb", "address": "fa:16:3e:72:41:a4", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415c1381-e4", "ovs_interfaceid": "415c1381-e446-4743-8420-56093064c1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9274af2c-557c-4b06-a375-5006f4792f69", "address": "fa:16:3e:69:b1:a3", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9274af2c-55", "ovs_interfaceid": "9274af2c-557c-4b06-a375-5006f4792f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "271512c1-1707-48da-84cf-978ab9e0d202", "address": "fa:16:3e:45:f5:f7", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap271512c1-17", "ovs_interfaceid": "271512c1-1707-48da-84cf-978ab9e0d202", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "address": "fa:16:3e:83:c1:f4", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652f5030-20", "ovs_interfaceid": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "address": "fa:16:3e:02:41:b2", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ee120-3c", "ovs_interfaceid": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:34:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4c7a7f6b-2c11-434d-aba5-0b106115237e req-b0acfd0b-7d0f-4c95-9309-5dcbf6eb48bb service nova] Releasing lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:34:43 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Successfully updated port: 7f9e1fe5-ad99-4c58-9181-0caeb7675dab {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:34:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-5ad552f5-177f-4446-8005-f2462aab5e6d req-3a62e57c-acfc-418e-b788-a76485fa8a4e service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-changed-7f9e1fe5-ad99-4c58-9181-0caeb7675dab {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:34:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-5ad552f5-177f-4446-8005-f2462aab5e6d req-3a62e57c-acfc-418e-b788-a76485fa8a4e service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Refreshing instance network info cache due to event network-changed-7f9e1fe5-ad99-4c58-9181-0caeb7675dab. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:34:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5ad552f5-177f-4446-8005-f2462aab5e6d req-3a62e57c-acfc-418e-b788-a76485fa8a4e service nova] Acquiring lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:34:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5ad552f5-177f-4446-8005-f2462aab5e6d req-3a62e57c-acfc-418e-b788-a76485fa8a4e service nova] Acquired lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:34:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-5ad552f5-177f-4446-8005-f2462aab5e6d req-3a62e57c-acfc-418e-b788-a76485fa8a4e service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Refreshing network info cache for port 7f9e1fe5-ad99-4c58-9181-0caeb7675dab {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:34:44 user nova-compute[73091]: DEBUG nova.network.neutron [req-5ad552f5-177f-4446-8005-f2462aab5e6d req-3a62e57c-acfc-418e-b788-a76485fa8a4e service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:34:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:44 user nova-compute[73091]: DEBUG nova.network.neutron [req-5ad552f5-177f-4446-8005-f2462aab5e6d req-3a62e57c-acfc-418e-b788-a76485fa8a4e service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:34:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5ad552f5-177f-4446-8005-f2462aab5e6d req-3a62e57c-acfc-418e-b788-a76485fa8a4e service nova] Releasing lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:34:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:45 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Successfully updated port: f3eac408-ecc9-4f3f-a64d-4364c91bf697 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:34:45 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Successfully updated port: 847e88af-f82a-4a2d-aa96-7e3dd512e055 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:34:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-af83b423-44f3-49ac-b920-b715f1155120 req-89c3471c-a922-49fa-82f3-4c3e9a7004c8 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-changed-f3eac408-ecc9-4f3f-a64d-4364c91bf697 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:34:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-af83b423-44f3-49ac-b920-b715f1155120 req-89c3471c-a922-49fa-82f3-4c3e9a7004c8 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Refreshing instance network info cache due to event network-changed-f3eac408-ecc9-4f3f-a64d-4364c91bf697. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:34:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-af83b423-44f3-49ac-b920-b715f1155120 req-89c3471c-a922-49fa-82f3-4c3e9a7004c8 service nova] Acquiring lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:34:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-af83b423-44f3-49ac-b920-b715f1155120 req-89c3471c-a922-49fa-82f3-4c3e9a7004c8 service nova] Acquired lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:34:45 user nova-compute[73091]: DEBUG nova.network.neutron [req-af83b423-44f3-49ac-b920-b715f1155120 req-89c3471c-a922-49fa-82f3-4c3e9a7004c8 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Refreshing network info cache for port f3eac408-ecc9-4f3f-a64d-4364c91bf697 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:34:46 user nova-compute[73091]: DEBUG nova.network.neutron [req-af83b423-44f3-49ac-b920-b715f1155120 req-89c3471c-a922-49fa-82f3-4c3e9a7004c8 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:34:46 user nova-compute[73091]: DEBUG nova.network.neutron [req-af83b423-44f3-49ac-b920-b715f1155120 req-89c3471c-a922-49fa-82f3-4c3e9a7004c8 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:34:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-af83b423-44f3-49ac-b920-b715f1155120 req-89c3471c-a922-49fa-82f3-4c3e9a7004c8 service nova] Releasing lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:34:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-af83b423-44f3-49ac-b920-b715f1155120 req-89c3471c-a922-49fa-82f3-4c3e9a7004c8 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-changed-847e88af-f82a-4a2d-aa96-7e3dd512e055 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:34:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-af83b423-44f3-49ac-b920-b715f1155120 req-89c3471c-a922-49fa-82f3-4c3e9a7004c8 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Refreshing instance network info cache due to event network-changed-847e88af-f82a-4a2d-aa96-7e3dd512e055. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:34:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-af83b423-44f3-49ac-b920-b715f1155120 req-89c3471c-a922-49fa-82f3-4c3e9a7004c8 service nova] Acquiring lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:34:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-af83b423-44f3-49ac-b920-b715f1155120 req-89c3471c-a922-49fa-82f3-4c3e9a7004c8 service nova] Acquired lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:34:46 user nova-compute[73091]: DEBUG nova.network.neutron [req-af83b423-44f3-49ac-b920-b715f1155120 req-89c3471c-a922-49fa-82f3-4c3e9a7004c8 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Refreshing network info cache for port 847e88af-f82a-4a2d-aa96-7e3dd512e055 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:34:46 user nova-compute[73091]: DEBUG nova.network.neutron [req-af83b423-44f3-49ac-b920-b715f1155120 req-89c3471c-a922-49fa-82f3-4c3e9a7004c8 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:34:46 user nova-compute[73091]: DEBUG nova.network.neutron [req-af83b423-44f3-49ac-b920-b715f1155120 req-89c3471c-a922-49fa-82f3-4c3e9a7004c8 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:34:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-af83b423-44f3-49ac-b920-b715f1155120 req-89c3471c-a922-49fa-82f3-4c3e9a7004c8 service nova] Releasing lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:34:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Successfully updated port: 9f37bd5d-1587-4aad-9da4-892334eadaad {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:34:47 user nova-compute[73091]: INFO nova.virt.block_device [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Booting with volume 91a6b7e6-0b03-4127-8480-7f49d15d5312 at /dev/vdc
Aug 09 16:34:47 user nova-compute[73091]: DEBUG os_brick.utils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe976cca-db25-4129-b9cf-8d0b7168195a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[077e2f80-72d1-4d93-8ee2-afb4ce641068]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba32a58-0bbc-4adb-827e-978ddc785f22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0e4e04-def1-4c83-91ce-0fb8a1187479]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:34:47 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:34:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda9e71f-493d-4bf3-85a5-515f6979b164]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG os_brick.utils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Updating existing volume attachment record: 9f89651f-e587-432c-8eb5-e14a2c7e3a2a {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:34:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Successfully updated port: 09f12e06-60f3-4e4d-b8c0-929fb56b0afd {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:34:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-73877e18-8225-4446-a0bb-6f209432f62f req-605c4894-32cd-4ca0-939e-9e0e3fbcf857 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-changed-9f37bd5d-1587-4aad-9da4-892334eadaad {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:34:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-73877e18-8225-4446-a0bb-6f209432f62f req-605c4894-32cd-4ca0-939e-9e0e3fbcf857 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Refreshing instance network info cache due to event network-changed-9f37bd5d-1587-4aad-9da4-892334eadaad. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:34:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-73877e18-8225-4446-a0bb-6f209432f62f req-605c4894-32cd-4ca0-939e-9e0e3fbcf857 service nova] Acquiring lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:34:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-73877e18-8225-4446-a0bb-6f209432f62f req-605c4894-32cd-4ca0-939e-9e0e3fbcf857 service nova] Acquired lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:34:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-73877e18-8225-4446-a0bb-6f209432f62f req-605c4894-32cd-4ca0-939e-9e0e3fbcf857 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Refreshing network info cache for port 9f37bd5d-1587-4aad-9da4-892334eadaad {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:34:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-73877e18-8225-4446-a0bb-6f209432f62f req-605c4894-32cd-4ca0-939e-9e0e3fbcf857 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:34:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-73877e18-8225-4446-a0bb-6f209432f62f req-605c4894-32cd-4ca0-939e-9e0e3fbcf857 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:34:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-73877e18-8225-4446-a0bb-6f209432f62f req-605c4894-32cd-4ca0-939e-9e0e3fbcf857 service nova] Releasing lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:34:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-73877e18-8225-4446-a0bb-6f209432f62f req-605c4894-32cd-4ca0-939e-9e0e3fbcf857 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-changed-09f12e06-60f3-4e4d-b8c0-929fb56b0afd {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:34:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-73877e18-8225-4446-a0bb-6f209432f62f req-605c4894-32cd-4ca0-939e-9e0e3fbcf857 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Refreshing instance network info cache due to event network-changed-09f12e06-60f3-4e4d-b8c0-929fb56b0afd. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:34:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-73877e18-8225-4446-a0bb-6f209432f62f req-605c4894-32cd-4ca0-939e-9e0e3fbcf857 service nova] Acquiring lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:34:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-73877e18-8225-4446-a0bb-6f209432f62f req-605c4894-32cd-4ca0-939e-9e0e3fbcf857 service nova] Acquired lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:34:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-73877e18-8225-4446-a0bb-6f209432f62f req-605c4894-32cd-4ca0-939e-9e0e3fbcf857 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Refreshing network info cache for port 09f12e06-60f3-4e4d-b8c0-929fb56b0afd {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:34:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-73877e18-8225-4446-a0bb-6f209432f62f req-605c4894-32cd-4ca0-939e-9e0e3fbcf857 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:34:49 user nova-compute[73091]: DEBUG nova.network.neutron [req-73877e18-8225-4446-a0bb-6f209432f62f req-605c4894-32cd-4ca0-939e-9e0e3fbcf857 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:34:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-73877e18-8225-4446-a0bb-6f209432f62f req-605c4894-32cd-4ca0-939e-9e0e3fbcf857 service nova] Releasing lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:34:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Successfully updated port: dc6e7056-4650-4973-be22-b1d98c14149f {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:34:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Successfully updated port: 1128f26c-215d-4940-8772-886149c34785 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:34:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Acquiring lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:34:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Acquired lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:34:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:34:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:34:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-f57ffb17-3a87-4292-afa0-5eb1c9827e71 req-cf6653ce-2c0c-48d0-91a5-6632b01271e5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-changed-dc6e7056-4650-4973-be22-b1d98c14149f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:34:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-f57ffb17-3a87-4292-afa0-5eb1c9827e71 req-cf6653ce-2c0c-48d0-91a5-6632b01271e5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Refreshing instance network info cache due to event network-changed-dc6e7056-4650-4973-be22-b1d98c14149f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:34:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f57ffb17-3a87-4292-afa0-5eb1c9827e71 req-cf6653ce-2c0c-48d0-91a5-6632b01271e5 service nova] Acquiring lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:34:51 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Updating instance_info_cache with network_info: [{"id": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "address": "fa:16:3e:30:e8:27", "network": {"id": "41f77be1-0754-463b-a14d-b199368ae881", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-32585978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9e1fe5-ad", "ovs_interfaceid": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "address": "fa:16:3e:a0:6f:69", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eac408-ec", "ovs_interfaceid": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "address": "fa:16:3e:db:ca:02", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847e88af-f8", "ovs_interfaceid": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f37bd5d-1587-4aad-9da4-892334eadaad", "address": "fa:16:3e:79:2d:22", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f37bd5d-15", "ovs_interfaceid": "9f37bd5d-1587-4aad-9da4-892334eadaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "address": "fa:16:3e:05:45:18", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f12e06-60", "ovs_interfaceid": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc6e7056-4650-4973-be22-b1d98c14149f", "address": "fa:16:3e:af:95:d3", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc6e7056-46", "ovs_interfaceid": "dc6e7056-4650-4973-be22-b1d98c14149f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1128f26c-215d-4940-8772-886149c34785", "address": "fa:16:3e:18:47:aa", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1128f26c-21", "ovs_interfaceid": "1128f26c-215d-4940-8772-886149c34785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:34:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Releasing lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:34:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Instance network_info: |[{"id": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "address": "fa:16:3e:30:e8:27", "network": {"id": "41f77be1-0754-463b-a14d-b199368ae881", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-32585978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9e1fe5-ad", "ovs_interfaceid": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "address": "fa:16:3e:a0:6f:69", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eac408-ec", "ovs_interfaceid": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "address": "fa:16:3e:db:ca:02", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847e88af-f8", "ovs_interfaceid": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f37bd5d-1587-4aad-9da4-892334eadaad", "address": "fa:16:3e:79:2d:22", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f37bd5d-15", "ovs_interfaceid": "9f37bd5d-1587-4aad-9da4-892334eadaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "address": "fa:16:3e:05:45:18", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f12e06-60", "ovs_interfaceid": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc6e7056-4650-4973-be22-b1d98c14149f", "address": "fa:16:3e:af:95:d3", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc6e7056-46", "ovs_interfaceid": "dc6e7056-4650-4973-be22-b1d98c14149f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1128f26c-215d-4940-8772-886149c34785", "address": "fa:16:3e:18:47:aa", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1128f26c-21", "ovs_interfaceid": "1128f26c-215d-4940-8772-886149c34785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:34:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f57ffb17-3a87-4292-afa0-5eb1c9827e71 req-cf6653ce-2c0c-48d0-91a5-6632b01271e5 service nova] Acquired lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:34:51 user nova-compute[73091]: DEBUG nova.network.neutron [req-f57ffb17-3a87-4292-afa0-5eb1c9827e71 req-cf6653ce-2c0c-48d0-91a5-6632b01271e5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Refreshing network info cache for port dc6e7056-4650-4973-be22-b1d98c14149f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG nova.network.neutron [req-f57ffb17-3a87-4292-afa0-5eb1c9827e71 req-cf6653ce-2c0c-48d0-91a5-6632b01271e5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Updated VIF entry in instance network info cache for port dc6e7056-4650-4973-be22-b1d98c14149f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG nova.network.neutron [req-f57ffb17-3a87-4292-afa0-5eb1c9827e71 req-cf6653ce-2c0c-48d0-91a5-6632b01271e5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Updating instance_info_cache with network_info: [{"id": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "address": "fa:16:3e:30:e8:27", "network": {"id": "41f77be1-0754-463b-a14d-b199368ae881", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-32585978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9e1fe5-ad", "ovs_interfaceid": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "address": "fa:16:3e:a0:6f:69", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eac408-ec", "ovs_interfaceid": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "address": "fa:16:3e:db:ca:02", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847e88af-f8", "ovs_interfaceid": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f37bd5d-1587-4aad-9da4-892334eadaad", "address": "fa:16:3e:79:2d:22", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f37bd5d-15", "ovs_interfaceid": "9f37bd5d-1587-4aad-9da4-892334eadaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "address": "fa:16:3e:05:45:18", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f12e06-60", "ovs_interfaceid": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc6e7056-4650-4973-be22-b1d98c14149f", "address": "fa:16:3e:af:95:d3", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc6e7056-46", "ovs_interfaceid": "dc6e7056-4650-4973-be22-b1d98c14149f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1128f26c-215d-4940-8772-886149c34785", "address": "fa:16:3e:18:47:aa", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1128f26c-21", "ovs_interfaceid": "1128f26c-215d-4940-8772-886149c34785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f57ffb17-3a87-4292-afa0-5eb1c9827e71 req-cf6653ce-2c0c-48d0-91a5-6632b01271e5 service nova] Releasing lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-f57ffb17-3a87-4292-afa0-5eb1c9827e71 req-cf6653ce-2c0c-48d0-91a5-6632b01271e5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-changed-1128f26c-215d-4940-8772-886149c34785 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-f57ffb17-3a87-4292-afa0-5eb1c9827e71 req-cf6653ce-2c0c-48d0-91a5-6632b01271e5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Refreshing instance network info cache due to event network-changed-1128f26c-215d-4940-8772-886149c34785. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f57ffb17-3a87-4292-afa0-5eb1c9827e71 req-cf6653ce-2c0c-48d0-91a5-6632b01271e5 service nova] Acquiring lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f57ffb17-3a87-4292-afa0-5eb1c9827e71 req-cf6653ce-2c0c-48d0-91a5-6632b01271e5 service nova] Acquired lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG nova.network.neutron [req-f57ffb17-3a87-4292-afa0-5eb1c9827e71 req-cf6653ce-2c0c-48d0-91a5-6632b01271e5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Refreshing network info cache for port 1128f26c-215d-4940-8772-886149c34785 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:34:52 user nova-compute[73091]: INFO nova.virt.block_device [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Booting with volume 261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 at /dev/vdb
Aug 09 16:34:52 user nova-compute[73091]: DEBUG os_brick.utils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[38198042-e5ea-4abf-a4e6-9d2abac4bd73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[618977a6-e27f-4792-ae5a-65f821cd37ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc9e20e-5332-4d46-86d1-9d44d66b0841]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd053d6c-bd2d-4a46-8564-969f41fa9c12]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:34:52 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:34:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[adce6ead-6bc2-439c-9e9f-a4214f02500b]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG os_brick.utils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Updating existing volume attachment record: 4817fc85-94d4-446a-aa0a-33ea96634ff7 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG nova.network.neutron [req-f57ffb17-3a87-4292-afa0-5eb1c9827e71 req-cf6653ce-2c0c-48d0-91a5-6632b01271e5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Updated VIF entry in instance network info cache for port 1128f26c-215d-4940-8772-886149c34785. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG nova.network.neutron [req-f57ffb17-3a87-4292-afa0-5eb1c9827e71 req-cf6653ce-2c0c-48d0-91a5-6632b01271e5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Updating instance_info_cache with network_info: [{"id": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "address": "fa:16:3e:30:e8:27", "network": {"id": "41f77be1-0754-463b-a14d-b199368ae881", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-32585978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9e1fe5-ad", "ovs_interfaceid": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "address": "fa:16:3e:a0:6f:69", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eac408-ec", "ovs_interfaceid": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "address": "fa:16:3e:db:ca:02", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847e88af-f8", "ovs_interfaceid": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f37bd5d-1587-4aad-9da4-892334eadaad", "address": "fa:16:3e:79:2d:22", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f37bd5d-15", "ovs_interfaceid": "9f37bd5d-1587-4aad-9da4-892334eadaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "address": "fa:16:3e:05:45:18", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f12e06-60", "ovs_interfaceid": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc6e7056-4650-4973-be22-b1d98c14149f", "address": "fa:16:3e:af:95:d3", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc6e7056-46", "ovs_interfaceid": "dc6e7056-4650-4973-be22-b1d98c14149f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1128f26c-215d-4940-8772-886149c34785", "address": "fa:16:3e:18:47:aa", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1128f26c-21", "ovs_interfaceid": "1128f26c-215d-4940-8772-886149c34785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:34:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f57ffb17-3a87-4292-afa0-5eb1c9827e71 req-cf6653ce-2c0c-48d0-91a5-6632b01271e5 service nova] Releasing lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:34:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:34:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquiring lock "117928be-d7c7-4d40-a0ef-2a88c360cfec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "117928be-d7c7-4d40-a0ef-2a88c360cfec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:34:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:34:55 user nova-compute[73091]: INFO nova.compute.claims [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Claim successful on node user
Aug 09 16:34:55 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:34:55 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:34:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:34:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:34:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:34:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:34:55 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:34:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:34:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:34:55 user nova-compute[73091]: DEBUG nova.policy [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2bcb694325ff4b6ab46c3b26f625ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e547803499e4aa59f4ec4c4af9bd4da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:34:56 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Creating image(s)
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquiring lock "/opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "/opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "/opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.154s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.133s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec/disk 1073741824" returned: 0 in 0.047s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Checking if we can resize image /opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Cannot resize image /opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lazy-loading 'migration_context' on Instance uuid 117928be-d7c7-4d40-a0ef-2a88c360cfec {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Ensure instance console log exists: /opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:34:56 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Creating image(s)
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Ensure instance console log exists: /opt/stack/data/nova/instances/c4f1da39-1fb7-4551-8be0-10216ab423ea/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Start _get_guest_xml network_info=[{"id": "2d404f54-5fe2-47d8-b036-955d05de1706", "address": "fa:16:3e:93:70:5b", "network": {"id": "288571f5-6f90-44a8-b1a7-5a66a9a3ed4e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-506239100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d404f54-5f", "ovs_interfaceid": "2d404f54-5fe2-47d8-b036-955d05de1706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85a99727-150d-48a7-ba46-bce583a5353b", "address": "fa:16:3e:15:52:2a", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a99727-15", "ovs_interfaceid": "85a99727-150d-48a7-ba46-bce583a5353b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "415c1381-e446-4743-8420-56093064c1cb", "address": "fa:16:3e:72:41:a4", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415c1381-e4", "ovs_interfaceid": "415c1381-e446-4743-8420-56093064c1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9274af2c-557c-4b06-a375-5006f4792f69", "address": "fa:16:3e:69:b1:a3", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9274af2c-55", "ovs_interfaceid": "9274af2c-557c-4b06-a375-5006f4792f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "271512c1-1707-48da-84cf-978ab9e0d202", "address": "fa:16:3e:45:f5:f7", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap271512c1-17", "ovs_interfaceid": "271512c1-1707-48da-84cf-978ab9e0d202", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "address": "fa:16:3e:83:c1:f4", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652f5030-20", "ovs_interfaceid": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "address": "fa:16:3e:02:41:b2", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ee120-3c", "ovs_interfaceid": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '4f5b7494-2301-41ee-9703-88122e3537ed', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkxBeJNG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c4f1da39-1fb7-4551-8be0-10216ab423ea', 'attached_at': '', 'detached_at': '', 'volume_id': '5880d5fd-ede8-402d-9010-f7536acf6d33', 'serial': '5880d5fd-ede8-402d-9010-f7536acf6d33'}, 'mount_device': '/dev/vda', 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'ad3a220f-b452-4ae7-a5e4-330ef59ffe87', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oshlEfaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c4f1da39-1fb7-4551-8be0-10216ab423ea', 'attached_at': '', 'detached_at': '', 'volume_id': '44a02bc4-5692-436e-ac17-4e80de184f7f', 'serial': '44a02bc4-5692-436e-ac17-4e80de184f7f'}, 'mount_device': '/dev/vdb', 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '9f89651f-e587-432c-8eb5-e14a2c7e3a2a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPUsaeKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c4f1da39-1fb7-4551-8be0-10216ab423ea', 'attached_at': '', 'detached_at': '', 'volume_id': '91a6b7e6-0b03-4127-8480-7f49d15d5312', 'serial': '91a6b7e6-0b03-4127-8480-7f49d15d5312'}, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:34:56 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:34:56 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connector [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Factory for ISCSI on None {{(pid=73091) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkxBeJNG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:34:56 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:34:56 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:34:56 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f73dd0-e729-401f-87d7-efc09066eb0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:34:56 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Successfully created port: 525a0b55-12b7-47ff-9223-1fcfb3205ca3 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[79437155-83a1-4647-ad62-982f77d84730]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33] added
Aug 09 16:34:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b1ce1c-3455-4fea-8aa5-db0de74ffe91]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[159dd288-fd38-4486-bbff-d5548621ff81]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mkxBeJNG {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mkxBeJNG" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97fbc15-0f4c-4f0c-b85b-b4c8f53de4a9]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mkxBeJNG'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d56d3f-9b76-42ee-89e6-9fd580669850]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[26de1dab-d566-480e-bca3-046948cba1aa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 16:34:57 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 16:34:57 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:34:57 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 16:34:57 user nova-compute[73091]: 
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[76073882-7a8d-43d2-8ba2-a0ac5cba7c4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33, portal: 172.16.0.220,3260]
Aug 09 16:34:57 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33, portal: 172.16.0.220,3260] successful.
Aug 09 16:34:57 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ca3058-7079-4f10-8d75-92a8fd3f6cff]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[85657356-4863-40a2-8001-a165ce055914]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:34:57 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:34:57 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[784f8a72-bc05-4304-ae16-527e662317b8]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkxBeJNG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Successfully updated port: 525a0b55-12b7-47ff-9223-1fcfb3205ca3 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquiring lock "refresh_cache-117928be-d7c7-4d40-a0ef-2a88c360cfec" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquired lock "refresh_cache-117928be-d7c7-4d40-a0ef-2a88c360cfec" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-0a2e0a36-7982-470b-9865-58c7b7398abe req-7f1d4bf6-cdd3-4691-8167-1db142676d6f service nova] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Received event network-changed-525a0b55-12b7-47ff-9223-1fcfb3205ca3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-0a2e0a36-7982-470b-9865-58c7b7398abe req-7f1d4bf6-cdd3-4691-8167-1db142676d6f service nova] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Refreshing instance network info cache due to event network-changed-525a0b55-12b7-47ff-9223-1fcfb3205ca3. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0a2e0a36-7982-470b-9865-58c7b7398abe req-7f1d4bf6-cdd3-4691-8167-1db142676d6f service nova] Acquiring lock "refresh_cache-117928be-d7c7-4d40-a0ef-2a88c360cfec" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Updating instance_info_cache with network_info: [{"id": "525a0b55-12b7-47ff-9223-1fcfb3205ca3", "address": "fa:16:3e:b1:d1:8e", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525a0b55-12", "ovs_interfaceid": "525a0b55-12b7-47ff-9223-1fcfb3205ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Releasing lock "refresh_cache-117928be-d7c7-4d40-a0ef-2a88c360cfec" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Instance network_info: |[{"id": "525a0b55-12b7-47ff-9223-1fcfb3205ca3", "address": "fa:16:3e:b1:d1:8e", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525a0b55-12", "ovs_interfaceid": "525a0b55-12b7-47ff-9223-1fcfb3205ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0a2e0a36-7982-470b-9865-58c7b7398abe req-7f1d4bf6-cdd3-4691-8167-1db142676d6f service nova] Acquired lock "refresh_cache-117928be-d7c7-4d40-a0ef-2a88c360cfec" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG nova.network.neutron [req-0a2e0a36-7982-470b-9865-58c7b7398abe req-7f1d4bf6-cdd3-4691-8167-1db142676d6f service nova] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Refreshing network info cache for port 525a0b55-12b7-47ff-9223-1fcfb3205ca3 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:34:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Start _get_guest_xml network_info=[{"id": "525a0b55-12b7-47ff-9223-1fcfb3205ca3", "address": "fa:16:3e:b1:d1:8e", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525a0b55-12", "ovs_interfaceid": "525a0b55-12b7-47ff-9223-1fcfb3205ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:34:58 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:34:58 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:34:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-94900830',display_name='tempest-ServersNegativeTestJSON-server-94900830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-94900830',id=11,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e547803499e4aa59f4ec4c4af9bd4da',ramdisk_id='',reservation_id='r-lcvlkr5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-484230207',owner_user_name='tempest-ServersNegativeTestJSON-484230207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:56Z,user_data=None,user_id='2bcb694325ff4b6ab46c3b26f625ef1f',uuid=117928be-d7c7-4d40-a0ef-2a88c360cfec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "525a0b55-12b7-47ff-9223-1fcfb3205ca3", "address": "fa:16:3e:b1:d1:8e", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525a0b55-12", "ovs_interfaceid": "525a0b55-12b7-47ff-9223-1fcfb3205ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Converting VIF {"id": "525a0b55-12b7-47ff-9223-1fcfb3205ca3", "address": "fa:16:3e:b1:d1:8e", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525a0b55-12", "ovs_interfaceid": "525a0b55-12b7-47ff-9223-1fcfb3205ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d1:8e,bridge_name='br-int',has_traffic_filtering=True,id=525a0b55-12b7-47ff-9223-1fcfb3205ca3,network=Network(450122ab-0e98-4dd4-9f52-82aa1bfaa561),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525a0b55-12') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lazy-loading 'pci_devices' on Instance uuid 117928be-d7c7-4d40-a0ef-2a88c360cfec {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:34:58 user nova-compute[73091]:   <uuid>117928be-d7c7-4d40-a0ef-2a88c360cfec</uuid>
Aug 09 16:34:58 user nova-compute[73091]:   <name>instance-0000000b</name>
Aug 09 16:34:58 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:34:58 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:34:58 user nova-compute[73091]:   <metadata>
Aug 09 16:34:58 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:34:58 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:34:58 user nova-compute[73091]:       <nova:name>tempest-ServersNegativeTestJSON-server-94900830</nova:name>
Aug 09 16:34:58 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:34:58</nova:creationTime>
Aug 09 16:34:58 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:34:58 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:34:58 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:34:58 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:34:58 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:34:58 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:34:58 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:34:58 user nova-compute[73091]:       <nova:owner>
Aug 09 16:34:58 user nova-compute[73091]:         <nova:user uuid="2bcb694325ff4b6ab46c3b26f625ef1f">tempest-ServersNegativeTestJSON-484230207-project-member</nova:user>
Aug 09 16:34:58 user nova-compute[73091]:         <nova:project uuid="7e547803499e4aa59f4ec4c4af9bd4da">tempest-ServersNegativeTestJSON-484230207</nova:project>
Aug 09 16:34:58 user nova-compute[73091]:       </nova:owner>
Aug 09 16:34:58 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:34:58 user nova-compute[73091]:       <nova:ports>
Aug 09 16:34:58 user nova-compute[73091]:         <nova:port uuid="525a0b55-12b7-47ff-9223-1fcfb3205ca3">
Aug 09 16:34:58 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 16:34:58 user nova-compute[73091]:         </nova:port>
Aug 09 16:34:58 user nova-compute[73091]:       </nova:ports>
Aug 09 16:34:58 user nova-compute[73091]:     </nova:instance>
Aug 09 16:34:58 user nova-compute[73091]:   </metadata>
Aug 09 16:34:58 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:34:58 user nova-compute[73091]:     <system>
Aug 09 16:34:58 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:34:58 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:34:58 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:34:58 user nova-compute[73091]:       <entry name="serial">117928be-d7c7-4d40-a0ef-2a88c360cfec</entry>
Aug 09 16:34:58 user nova-compute[73091]:       <entry name="uuid">117928be-d7c7-4d40-a0ef-2a88c360cfec</entry>
Aug 09 16:34:58 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:34:58 user nova-compute[73091]:     </system>
Aug 09 16:34:58 user nova-compute[73091]:   </sysinfo>
Aug 09 16:34:58 user nova-compute[73091]:   <os>
Aug 09 16:34:58 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:34:58 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:34:58 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:34:58 user nova-compute[73091]:   </os>
Aug 09 16:34:58 user nova-compute[73091]:   <features>
Aug 09 16:34:58 user nova-compute[73091]:     <acpi/>
Aug 09 16:34:58 user nova-compute[73091]:     <apic/>
Aug 09 16:34:58 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:34:58 user nova-compute[73091]:   </features>
Aug 09 16:34:58 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:34:58 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:34:58 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:34:58 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:34:58 user nova-compute[73091]:   </clock>
Aug 09 16:34:58 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:34:58 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:34:58 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:34:58 user nova-compute[73091]:   </cpu>
Aug 09 16:34:58 user nova-compute[73091]:   <devices>
Aug 09 16:34:58 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:34:58 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:34:58 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec/disk"/>
Aug 09 16:34:58 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:34:58 user nova-compute[73091]:     </disk>
Aug 09 16:34:58 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:34:58 user nova-compute[73091]:       <mac address="fa:16:3e:b1:d1:8e"/>
Aug 09 16:34:58 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:34:58 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:34:58 user nova-compute[73091]:       <target dev="tap525a0b55-12"/>
Aug 09 16:34:58 user nova-compute[73091]:     </interface>
Aug 09 16:34:58 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:34:58 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec/console.log" append="off"/>
Aug 09 16:34:58 user nova-compute[73091]:     </serial>
Aug 09 16:34:58 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:34:58 user nova-compute[73091]:     <video>
Aug 09 16:34:58 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:34:58 user nova-compute[73091]:     </video>
Aug 09 16:34:58 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:34:58 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:34:58 user nova-compute[73091]:     </rng>
Aug 09 16:34:58 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:34:58 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:34:58 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:34:58 user nova-compute[73091]:     </memballoon>
Aug 09 16:34:58 user nova-compute[73091]:   </devices>
Aug 09 16:34:58 user nova-compute[73091]: </domain>
Aug 09 16:34:58 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:34:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-94900830',display_name='tempest-ServersNegativeTestJSON-server-94900830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-94900830',id=11,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e547803499e4aa59f4ec4c4af9bd4da',ramdisk_id='',reservation_id='r-lcvlkr5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-484230207',owner_user_name='tempest-ServersNegativeTestJSON-484230207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:56Z,user_data=None,user_id='2bcb694325ff4b6ab46c3b26f625ef1f',uuid=117928be-d7c7-4d40-a0ef-2a88c360cfec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "525a0b55-12b7-47ff-9223-1fcfb3205ca3", "address": "fa:16:3e:b1:d1:8e", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525a0b55-12", "ovs_interfaceid": "525a0b55-12b7-47ff-9223-1fcfb3205ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Converting VIF {"id": "525a0b55-12b7-47ff-9223-1fcfb3205ca3", "address": "fa:16:3e:b1:d1:8e", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525a0b55-12", "ovs_interfaceid": "525a0b55-12b7-47ff-9223-1fcfb3205ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d1:8e,bridge_name='br-int',has_traffic_filtering=True,id=525a0b55-12b7-47ff-9223-1fcfb3205ca3,network=Network(450122ab-0e98-4dd4-9f52-82aa1bfaa561),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525a0b55-12') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_vif [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d1:8e,bridge_name='br-int',has_traffic_filtering=True,id=525a0b55-12b7-47ff-9223-1fcfb3205ca3,network=Network(450122ab-0e98-4dd4-9f52-82aa1bfaa561),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525a0b55-12') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap525a0b55-12, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap525a0b55-12, col_values=(('external_ids', {'iface-id': '525a0b55-12b7-47ff-9223-1fcfb3205ca3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:d1:8e', 'vm-uuid': '117928be-d7c7-4d40-a0ef-2a88c360cfec'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:58 user nova-compute[73091]: INFO os_vif [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d1:8e,bridge_name='br-int',has_traffic_filtering=True,id=525a0b55-12b7-47ff-9223-1fcfb3205ca3,network=Network(450122ab-0e98-4dd4-9f52-82aa1bfaa561),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525a0b55-12')
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23538343661343235', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538343661343235', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oshlEfaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:34:58 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:34:58 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:34:58 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] No VIF found with MAC fa:16:3e:b1:d1:8e, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7e8665-9a88-4aa5-beea-ba4fc8b405df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:34:58 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c0f89b-42b8-4e48-bfeb-3d5344843638]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f] added
Aug 09 16:34:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[739b2b2c-f5d1-47e3-9fc2-7fbb4ff72d3b]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25b57b1-e781-4125-a277-ac7f06a09765]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oshlEfaB {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oshlEfaB" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5857bf-27e2-4469-b326-27717e7ba976]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oshlEfaB'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec8cf30-5152-46d3-8ab7-25658f37c119]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c4ec64-a2bb-46fc-9e14-19a86509482d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:34:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:34:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.network.neutron [req-0a2e0a36-7982-470b-9865-58c7b7398abe req-7f1d4bf6-cdd3-4691-8167-1db142676d6f service nova] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Updated VIF entry in instance network info cache for port 525a0b55-12b7-47ff-9223-1fcfb3205ca3. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG nova.network.neutron [req-0a2e0a36-7982-470b-9865-58c7b7398abe req-7f1d4bf6-cdd3-4691-8167-1db142676d6f service nova] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Updating instance_info_cache with network_info: [{"id": "525a0b55-12b7-47ff-9223-1fcfb3205ca3", "address": "fa:16:3e:b1:d1:8e", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525a0b55-12", "ovs_interfaceid": "525a0b55-12b7-47ff-9223-1fcfb3205ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6ba5e6-36dc-40fe-acc7-8f4e1fa88895]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f, portal: 172.16.0.220,3260]
Aug 09 16:34:58 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f, portal: 172.16.0.220,3260] successful.
Aug 09 16:34:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0a2e0a36-7982-470b-9865-58c7b7398abe req-7f1d4bf6-cdd3-4691-8167-1db142676d6f service nova] Releasing lock "refresh_cache-117928be-d7c7-4d40-a0ef-2a88c360cfec" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[42aeb7d5-9060-4bcd-981e-3f4d923e97e3]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[010f9767-4868-448d-82b8-64f053992c98]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:34:58 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:34:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:34:58 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:34:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85afbf1-65db-4ca2-856c-326f7bebb490]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oshlEfaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:34:58 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23431396263653134', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431396263653134', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPUsaeKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:34:59 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:34:59 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:34:59 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d713acbd-0185-4085-9078-8c9ec491fdec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:34:59 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc616cf-f041-4727-8fff-1605d4efdb7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312] added
Aug 09 16:34:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b16e47-a296-4189-9335-c4c5363d38c6]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3911ce3-dc9b-427a-a8e4-6ecd5ff3fcab]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LPUsaeKx {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LPUsaeKx" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e284e4-f2f4-4032-8a00-e6899c04abdb]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LPUsaeKx'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa264984-78e5-46b2-9d60-5e825b366bab]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ae3771-b93d-4658-9717-5c07751607c9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:34:59 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:34:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:34:59 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:34:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cbc1da-3330-4217-be24-da298327ddcf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312, portal: 172.16.0.220,3260]
Aug 09 16:34:59 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312, portal: 172.16.0.220,3260] successful.
Aug 09 16:34:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[93336531-d2c1-4a56-b972-527ec3fcd73c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dc009b-8d2d-41e4-bdfd-df0564a207b0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:34:59 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:34:59 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:34:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:34:59 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:34:59 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:34:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb352a3-af20-4c0d-a9b7-7738f630b8b1]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPUsaeKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-6928858f-e48f-4b80-8359-b464d7ee5a1c req-0157d1ff-787a-4b0a-8f42-09ed64f328b4 service nova] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Received event network-vif-plugged-525a0b55-12b7-47ff-9223-1fcfb3205ca3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6928858f-e48f-4b80-8359-b464d7ee5a1c req-0157d1ff-787a-4b0a-8f42-09ed64f328b4 service nova] Acquiring lock "117928be-d7c7-4d40-a0ef-2a88c360cfec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6928858f-e48f-4b80-8359-b464d7ee5a1c req-0157d1ff-787a-4b0a-8f42-09ed64f328b4 service nova] Lock "117928be-d7c7-4d40-a0ef-2a88c360cfec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6928858f-e48f-4b80-8359-b464d7ee5a1c req-0157d1ff-787a-4b0a-8f42-09ed64f328b4 service nova] Lock "117928be-d7c7-4d40-a0ef-2a88c360cfec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-6928858f-e48f-4b80-8359-b464d7ee5a1c req-0157d1ff-787a-4b0a-8f42-09ed64f328b4 service nova] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] No waiting events found dispatching network-vif-plugged-525a0b55-12b7-47ff-9223-1fcfb3205ca3 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:34:59 user nova-compute[73091]: WARNING nova.compute.manager [req-6928858f-e48f-4b80-8359-b464d7ee5a1c req-0157d1ff-787a-4b0a-8f42-09ed64f328b4 service nova] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Received unexpected event network-vif-plugged-525a0b55-12b7-47ff-9223-1fcfb3205ca3 for instance with vm_state building and task_state spawning.
Aug 09 16:34:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:34:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-e4ec0db9-740e-4047-8cab-ac60a1681483" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-e4ec0db9-740e-4047-8cab-ac60a1681483" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Updating instance_info_cache with network_info: [{"id": "0e3f420c-de38-4d22-a167-fdca07babd17", "address": "fa:16:3e:34:44:1f", "network": {"id": "e19cb2bb-1445-4ff3-babe-23d0e2c23362", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2077372665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a17cf3e438de4946aeaa9899d1fcc865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3f420c-de", "ovs_interfaceid": "0e3f420c-de38-4d22-a167-fdca07babd17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-e4ec0db9-740e-4047-8cab-ac60a1681483" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23031616434363563', 'path': '/dev/sdd'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031616434363563', 'path': '/dev/sdd'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d404f54-5fe2-47d8-b036-955d05de1706", "address": "fa:16:3e:93:70:5b", "network": {"id": "288571f5-6f90-44a8-b1a7-5a66a9a3ed4e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-506239100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d404f54-5f", "ovs_interfaceid": "2d404f54-5fe2-47d8-b036-955d05de1706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "2d404f54-5fe2-47d8-b036-955d05de1706", "address": "fa:16:3e:93:70:5b", "network": {"id": "288571f5-6f90-44a8-b1a7-5a66a9a3ed4e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-506239100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d404f54-5f", "ovs_interfaceid": "2d404f54-5fe2-47d8-b036-955d05de1706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:70:5b,bridge_name='br-int',has_traffic_filtering=True,id=2d404f54-5fe2-47d8-b036-955d05de1706,network=Network(288571f5-6f90-44a8-b1a7-5a66a9a3ed4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d404f54-5f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85a99727-150d-48a7-ba46-bce583a5353b", "address": "fa:16:3e:15:52:2a", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a99727-15", "ovs_interfaceid": "85a99727-150d-48a7-ba46-bce583a5353b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "85a99727-150d-48a7-ba46-bce583a5353b", "address": "fa:16:3e:15:52:2a", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a99727-15", "ovs_interfaceid": "85a99727-150d-48a7-ba46-bce583a5353b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:52:2a,bridge_name='br-int',has_traffic_filtering=True,id=85a99727-150d-48a7-ba46-bce583a5353b,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap85a99727-15') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "415c1381-e446-4743-8420-56093064c1cb", "address": "fa:16:3e:72:41:a4", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415c1381-e4", "ovs_interfaceid": "415c1381-e446-4743-8420-56093064c1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "415c1381-e446-4743-8420-56093064c1cb", "address": "fa:16:3e:72:41:a4", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415c1381-e4", "ovs_interfaceid": "415c1381-e446-4743-8420-56093064c1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:41:a4,bridge_name='br-int',has_traffic_filtering=True,id=415c1381-e446-4743-8420-56093064c1cb,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap415c1381-e4') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9274af2c-557c-4b06-a375-5006f4792f69", "address": "fa:16:3e:69:b1:a3", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9274af2c-55", "ovs_interfaceid": "9274af2c-557c-4b06-a375-5006f4792f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "9274af2c-557c-4b06-a375-5006f4792f69", "address": "fa:16:3e:69:b1:a3", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9274af2c-55", "ovs_interfaceid": "9274af2c-557c-4b06-a375-5006f4792f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:b1:a3,bridge_name='br-int',has_traffic_filtering=True,id=9274af2c-557c-4b06-a375-5006f4792f69,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9274af2c-55') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "271512c1-1707-48da-84cf-978ab9e0d202", "address": "fa:16:3e:45:f5:f7", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap271512c1-17", "ovs_interfaceid": "271512c1-1707-48da-84cf-978ab9e0d202", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "271512c1-1707-48da-84cf-978ab9e0d202", "address": "fa:16:3e:45:f5:f7", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap271512c1-17", "ovs_interfaceid": "271512c1-1707-48da-84cf-978ab9e0d202", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:f5:f7,bridge_name='br-int',has_traffic_filtering=True,id=271512c1-1707-48da-84cf-978ab9e0d202,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap271512c1-17') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "address": "fa:16:3e:83:c1:f4", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652f5030-20", "ovs_interfaceid": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "address": "fa:16:3e:83:c1:f4", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652f5030-20", "ovs_interfaceid": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:c1:f4,bridge_name='br-int',has_traffic_filtering=True,id=652f5030-2075-40f8-ab87-f86f5dbb6e75,network=Network(d3e5957a-3aa9-4009-9f99-19f55722be34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap652f5030-20') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "address": "fa:16:3e:02:41:b2", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ee120-3c", "ovs_interfaceid": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "address": "fa:16:3e:02:41:b2", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ee120-3c", "ovs_interfaceid": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=9c7ee120-3c19-4ba4-8f87-de7384c64d7a,network=Network(d3e5957a-3aa9-4009-9f99-19f55722be34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ee120-3c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.objects.instance [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lazy-loading 'pci_devices' on Instance uuid c4f1da39-1fb7-4551-8be0-10216ab423ea {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:35:00 user nova-compute[73091]:   <uuid>c4f1da39-1fb7-4551-8be0-10216ab423ea</uuid>
Aug 09 16:35:00 user nova-compute[73091]:   <name>instance-00000009</name>
Aug 09 16:35:00 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:35:00 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:35:00 user nova-compute[73091]:   <metadata>
Aug 09 16:35:00 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:35:00 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:35:00 user nova-compute[73091]:       <nova:name>tempest-device-tagging-server-9362893</nova:name>
Aug 09 16:35:00 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:34:56</nova:creationTime>
Aug 09 16:35:00 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:35:00 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:35:00 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:35:00 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:35:00 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:35:00 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:35:00 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:35:00 user nova-compute[73091]:       <nova:owner>
Aug 09 16:35:00 user nova-compute[73091]:         <nova:user uuid="9f8ebe5c5921442db9b4ac5a7e0d6e2d">tempest-TaggedBootDevicesTest-733706730-project-member</nova:user>
Aug 09 16:35:00 user nova-compute[73091]:         <nova:project uuid="50caffcf74fb48dc9bb136c3fecc91c1">tempest-TaggedBootDevicesTest-733706730</nova:project>
Aug 09 16:35:00 user nova-compute[73091]:       </nova:owner>
Aug 09 16:35:00 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:35:00 user nova-compute[73091]:       <nova:ports>
Aug 09 16:35:00 user nova-compute[73091]:         <nova:port uuid="2d404f54-5fe2-47d8-b036-955d05de1706">
Aug 09 16:35:00 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 16:35:00 user nova-compute[73091]:         </nova:port>
Aug 09 16:35:00 user nova-compute[73091]:         <nova:port uuid="85a99727-150d-48a7-ba46-bce583a5353b">
Aug 09 16:35:00 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.145" ipVersion="4"/>
Aug 09 16:35:00 user nova-compute[73091]:         </nova:port>
Aug 09 16:35:00 user nova-compute[73091]:         <nova:port uuid="415c1381-e446-4743-8420-56093064c1cb">
Aug 09 16:35:00 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.193" ipVersion="4"/>
Aug 09 16:35:00 user nova-compute[73091]:         </nova:port>
Aug 09 16:35:00 user nova-compute[73091]:         <nova:port uuid="9274af2c-557c-4b06-a375-5006f4792f69">
Aug 09 16:35:00 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.76" ipVersion="4"/>
Aug 09 16:35:00 user nova-compute[73091]:         </nova:port>
Aug 09 16:35:00 user nova-compute[73091]:         <nova:port uuid="271512c1-1707-48da-84cf-978ab9e0d202">
Aug 09 16:35:00 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.75" ipVersion="4"/>
Aug 09 16:35:00 user nova-compute[73091]:         </nova:port>
Aug 09 16:35:00 user nova-compute[73091]:         <nova:port uuid="652f5030-2075-40f8-ab87-f86f5dbb6e75">
Aug 09 16:35:00 user nova-compute[73091]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 09 16:35:00 user nova-compute[73091]:         </nova:port>
Aug 09 16:35:00 user nova-compute[73091]:         <nova:port uuid="9c7ee120-3c19-4ba4-8f87-de7384c64d7a">
Aug 09 16:35:00 user nova-compute[73091]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 09 16:35:00 user nova-compute[73091]:         </nova:port>
Aug 09 16:35:00 user nova-compute[73091]:       </nova:ports>
Aug 09 16:35:00 user nova-compute[73091]:     </nova:instance>
Aug 09 16:35:00 user nova-compute[73091]:   </metadata>
Aug 09 16:35:00 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:35:00 user nova-compute[73091]:     <system>
Aug 09 16:35:00 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:35:00 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:35:00 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:35:00 user nova-compute[73091]:       <entry name="serial">c4f1da39-1fb7-4551-8be0-10216ab423ea</entry>
Aug 09 16:35:00 user nova-compute[73091]:       <entry name="uuid">c4f1da39-1fb7-4551-8be0-10216ab423ea</entry>
Aug 09 16:35:00 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:35:00 user nova-compute[73091]:     </system>
Aug 09 16:35:00 user nova-compute[73091]:   </sysinfo>
Aug 09 16:35:00 user nova-compute[73091]:   <os>
Aug 09 16:35:00 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:35:00 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:35:00 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:35:00 user nova-compute[73091]:   </os>
Aug 09 16:35:00 user nova-compute[73091]:   <features>
Aug 09 16:35:00 user nova-compute[73091]:     <acpi/>
Aug 09 16:35:00 user nova-compute[73091]:     <apic/>
Aug 09 16:35:00 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:35:00 user nova-compute[73091]:   </features>
Aug 09 16:35:00 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:35:00 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:35:00 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:35:00 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:35:00 user nova-compute[73091]:   </clock>
Aug 09 16:35:00 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:35:00 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:35:00 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:35:00 user nova-compute[73091]:   </cpu>
Aug 09 16:35:00 user nova-compute[73091]:   <devices>
Aug 09 16:35:00 user nova-compute[73091]:     <disk type="file" device="cdrom">
Aug 09 16:35:00 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 16:35:00 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/c4f1da39-1fb7-4551-8be0-10216ab423ea/disk.config"/>
Aug 09 16:35:00 user nova-compute[73091]:       <target dev="hda" bus="ide"/>
Aug 09 16:35:00 user nova-compute[73091]:     </disk>
Aug 09 16:35:00 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:35:00 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:35:00 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 09 16:35:00 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:35:00 user nova-compute[73091]:       <serial>5880d5fd-ede8-402d-9010-f7536acf6d33</serial>
Aug 09 16:35:00 user nova-compute[73091]:     </disk>
Aug 09 16:35:00 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:35:00 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:35:00 user nova-compute[73091]:       <source dev="/dev/sdc"/>
Aug 09 16:35:00 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 09 16:35:00 user nova-compute[73091]:       <serial>44a02bc4-5692-436e-ac17-4e80de184f7f</serial>
Aug 09 16:35:00 user nova-compute[73091]:     </disk>
Aug 09 16:35:00 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:35:00 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:35:00 user nova-compute[73091]:       <source dev="/dev/sdd"/>
Aug 09 16:35:00 user nova-compute[73091]:       <target dev="vdc" bus="virtio"/>
Aug 09 16:35:00 user nova-compute[73091]:       <serial>91a6b7e6-0b03-4127-8480-7f49d15d5312</serial>
Aug 09 16:35:00 user nova-compute[73091]:     </disk>
Aug 09 16:35:00 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:35:00 user nova-compute[73091]:       <mac address="fa:16:3e:93:70:5b"/>
Aug 09 16:35:00 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:35:00 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:35:00 user nova-compute[73091]:       <target dev="tap2d404f54-5f"/>
Aug 09 16:35:00 user nova-compute[73091]:     </interface>
Aug 09 16:35:00 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:35:00 user nova-compute[73091]:       <mac address="fa:16:3e:15:52:2a"/>
Aug 09 16:35:00 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:35:00 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:35:00 user nova-compute[73091]:       <target dev="tap85a99727-15"/>
Aug 09 16:35:00 user nova-compute[73091]:     </interface>
Aug 09 16:35:00 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:35:00 user nova-compute[73091]:       <mac address="fa:16:3e:72:41:a4"/>
Aug 09 16:35:00 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:35:00 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:35:00 user nova-compute[73091]:       <target dev="tap415c1381-e4"/>
Aug 09 16:35:00 user nova-compute[73091]:     </interface>
Aug 09 16:35:00 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:35:00 user nova-compute[73091]:       <mac address="fa:16:3e:69:b1:a3"/>
Aug 09 16:35:00 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:35:00 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:35:00 user nova-compute[73091]:       <target dev="tap9274af2c-55"/>
Aug 09 16:35:00 user nova-compute[73091]:     </interface>
Aug 09 16:35:00 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:35:00 user nova-compute[73091]:       <mac address="fa:16:3e:45:f5:f7"/>
Aug 09 16:35:00 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:35:00 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:35:00 user nova-compute[73091]:       <target dev="tap271512c1-17"/>
Aug 09 16:35:00 user nova-compute[73091]:     </interface>
Aug 09 16:35:00 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:35:00 user nova-compute[73091]:       <mac address="fa:16:3e:83:c1:f4"/>
Aug 09 16:35:00 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:35:00 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:35:00 user nova-compute[73091]:       <target dev="tap652f5030-20"/>
Aug 09 16:35:00 user nova-compute[73091]:     </interface>
Aug 09 16:35:00 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:35:00 user nova-compute[73091]:       <mac address="fa:16:3e:02:41:b2"/>
Aug 09 16:35:00 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:35:00 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:35:00 user nova-compute[73091]:       <target dev="tap9c7ee120-3c"/>
Aug 09 16:35:00 user nova-compute[73091]:     </interface>
Aug 09 16:35:00 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:35:00 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/c4f1da39-1fb7-4551-8be0-10216ab423ea/console.log" append="off"/>
Aug 09 16:35:00 user nova-compute[73091]:     </serial>
Aug 09 16:35:00 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:35:00 user nova-compute[73091]:     <video>
Aug 09 16:35:00 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:35:00 user nova-compute[73091]:     </video>
Aug 09 16:35:00 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:35:00 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:35:00 user nova-compute[73091]:     </rng>
Aug 09 16:35:00 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:35:00 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:35:00 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:35:00 user nova-compute[73091]:     </memballoon>
Aug 09 16:35:00 user nova-compute[73091]:   </devices>
Aug 09 16:35:00 user nova-compute[73091]: </domain>
Aug 09 16:35:00 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d404f54-5fe2-47d8-b036-955d05de1706", "address": "fa:16:3e:93:70:5b", "network": {"id": "288571f5-6f90-44a8-b1a7-5a66a9a3ed4e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-506239100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d404f54-5f", "ovs_interfaceid": "2d404f54-5fe2-47d8-b036-955d05de1706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "2d404f54-5fe2-47d8-b036-955d05de1706", "address": "fa:16:3e:93:70:5b", "network": {"id": "288571f5-6f90-44a8-b1a7-5a66a9a3ed4e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-506239100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d404f54-5f", "ovs_interfaceid": "2d404f54-5fe2-47d8-b036-955d05de1706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:70:5b,bridge_name='br-int',has_traffic_filtering=True,id=2d404f54-5fe2-47d8-b036-955d05de1706,network=Network(288571f5-6f90-44a8-b1a7-5a66a9a3ed4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d404f54-5f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG os_vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:70:5b,bridge_name='br-int',has_traffic_filtering=True,id=2d404f54-5fe2-47d8-b036-955d05de1706,network=Network(288571f5-6f90-44a8-b1a7-5a66a9a3ed4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d404f54-5f') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d404f54-5f, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2d404f54-5f, col_values=(('external_ids', {'iface-id': '2d404f54-5fe2-47d8-b036-955d05de1706', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:70:5b', 'vm-uuid': 'c4f1da39-1fb7-4551-8be0-10216ab423ea'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:00 user nova-compute[73091]: INFO os_vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:70:5b,bridge_name='br-int',has_traffic_filtering=True,id=2d404f54-5fe2-47d8-b036-955d05de1706,network=Network(288571f5-6f90-44a8-b1a7-5a66a9a3ed4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d404f54-5f')
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85a99727-150d-48a7-ba46-bce583a5353b", "address": "fa:16:3e:15:52:2a", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a99727-15", "ovs_interfaceid": "85a99727-150d-48a7-ba46-bce583a5353b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "85a99727-150d-48a7-ba46-bce583a5353b", "address": "fa:16:3e:15:52:2a", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a99727-15", "ovs_interfaceid": "85a99727-150d-48a7-ba46-bce583a5353b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:52:2a,bridge_name='br-int',has_traffic_filtering=True,id=85a99727-150d-48a7-ba46-bce583a5353b,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap85a99727-15') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG os_vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:52:2a,bridge_name='br-int',has_traffic_filtering=True,id=85a99727-150d-48a7-ba46-bce583a5353b,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap85a99727-15') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85a99727-15, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85a99727-15, col_values=(('external_ids', {'iface-id': '85a99727-150d-48a7-ba46-bce583a5353b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:52:2a', 'vm-uuid': 'c4f1da39-1fb7-4551-8be0-10216ab423ea'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:01 user nova-compute[73091]: INFO os_vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:52:2a,bridge_name='br-int',has_traffic_filtering=True,id=85a99727-150d-48a7-ba46-bce583a5353b,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap85a99727-15')
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "415c1381-e446-4743-8420-56093064c1cb", "address": "fa:16:3e:72:41:a4", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415c1381-e4", "ovs_interfaceid": "415c1381-e446-4743-8420-56093064c1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "415c1381-e446-4743-8420-56093064c1cb", "address": "fa:16:3e:72:41:a4", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415c1381-e4", "ovs_interfaceid": "415c1381-e446-4743-8420-56093064c1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:41:a4,bridge_name='br-int',has_traffic_filtering=True,id=415c1381-e446-4743-8420-56093064c1cb,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap415c1381-e4') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG os_vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:41:a4,bridge_name='br-int',has_traffic_filtering=True,id=415c1381-e446-4743-8420-56093064c1cb,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap415c1381-e4') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap415c1381-e4, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap415c1381-e4, col_values=(('external_ids', {'iface-id': '415c1381-e446-4743-8420-56093064c1cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:41:a4', 'vm-uuid': 'c4f1da39-1fb7-4551-8be0-10216ab423ea'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:01 user nova-compute[73091]: INFO os_vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:41:a4,bridge_name='br-int',has_traffic_filtering=True,id=415c1381-e446-4743-8420-56093064c1cb,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap415c1381-e4')
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9274af2c-557c-4b06-a375-5006f4792f69", "address": "fa:16:3e:69:b1:a3", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9274af2c-55", "ovs_interfaceid": "9274af2c-557c-4b06-a375-5006f4792f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "9274af2c-557c-4b06-a375-5006f4792f69", "address": "fa:16:3e:69:b1:a3", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9274af2c-55", "ovs_interfaceid": "9274af2c-557c-4b06-a375-5006f4792f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:b1:a3,bridge_name='br-int',has_traffic_filtering=True,id=9274af2c-557c-4b06-a375-5006f4792f69,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9274af2c-55') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG os_vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:b1:a3,bridge_name='br-int',has_traffic_filtering=True,id=9274af2c-557c-4b06-a375-5006f4792f69,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9274af2c-55') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9274af2c-55, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9274af2c-55, col_values=(('external_ids', {'iface-id': '9274af2c-557c-4b06-a375-5006f4792f69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:b1:a3', 'vm-uuid': 'c4f1da39-1fb7-4551-8be0-10216ab423ea'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:01 user nova-compute[73091]: INFO os_vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:b1:a3,bridge_name='br-int',has_traffic_filtering=True,id=9274af2c-557c-4b06-a375-5006f4792f69,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9274af2c-55')
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "271512c1-1707-48da-84cf-978ab9e0d202", "address": "fa:16:3e:45:f5:f7", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap271512c1-17", "ovs_interfaceid": "271512c1-1707-48da-84cf-978ab9e0d202", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "271512c1-1707-48da-84cf-978ab9e0d202", "address": "fa:16:3e:45:f5:f7", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap271512c1-17", "ovs_interfaceid": "271512c1-1707-48da-84cf-978ab9e0d202", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:f5:f7,bridge_name='br-int',has_traffic_filtering=True,id=271512c1-1707-48da-84cf-978ab9e0d202,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap271512c1-17') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG os_vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:f5:f7,bridge_name='br-int',has_traffic_filtering=True,id=271512c1-1707-48da-84cf-978ab9e0d202,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap271512c1-17') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap271512c1-17, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap271512c1-17, col_values=(('external_ids', {'iface-id': '271512c1-1707-48da-84cf-978ab9e0d202', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:f5:f7', 'vm-uuid': 'c4f1da39-1fb7-4551-8be0-10216ab423ea'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:01 user nova-compute[73091]: INFO os_vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:f5:f7,bridge_name='br-int',has_traffic_filtering=True,id=271512c1-1707-48da-84cf-978ab9e0d202,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap271512c1-17')
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "address": "fa:16:3e:83:c1:f4", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652f5030-20", "ovs_interfaceid": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "address": "fa:16:3e:83:c1:f4", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652f5030-20", "ovs_interfaceid": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:c1:f4,bridge_name='br-int',has_traffic_filtering=True,id=652f5030-2075-40f8-ab87-f86f5dbb6e75,network=Network(d3e5957a-3aa9-4009-9f99-19f55722be34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap652f5030-20') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG os_vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:c1:f4,bridge_name='br-int',has_traffic_filtering=True,id=652f5030-2075-40f8-ab87-f86f5dbb6e75,network=Network(d3e5957a-3aa9-4009-9f99-19f55722be34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap652f5030-20') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap652f5030-20, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap652f5030-20, col_values=(('external_ids', {'iface-id': '652f5030-2075-40f8-ab87-f86f5dbb6e75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:c1:f4', 'vm-uuid': 'c4f1da39-1fb7-4551-8be0-10216ab423ea'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:01 user nova-compute[73091]: INFO os_vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:c1:f4,bridge_name='br-int',has_traffic_filtering=True,id=652f5030-2075-40f8-ab87-f86f5dbb6e75,network=Network(d3e5957a-3aa9-4009-9f99-19f55722be34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap652f5030-20')
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "address": "fa:16:3e:02:41:b2", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ee120-3c", "ovs_interfaceid": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "address": "fa:16:3e:02:41:b2", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ee120-3c", "ovs_interfaceid": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=9c7ee120-3c19-4ba4-8f87-de7384c64d7a,network=Network(d3e5957a-3aa9-4009-9f99-19f55722be34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ee120-3c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG os_vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=9c7ee120-3c19-4ba4-8f87-de7384c64d7a,network=Network(d3e5957a-3aa9-4009-9f99-19f55722be34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ee120-3c') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c7ee120-3c, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c7ee120-3c, col_values=(('external_ids', {'iface-id': '9c7ee120-3c19-4ba4-8f87-de7384c64d7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:41:b2', 'vm-uuid': 'c4f1da39-1fb7-4551-8be0-10216ab423ea'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:01 user nova-compute[73091]: INFO os_vif [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=9c7ee120-3c19-4ba4-8f87-de7384c64d7a,network=Network(d3e5957a-3aa9-4009-9f99-19f55722be34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ee120-3c')
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] No BDM found with device name hda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] No VIF found with MAC fa:16:3e:93:70:5b, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] No VIF found with MAC fa:16:3e:45:f5:f7, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:35:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Using config drive
Aug 09 16:35:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Creating config drive at /opt/stack/data/nova/instances/c4f1da39-1fb7-4551-8be0-10216ab423ea/disk.config
Aug 09 16:35:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c4f1da39-1fb7-4551-8be0-10216ab423ea/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyqdaaz2d {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c4f1da39-1fb7-4551-8be0-10216ab423ea/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyqdaaz2d" returned: 0 in 0.068s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-3a647c17-e272-4469-8a91-370c0b77f802 req-c4bedd28-131b-4322-8895-451ab0673067 service nova] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Received event network-vif-plugged-525a0b55-12b7-47ff-9223-1fcfb3205ca3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3a647c17-e272-4469-8a91-370c0b77f802 req-c4bedd28-131b-4322-8895-451ab0673067 service nova] Acquiring lock "117928be-d7c7-4d40-a0ef-2a88c360cfec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3a647c17-e272-4469-8a91-370c0b77f802 req-c4bedd28-131b-4322-8895-451ab0673067 service nova] Lock "117928be-d7c7-4d40-a0ef-2a88c360cfec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3a647c17-e272-4469-8a91-370c0b77f802 req-c4bedd28-131b-4322-8895-451ab0673067 service nova] Lock "117928be-d7c7-4d40-a0ef-2a88c360cfec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-3a647c17-e272-4469-8a91-370c0b77f802 req-c4bedd28-131b-4322-8895-451ab0673067 service nova] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] No waiting events found dispatching network-vif-plugged-525a0b55-12b7-47ff-9223-1fcfb3205ca3 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:01 user nova-compute[73091]: WARNING nova.compute.manager [req-3a647c17-e272-4469-8a91-370c0b77f802 req-c4bedd28-131b-4322-8895-451ab0673067 service nova] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Received unexpected event network-vif-plugged-525a0b55-12b7-47ff-9223-1fcfb3205ca3 for instance with vm_state building and task_state spawning.
Aug 09 16:35:02 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598902.1320562, 117928be-d7c7-4d40-a0ef-2a88c360cfec => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:35:02 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] VM Resumed (Lifecycle Event)
Aug 09 16:35:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:35:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:35:02 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Instance spawned successfully.
Aug 09 16:35:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:35:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:35:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:35:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:35:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:35:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:35:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:35:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:35:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:35:02 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:35:02 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598902.1390893, 117928be-d7c7-4d40-a0ef-2a88c360cfec => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:35:02 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] VM Started (Lifecycle Event)
Aug 09 16:35:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:35:02 user nova-compute[73091]: INFO nova.compute.manager [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Took 6.22 seconds to spawn the instance on the hypervisor.
Aug 09 16:35:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:35:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:35:02 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:35:02 user nova-compute[73091]: INFO nova.compute.manager [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Took 7.12 seconds to build instance.
Aug 09 16:35:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e377c29e-7b79-4549-a725-2caee2032813 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "117928be-d7c7-4d40-a0ef-2a88c360cfec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.208s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-c647a30d-b760-4099-8011-0b58fdca77da req-dd112809-35e5-4dbb-b9e5-3749307992d6 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-2d404f54-5fe2-47d8-b036-955d05de1706 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c647a30d-b760-4099-8011-0b58fdca77da req-dd112809-35e5-4dbb-b9e5-3749307992d6 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c647a30d-b760-4099-8011-0b58fdca77da req-dd112809-35e5-4dbb-b9e5-3749307992d6 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c647a30d-b760-4099-8011-0b58fdca77da req-dd112809-35e5-4dbb-b9e5-3749307992d6 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-c647a30d-b760-4099-8011-0b58fdca77da req-dd112809-35e5-4dbb-b9e5-3749307992d6 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-2d404f54-5fe2-47d8-b036-955d05de1706 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:03 user nova-compute[73091]: WARNING nova.compute.manager [req-c647a30d-b760-4099-8011-0b58fdca77da req-dd112809-35e5-4dbb-b9e5-3749307992d6 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-2d404f54-5fe2-47d8-b036-955d05de1706 for instance with vm_state building and task_state spawning.
Aug 09 16:35:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-c83f6f96-a642-4828-81dd-4e0ebb64f721 req-9a7e363b-394d-43db-9595-943e30622fcb service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-415c1381-e446-4743-8420-56093064c1cb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c83f6f96-a642-4828-81dd-4e0ebb64f721 req-9a7e363b-394d-43db-9595-943e30622fcb service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c83f6f96-a642-4828-81dd-4e0ebb64f721 req-9a7e363b-394d-43db-9595-943e30622fcb service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c83f6f96-a642-4828-81dd-4e0ebb64f721 req-9a7e363b-394d-43db-9595-943e30622fcb service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-c83f6f96-a642-4828-81dd-4e0ebb64f721 req-9a7e363b-394d-43db-9595-943e30622fcb service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-415c1381-e446-4743-8420-56093064c1cb {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:04 user nova-compute[73091]: WARNING nova.compute.manager [req-c83f6f96-a642-4828-81dd-4e0ebb64f721 req-9a7e363b-394d-43db-9595-943e30622fcb service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-415c1381-e446-4743-8420-56093064c1cb for instance with vm_state building and task_state spawning.
Aug 09 16:35:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-9cc4dc4e-27e7-471a-94ec-f4a5ece1b198 req-710fae53-8103-4e7a-823f-f1ff5a62d23e service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-271512c1-1707-48da-84cf-978ab9e0d202 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9cc4dc4e-27e7-471a-94ec-f4a5ece1b198 req-710fae53-8103-4e7a-823f-f1ff5a62d23e service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9cc4dc4e-27e7-471a-94ec-f4a5ece1b198 req-710fae53-8103-4e7a-823f-f1ff5a62d23e service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9cc4dc4e-27e7-471a-94ec-f4a5ece1b198 req-710fae53-8103-4e7a-823f-f1ff5a62d23e service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-9cc4dc4e-27e7-471a-94ec-f4a5ece1b198 req-710fae53-8103-4e7a-823f-f1ff5a62d23e service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-271512c1-1707-48da-84cf-978ab9e0d202 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:04 user nova-compute[73091]: WARNING nova.compute.manager [req-9cc4dc4e-27e7-471a-94ec-f4a5ece1b198 req-710fae53-8103-4e7a-823f-f1ff5a62d23e service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-271512c1-1707-48da-84cf-978ab9e0d202 for instance with vm_state building and task_state spawning.
Aug 09 16:35:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-4a973077-5651-4363-a270-b46c02b7646b req-c55b880b-6132-417d-8f8f-e5f8c14e23f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-2d404f54-5fe2-47d8-b036-955d05de1706 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4a973077-5651-4363-a270-b46c02b7646b req-c55b880b-6132-417d-8f8f-e5f8c14e23f7 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4a973077-5651-4363-a270-b46c02b7646b req-c55b880b-6132-417d-8f8f-e5f8c14e23f7 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4a973077-5651-4363-a270-b46c02b7646b req-c55b880b-6132-417d-8f8f-e5f8c14e23f7 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-4a973077-5651-4363-a270-b46c02b7646b req-c55b880b-6132-417d-8f8f-e5f8c14e23f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-2d404f54-5fe2-47d8-b036-955d05de1706 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:05 user nova-compute[73091]: WARNING nova.compute.manager [req-4a973077-5651-4363-a270-b46c02b7646b req-c55b880b-6132-417d-8f8f-e5f8c14e23f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-2d404f54-5fe2-47d8-b036-955d05de1706 for instance with vm_state building and task_state spawning.
Aug 09 16:35:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-4a973077-5651-4363-a270-b46c02b7646b req-c55b880b-6132-417d-8f8f-e5f8c14e23f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-85a99727-150d-48a7-ba46-bce583a5353b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4a973077-5651-4363-a270-b46c02b7646b req-c55b880b-6132-417d-8f8f-e5f8c14e23f7 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4a973077-5651-4363-a270-b46c02b7646b req-c55b880b-6132-417d-8f8f-e5f8c14e23f7 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4a973077-5651-4363-a270-b46c02b7646b req-c55b880b-6132-417d-8f8f-e5f8c14e23f7 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-4a973077-5651-4363-a270-b46c02b7646b req-c55b880b-6132-417d-8f8f-e5f8c14e23f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-85a99727-150d-48a7-ba46-bce583a5353b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:05 user nova-compute[73091]: WARNING nova.compute.manager [req-4a973077-5651-4363-a270-b46c02b7646b req-c55b880b-6132-417d-8f8f-e5f8c14e23f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-85a99727-150d-48a7-ba46-bce583a5353b for instance with vm_state building and task_state spawning.
Aug 09 16:35:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-4a973077-5651-4363-a270-b46c02b7646b req-c55b880b-6132-417d-8f8f-e5f8c14e23f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-85a99727-150d-48a7-ba46-bce583a5353b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4a973077-5651-4363-a270-b46c02b7646b req-c55b880b-6132-417d-8f8f-e5f8c14e23f7 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4a973077-5651-4363-a270-b46c02b7646b req-c55b880b-6132-417d-8f8f-e5f8c14e23f7 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4a973077-5651-4363-a270-b46c02b7646b req-c55b880b-6132-417d-8f8f-e5f8c14e23f7 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-4a973077-5651-4363-a270-b46c02b7646b req-c55b880b-6132-417d-8f8f-e5f8c14e23f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-85a99727-150d-48a7-ba46-bce583a5353b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:05 user nova-compute[73091]: WARNING nova.compute.manager [req-4a973077-5651-4363-a270-b46c02b7646b req-c55b880b-6132-417d-8f8f-e5f8c14e23f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-85a99727-150d-48a7-ba46-bce583a5353b for instance with vm_state building and task_state spawning.
Aug 09 16:35:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-415c1381-e446-4743-8420-56093064c1cb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-415c1381-e446-4743-8420-56093064c1cb {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:06 user nova-compute[73091]: WARNING nova.compute.manager [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-415c1381-e446-4743-8420-56093064c1cb for instance with vm_state building and task_state spawning.
Aug 09 16:35:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-9274af2c-557c-4b06-a375-5006f4792f69 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-9274af2c-557c-4b06-a375-5006f4792f69 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:06 user nova-compute[73091]: WARNING nova.compute.manager [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-9274af2c-557c-4b06-a375-5006f4792f69 for instance with vm_state building and task_state spawning.
Aug 09 16:35:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-9274af2c-557c-4b06-a375-5006f4792f69 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-9274af2c-557c-4b06-a375-5006f4792f69 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:06 user nova-compute[73091]: WARNING nova.compute.manager [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-9274af2c-557c-4b06-a375-5006f4792f69 for instance with vm_state building and task_state spawning.
Aug 09 16:35:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-652f5030-2075-40f8-ab87-f86f5dbb6e75 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-652f5030-2075-40f8-ab87-f86f5dbb6e75 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:06 user nova-compute[73091]: WARNING nova.compute.manager [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-652f5030-2075-40f8-ab87-f86f5dbb6e75 for instance with vm_state building and task_state spawning.
Aug 09 16:35:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-652f5030-2075-40f8-ab87-f86f5dbb6e75 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-652f5030-2075-40f8-ab87-f86f5dbb6e75 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:06 user nova-compute[73091]: WARNING nova.compute.manager [req-16aa109f-281e-4ef2-9286-ff12a454285b req-03a174a3-6ce8-43e7-a068-fe5063a0a461 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-652f5030-2075-40f8-ab87-f86f5dbb6e75 for instance with vm_state building and task_state spawning.
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-8923b2e5-a819-4c25-9483-317443c00e4f req-739e9aed-071e-4ca2-acde-4096f5a02e4d service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-271512c1-1707-48da-84cf-978ab9e0d202 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8923b2e5-a819-4c25-9483-317443c00e4f req-739e9aed-071e-4ca2-acde-4096f5a02e4d service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8923b2e5-a819-4c25-9483-317443c00e4f req-739e9aed-071e-4ca2-acde-4096f5a02e4d service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8923b2e5-a819-4c25-9483-317443c00e4f req-739e9aed-071e-4ca2-acde-4096f5a02e4d service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-8923b2e5-a819-4c25-9483-317443c00e4f req-739e9aed-071e-4ca2-acde-4096f5a02e4d service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-271512c1-1707-48da-84cf-978ab9e0d202 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:06 user nova-compute[73091]: WARNING nova.compute.manager [req-8923b2e5-a819-4c25-9483-317443c00e4f req-739e9aed-071e-4ca2-acde-4096f5a02e4d service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-271512c1-1707-48da-84cf-978ab9e0d202 for instance with vm_state building and task_state spawning.
Aug 09 16:35:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-e8578ea5-3173-4ed7-9ef9-cad2fa3be863 req-ce461649-492f-4611-ae13-56bddd589cdf service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-9c7ee120-3c19-4ba4-8f87-de7384c64d7a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e8578ea5-3173-4ed7-9ef9-cad2fa3be863 req-ce461649-492f-4611-ae13-56bddd589cdf service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e8578ea5-3173-4ed7-9ef9-cad2fa3be863 req-ce461649-492f-4611-ae13-56bddd589cdf service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e8578ea5-3173-4ed7-9ef9-cad2fa3be863 req-ce461649-492f-4611-ae13-56bddd589cdf service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-e8578ea5-3173-4ed7-9ef9-cad2fa3be863 req-ce461649-492f-4611-ae13-56bddd589cdf service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-9c7ee120-3c19-4ba4-8f87-de7384c64d7a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:07 user nova-compute[73091]: WARNING nova.compute.manager [req-e8578ea5-3173-4ed7-9ef9-cad2fa3be863 req-ce461649-492f-4611-ae13-56bddd589cdf service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-9c7ee120-3c19-4ba4-8f87-de7384c64d7a for instance with vm_state building and task_state spawning.
Aug 09 16:35:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-e8578ea5-3173-4ed7-9ef9-cad2fa3be863 req-ce461649-492f-4611-ae13-56bddd589cdf service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-9c7ee120-3c19-4ba4-8f87-de7384c64d7a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e8578ea5-3173-4ed7-9ef9-cad2fa3be863 req-ce461649-492f-4611-ae13-56bddd589cdf service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e8578ea5-3173-4ed7-9ef9-cad2fa3be863 req-ce461649-492f-4611-ae13-56bddd589cdf service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e8578ea5-3173-4ed7-9ef9-cad2fa3be863 req-ce461649-492f-4611-ae13-56bddd589cdf service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-e8578ea5-3173-4ed7-9ef9-cad2fa3be863 req-ce461649-492f-4611-ae13-56bddd589cdf service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-9c7ee120-3c19-4ba4-8f87-de7384c64d7a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:07 user nova-compute[73091]: WARNING nova.compute.manager [req-e8578ea5-3173-4ed7-9ef9-cad2fa3be863 req-ce461649-492f-4611-ae13-56bddd589cdf service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-9c7ee120-3c19-4ba4-8f87-de7384c64d7a for instance with vm_state building and task_state spawning.
Aug 09 16:35:07 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598907.8538656, c4f1da39-1fb7-4551-8be0-10216ab423ea => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:35:07 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] VM Resumed (Lifecycle Event)
Aug 09 16:35:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:35:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Instance spawned successfully.
Aug 09 16:35:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:35:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:35:07 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:35:07 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598907.8547313, c4f1da39-1fb7-4551-8be0-10216ab423ea => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:35:07 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] VM Started (Lifecycle Event)
Aug 09 16:35:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:08 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:35:08 user nova-compute[73091]: INFO nova.compute.manager [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Took 11.41 seconds to spawn the instance on the hypervisor.
Aug 09 16:35:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:08 user nova-compute[73091]: INFO nova.compute.manager [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Took 42.28 seconds to build instance.
Aug 09 16:35:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0417d070-ff92-4fd3-8e80-9c01441bc1e7 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.394s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:09 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:35:09 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:35:09 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7295MB free_disk=25.599056243896484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:35:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-ba532419-0677-46cb-af85-68614b52c471 req-e2964196-dedb-4075-95b8-2bb832e18b70 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received event network-changed-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-ba532419-0677-46cb-af85-68614b52c471 req-e2964196-dedb-4075-95b8-2bb832e18b70 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Refreshing instance network info cache due to event network-changed-93308f09-a0e7-49b6-8b29-dc0999acbfc1. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:35:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ba532419-0677-46cb-af85-68614b52c471 req-e2964196-dedb-4075-95b8-2bb832e18b70 service nova] Acquiring lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:35:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ba532419-0677-46cb-af85-68614b52c471 req-e2964196-dedb-4075-95b8-2bb832e18b70 service nova] Acquired lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:35:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-ba532419-0677-46cb-af85-68614b52c471 req-e2964196-dedb-4075-95b8-2bb832e18b70 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Refreshing network info cache for port 93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:35:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:35:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance e4ec0db9-740e-4047-8cab-ac60a1681483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:35:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f3e2ea27-5fa4-4437-83d0-2eeda59506a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:35:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 7bcc1e42-532f-4fb6-984e-cdf659cfef7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:35:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance b791bded-3eb5-4bf8-a14e-eae269ae2043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:35:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance ec2187af-1b88-4c23-abba-2f09db3057d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:35:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:35:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 7e75e099-39c8-4cc4-b3dd-50c67e1b4857 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:35:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c4f1da39-1fb7-4551-8be0-10216ab423ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:35:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 9c8b5adc-d13f-4d9f-a878-e59dd52550c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:35:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 117928be-d7c7-4d40-a0ef-2a88c360cfec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:35:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:35:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:35:10 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:35:10 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:35:10 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:35:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.746s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:10 user nova-compute[73091]: DEBUG nova.network.neutron [req-ba532419-0677-46cb-af85-68614b52c471 req-e2964196-dedb-4075-95b8-2bb832e18b70 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Updated VIF entry in instance network info cache for port 93308f09-a0e7-49b6-8b29-dc0999acbfc1. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:35:10 user nova-compute[73091]: DEBUG nova.network.neutron [req-ba532419-0677-46cb-af85-68614b52c471 req-e2964196-dedb-4075-95b8-2bb832e18b70 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Updating instance_info_cache with network_info: [{"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:35:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ba532419-0677-46cb-af85-68614b52c471 req-e2964196-dedb-4075-95b8-2bb832e18b70 service nova] Releasing lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:35:11 user nova-compute[73091]: INFO nova.virt.block_device [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Booting with volume 7972dac2-c9ab-407d-95d9-977d6529d2c3 at /dev/vdc
Aug 09 16:35:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG os_brick.utils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a10f6f-746c-4049-89f2-d6febb0621f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4eb87fc-af40-4e88-8baf-f7637eef21cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ad3643-161d-4fb3-b4e9-2c729b639421]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe25c55a-06be-449d-8cfe-76d72ff90398]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:35:11 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cd8033-4698-40e7-886d-78ae4d394a6c]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG os_brick.utils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Updating existing volume attachment record: f70f0f3c-ac49-4708-b0f8-1ea57bfc09b8 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Acquiring lock "e4ec0db9-740e-4047-8cab-ac60a1681483" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "e4ec0db9-740e-4047-8cab-ac60a1681483" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG nova.objects.instance [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lazy-loading 'flavor' on Instance uuid e4ec0db9-740e-4047-8cab-ac60a1681483 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "e4ec0db9-740e-4047-8cab-ac60a1681483" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.124s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Acquiring lock "e4ec0db9-740e-4047-8cab-ac60a1681483" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "e4ec0db9-740e-4047-8cab-ac60a1681483" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:11 user nova-compute[73091]: INFO nova.compute.manager [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Attaching volume 83195218-7b4e-407a-a75d-65eb41470716 to /dev/vdb
Aug 09 16:35:11 user nova-compute[73091]: DEBUG os_brick.utils [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:35:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b3bc8a-4886-4bc5-afe0-9ae0c0813771]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5c4fbd-ae1d-4cc8-b5b1-43a36c95ce4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d60e83-1c39-447e-84f3-c169863eed4d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccfbf0d-6e3c-46be-8302-b2959adf6872]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:35:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:35:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:35:12 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:35:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b478f7-bfa6-4e98-8f5e-0c5136855706]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:35:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:35:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:35:12 user nova-compute[73091]: DEBUG os_brick.utils [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:35:12 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Updating existing volume attachment record: 274402a7-7e95-4a77-91e9-dfdb86d3a70f {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:35:13 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:35:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:15 user nova-compute[73091]: INFO nova.compute.manager [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Shelving
Aug 09 16:35:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-f44cb2c8-5610-4105-8bd5-ed6280e6e277 req-67ba4889-771b-47c8-925e-6c87e2f4f552 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received event network-vif-unplugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f44cb2c8-5610-4105-8bd5-ed6280e6e277 req-67ba4889-771b-47c8-925e-6c87e2f4f552 service nova] Acquiring lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f44cb2c8-5610-4105-8bd5-ed6280e6e277 req-67ba4889-771b-47c8-925e-6c87e2f4f552 service nova] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f44cb2c8-5610-4105-8bd5-ed6280e6e277 req-67ba4889-771b-47c8-925e-6c87e2f4f552 service nova] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-f44cb2c8-5610-4105-8bd5-ed6280e6e277 req-67ba4889-771b-47c8-925e-6c87e2f4f552 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] No waiting events found dispatching network-vif-unplugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:15 user nova-compute[73091]: WARNING nova.compute.manager [req-f44cb2c8-5610-4105-8bd5-ed6280e6e277 req-67ba4889-771b-47c8-925e-6c87e2f4f552 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received unexpected event network-vif-unplugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 for instance with vm_state active and task_state shelving.
Aug 09 16:35:15 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Instance destroyed successfully.
Aug 09 16:35:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Beginning cold snapshot process
Aug 09 16:35:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:16 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 16:35:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk /opt/stack/data/nova/instances/snapshots/tmpsfjzwdp1/1c4fab98477443f19ca84bf3e1b3b5e9 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk /opt/stack/data/nova/instances/snapshots/tmpsfjzwdp1/1c4fab98477443f19ca84bf3e1b3b5e9" returned: 0 in 1.004s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Snapshot extracted, beginning image upload
Aug 09 16:35:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-3c9cce85-c407-4037-99f7-f559cf154a13 req-10ba0e55-c7ea-429b-9f1b-66561d4de095 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received event network-vif-plugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3c9cce85-c407-4037-99f7-f559cf154a13 req-10ba0e55-c7ea-429b-9f1b-66561d4de095 service nova] Acquiring lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3c9cce85-c407-4037-99f7-f559cf154a13 req-10ba0e55-c7ea-429b-9f1b-66561d4de095 service nova] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3c9cce85-c407-4037-99f7-f559cf154a13 req-10ba0e55-c7ea-429b-9f1b-66561d4de095 service nova] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-3c9cce85-c407-4037-99f7-f559cf154a13 req-10ba0e55-c7ea-429b-9f1b-66561d4de095 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] No waiting events found dispatching network-vif-plugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:17 user nova-compute[73091]: WARNING nova.compute.manager [req-3c9cce85-c407-4037-99f7-f559cf154a13 req-10ba0e55-c7ea-429b-9f1b-66561d4de095 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received unexpected event network-vif-plugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 16:35:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Snapshot image upload complete
Aug 09 16:35:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:35:20 user nova-compute[73091]: INFO nova.compute.manager [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Shelve offloading
Aug 09 16:35:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Instance destroyed successfully.
Aug 09 16:35:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:35:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:35:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquired lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:35:20 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:35:20 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Updating instance_info_cache with network_info: [{"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:35:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Releasing lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:35:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:21 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Instance destroyed successfully.
Aug 09 16:35:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'resources' on Instance uuid f3e2ea27-5fa4-4437-83d0-2eeda59506a9 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:35:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1616872134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1616872134',id=3,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAITbZ0bekUUaQcD9JG/a45LmgmiGDqXNdBL8us/+D3kEuK3lX64SC3DS9c5RvpZzIppm7AwxfGpJ8le2Ng0oRqLADK98z9cmOu+DwcKkC/ohl31CHyQco0JJV2LY0z1qQ==',key_name='tempest-keypair-2075151971',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:33:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b8000a47d82748ce8d43d306682d62c6',ramdisk_id='',reservation_id='r-3yoej5re',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1451982310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1451982310-project-member',shelved_at='2023-08-09T16:35:20.021030',shelved_host='user',shelved_image_id='93cf5d37-48ec-4c45-afba-90bda5253287'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343ec5734ef547f292ee631dbb272359',uuid=f3e2ea27-5fa4-4437-83d0-2eeda59506a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:35:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converting VIF {"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:62:67,bridge_name='br-int',has_traffic_filtering=True,id=93308f09-a0e7-49b6-8b29-dc0999acbfc1,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93308f09-a0') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:21 user nova-compute[73091]: DEBUG os_vif [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:62:67,bridge_name='br-int',has_traffic_filtering=True,id=93308f09-a0e7-49b6-8b29-dc0999acbfc1,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93308f09-a0') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:35:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93308f09-a0, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:35:21 user nova-compute[73091]: INFO os_vif [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:62:67,bridge_name='br-int',has_traffic_filtering=True,id=93308f09-a0e7-49b6-8b29-dc0999acbfc1,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93308f09-a0')
Aug 09 16:35:21 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Deleting instance files /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9_del
Aug 09 16:35:21 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Deletion of /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9_del complete
Aug 09 16:35:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-ea5c784f-7ef1-4994-9285-6efb1b09907e req-48fbf665-ba7a-40d1-af81-66fbba9fefea service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received event network-changed-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-ea5c784f-7ef1-4994-9285-6efb1b09907e req-48fbf665-ba7a-40d1-af81-66fbba9fefea service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Refreshing instance network info cache due to event network-changed-93308f09-a0e7-49b6-8b29-dc0999acbfc1. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:35:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ea5c784f-7ef1-4994-9285-6efb1b09907e req-48fbf665-ba7a-40d1-af81-66fbba9fefea service nova] Acquiring lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:35:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ea5c784f-7ef1-4994-9285-6efb1b09907e req-48fbf665-ba7a-40d1-af81-66fbba9fefea service nova] Acquired lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:35:21 user nova-compute[73091]: DEBUG nova.network.neutron [req-ea5c784f-7ef1-4994-9285-6efb1b09907e req-48fbf665-ba7a-40d1-af81-66fbba9fefea service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Refreshing network info cache for port 93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:35:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73091) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 09 16:35:21 user nova-compute[73091]: INFO nova.virt.libvirt.host [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] UEFI support detected
Aug 09 16:35:21 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Deleted allocations for instance f3e2ea27-5fa4-4437-83d0-2eeda59506a9
Aug 09 16:35:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'numa_topology' on Instance uuid f3e2ea27-5fa4-4437-83d0-2eeda59506a9 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.network.neutron [req-ea5c784f-7ef1-4994-9285-6efb1b09907e req-48fbf665-ba7a-40d1-af81-66fbba9fefea service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Updated VIF entry in instance network info cache for port 93308f09-a0e7-49b6-8b29-dc0999acbfc1. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.network.neutron [req-ea5c784f-7ef1-4994-9285-6efb1b09907e req-48fbf665-ba7a-40d1-af81-66fbba9fefea service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Updating instance_info_cache with network_info: [{"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap93308f09-a0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.469s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ea5c784f-7ef1-4994-9285-6efb1b09907e req-48fbf665-ba7a-40d1-af81-66fbba9fefea service nova] Releasing lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:35:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Creating image(s)
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Ensure instance console log exists: /opt/stack/data/nova/instances/9c8b5adc-d13f-4d9f-a878-e59dd52550c3/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Start _get_guest_xml network_info=[{"id": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "address": "fa:16:3e:30:e8:27", "network": {"id": "41f77be1-0754-463b-a14d-b199368ae881", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-32585978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9e1fe5-ad", "ovs_interfaceid": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "address": "fa:16:3e:a0:6f:69", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eac408-ec", "ovs_interfaceid": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "address": "fa:16:3e:db:ca:02", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847e88af-f8", "ovs_interfaceid": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f37bd5d-1587-4aad-9da4-892334eadaad", "address": "fa:16:3e:79:2d:22", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f37bd5d-15", "ovs_interfaceid": "9f37bd5d-1587-4aad-9da4-892334eadaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "address": "fa:16:3e:05:45:18", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f12e06-60", "ovs_interfaceid": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc6e7056-4650-4973-be22-b1d98c14149f", "address": "fa:16:3e:af:95:d3", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc6e7056-46", "ovs_interfaceid": "dc6e7056-4650-4973-be22-b1d98c14149f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1128f26c-215d-4940-8772-886149c34785", "address": "fa:16:3e:18:47:aa", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1128f26c-21", "ovs_interfaceid": "1128f26c-215d-4940-8772-886149c34785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'ab84f9c4-4fe8-49a2-8fd4-3dd4fb6ca8ba', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StgOlzQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9c8b5adc-d13f-4d9f-a878-e59dd52550c3', 'attached_at': '', 'detached_at': '', 'volume_id': '6bcd953f-ccea-4ad0-8470-2afa38d7e172', 'serial': '6bcd953f-ccea-4ad0-8470-2afa38d7e172'}, 'mount_device': '/dev/vda', 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '4817fc85-94d4-446a-aa0a-33ea96634ff7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GajpxueF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9c8b5adc-d13f-4d9f-a878-e59dd52550c3', 'attached_at': '', 'detached_at': '', 'volume_id': '261a4d27-c0c4-4c3f-95d5-bd82c38f07b5', 'serial': '261a4d27-c0c4-4c3f-95d5-bd82c38f07b5'}, 'mount_device': '/dev/vdb', 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'f70f0f3c-ac49-4708-b0f8-1ea57bfc09b8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmqYCQVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9c8b5adc-d13f-4d9f-a878-e59dd52550c3', 'attached_at': '', 'detached_at': '', 'volume_id': '7972dac2-c9ab-407d-95d9-977d6529d2c3', 'serial': '7972dac2-c9ab-407d-95d9-977d6529d2c3'}, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ea745338-c3d4-4893-a310-62d9aa136f63 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.418s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:22 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:35:22 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StgOlzQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:35:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:35:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:35:22 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[318f9607-7d71-4014-9fa1-5af263619fb1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:35:22 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4105ef-bdc1-470f-80ba-1e742f63acb7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172] added
Aug 09 16:35:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a715da-8833-48d5-8672-900fcd638f36]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[197c8834-5bed-41ab-910c-b47ae7c7d85e]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v StgOlzQb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v StgOlzQb" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[65356c6b-cb03-45d6-a86b-45f684a6bc4f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'StgOlzQb'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0e4b73-3fe1-4f80-8ed3-1090fd197c2a]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ce3952-7d8a-46aa-bc58-d785bea1325d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:22 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:22 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:22 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:22 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJqGsVIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:35:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f589a5-6e6d-4361-8856-ff9f1a579c71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172, portal: 172.16.0.220,3260]
Aug 09 16:35:22 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172, portal: 172.16.0.220,3260] successful.
Aug 09 16:35:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d33a8d-8083-4e73-904a-64f6791d8a4f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2fea69-a7f3-4029-bd79-b0ffb14bf539]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:22 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:22 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:22 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:22 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:22 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:22 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5126e1c-f56a-4ae0-a3ba-afba4694cbbe]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StgOlzQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23734316264383534', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734316264383534', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.140s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:35:23 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:35:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:35:23 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:35:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a956bd94-4883-453b-9f7a-e19195d5ce25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:35:23 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GajpxueF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:35:23 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:35:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8df77f9-33ed-444f-8f8d-4217fc3b899b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716] added
Aug 09 16:35:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70c9786-c9d2-4de7-861f-613a8690d73b]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b09af9d-8607-411f-91f2-c517c9cddebe]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJqGsVIP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJqGsVIP" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fdb90a-5957-44f1-87ac-2f802b84812a]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZJqGsVIP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a9fae4-5fed-46f4-8e07-6b3d2607e9dc]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07524ce-b61a-42c0-8ba5-a604ab9eea2e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:24 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:24 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:24 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:24 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:24 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:24 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:24 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:24 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[384e4c30-cf44-4cf3-9f9c-db2c2bc1802f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716, portal: 172.16.0.220,3260]
Aug 09 16:35:24 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716, portal: 172.16.0.220,3260] successful.
Aug 09 16:35:24 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4923f76-c057-4499-acb0-0089d20af7fe]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e0d56b-e89d-4154-91f5-825584c969ac]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:24 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:24 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:24 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:24 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 (non-flash)
Aug 09 16:35:24 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:24 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:24 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:24 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:24 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 (non-flash)
Aug 09 16:35:24 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c3d254-a73c-43da-833f-524fd419d19c]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJqGsVIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:35:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] <== connect_volume: return (2472ms) {'type': 'block', 'scsi_wwn': '23865663838663265', 'path': '/dev/sdf'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865663838663265', 'path': '/dev/sdf'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.304s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:35:25 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:35:25 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG nova.objects.instance [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lazy-loading 'flavor' on Instance uuid e4ec0db9-740e-4047-8cab-ac60a1681483 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[13000a85-40bf-44f1-9be8-5334516e0447]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:35:25 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a48720-4ac6-4ab2-8ef4-17d9d177b44a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5] added
Aug 09 16:35:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:35:25 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:35:25 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 09 16:35:25 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:35:25 user nova-compute[73091]:   <serial>83195218-7b4e-407a-a75d-65eb41470716</serial>
Aug 09 16:35:25 user nova-compute[73091]: </disk>
Aug 09 16:35:25 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f971c7-0a7e-4f90-8f13-4bcb8f619231]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6572f4ba-a4dc-4d36-9cb5-877610592c34]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GajpxueF {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GajpxueF" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7409cc9b-3d91-47f8-b25d-bdd9164b2a9a]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GajpxueF'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3ebaf0-2ae0-496c-80ff-817256ab3294]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a071f6ce-3290-4ce0-830c-24dc8d92c39a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:25 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:25 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:25 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:25 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 (non-flash)
Aug 09 16:35:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:25 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:25 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:25 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:25 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 (non-flash)
Aug 09 16:35:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.209s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29bf77a-0b74-4809-9bff-c68f3b262d6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5, portal: 172.16.0.220,3260]
Aug 09 16:35:25 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5, portal: 172.16.0.220,3260] successful.
Aug 09 16:35:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b773d48-9042-4678-86df-b3602516a52c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3ad4fe-696a-411b-98a0-43c741b0748d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:25 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:25 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:25 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:25 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 (non-flash)
Aug 09 16:35:25 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:25 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:25 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:25 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:25 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 (non-flash)
Aug 09 16:35:25 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.456s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.126s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb60cf0-f5fc-49af-b0e3-57d6eb1d2d43]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:35:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] No VIF found with MAC fa:16:3e:34:44:1f, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-93597a39-e297-4601-8f18-5be47813bd85 tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "e4ec0db9-740e-4047-8cab-ac60a1681483" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.162s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Acquiring lock "e4ec0db9-740e-4047-8cab-ac60a1681483" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "e4ec0db9-740e-4047-8cab-ac60a1681483" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Acquiring lock "e4ec0db9-740e-4047-8cab-ac60a1681483-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "e4ec0db9-740e-4047-8cab-ac60a1681483-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "e4ec0db9-740e-4047-8cab-ac60a1681483-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:26 user nova-compute[73091]: INFO nova.compute.manager [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Terminating instance
Aug 09 16:35:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GajpxueF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.594s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] <== connect_volume: return (2899ms) {'type': 'block', 'scsi_wwn': '26265313239333530', 'path': '/dev/sdg'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265313239333530', 'path': '/dev/sdg'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmqYCQVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:35:26 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:35:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:35:26 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:35:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:35:26 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:35:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8de044d-897d-4e7c-aa97-71e0ba2a13e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:35:26 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3c8887-6554-4b60-a8ea-e98d33e3a8ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3] added
Aug 09 16:35:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[77285a03-cb7f-4705-88ea-f73164fbacfe]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56a605b-4030-40d8-b1ba-b1472331d45b]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vmqYCQVi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vmqYCQVi" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7342f6-386c-4d99-8c2e-f4ac47976fd8]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vmqYCQVi'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84772b0-d409-4be2-b2fd-2d69def9a5fe]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d143e9b7-c4bf-4dc6-8957-314e38bd29f3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-a03a81cd-a698-4778-8d51-a9e95770705f req-b05a7fbc-fec7-4eda-ad5d-f142520bd65f service nova] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Received event network-vif-unplugged-0e3f420c-de38-4d22-a167-fdca07babd17 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a03a81cd-a698-4778-8d51-a9e95770705f req-b05a7fbc-fec7-4eda-ad5d-f142520bd65f service nova] Acquiring lock "e4ec0db9-740e-4047-8cab-ac60a1681483-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a03a81cd-a698-4778-8d51-a9e95770705f req-b05a7fbc-fec7-4eda-ad5d-f142520bd65f service nova] Lock "e4ec0db9-740e-4047-8cab-ac60a1681483-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a03a81cd-a698-4778-8d51-a9e95770705f req-b05a7fbc-fec7-4eda-ad5d-f142520bd65f service nova] Lock "e4ec0db9-740e-4047-8cab-ac60a1681483-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-a03a81cd-a698-4778-8d51-a9e95770705f req-b05a7fbc-fec7-4eda-ad5d-f142520bd65f service nova] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] No waiting events found dispatching network-vif-unplugged-0e3f420c-de38-4d22-a167-fdca07babd17 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-a03a81cd-a698-4778-8d51-a9e95770705f req-b05a7fbc-fec7-4eda-ad5d-f142520bd65f service nova] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Received event network-vif-unplugged-0e3f420c-de38-4d22-a167-fdca07babd17 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f673409-1c14-4f69-839c-c031bd30ac89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3, portal: 172.16.0.220,3260]
Aug 09 16:35:27 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3, portal: 172.16.0.220,3260] successful.
Aug 09 16:35:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e76a34-cd2b-4796-a907-510292934100]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61b0006-83bf-4ed2-b989-c62e1f9d199f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0599b29f-cdb3-4a3f-863f-4113b774363d]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmqYCQVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:35:27 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Instance destroyed successfully.
Aug 09 16:35:27 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lazy-loading 'resources' on Instance uuid e4ec0db9-740e-4047-8cab-ac60a1681483 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:33:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1840367609',display_name='tempest-DeleteServersTestJSON-server-1840367609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1840367609',id=2,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:33:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a17cf3e438de4946aeaa9899d1fcc865',ramdisk_id='',reservation_id='r-0r9mjncr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1124556085',owner_user_name='tempest-DeleteServersTestJSON-1124556085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:33:22Z,user_data=None,user_id='414e511356854600889f4ee30f925eaf',uuid=e4ec0db9-740e-4047-8cab-ac60a1681483,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e3f420c-de38-4d22-a167-fdca07babd17", "address": "fa:16:3e:34:44:1f", "network": {"id": "e19cb2bb-1445-4ff3-babe-23d0e2c23362", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2077372665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a17cf3e438de4946aeaa9899d1fcc865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3f420c-de", "ovs_interfaceid": "0e3f420c-de38-4d22-a167-fdca07babd17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Converting VIF {"id": "0e3f420c-de38-4d22-a167-fdca07babd17", "address": "fa:16:3e:34:44:1f", "network": {"id": "e19cb2bb-1445-4ff3-babe-23d0e2c23362", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2077372665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a17cf3e438de4946aeaa9899d1fcc865", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e3f420c-de", "ovs_interfaceid": "0e3f420c-de38-4d22-a167-fdca07babd17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:44:1f,bridge_name='br-int',has_traffic_filtering=True,id=0e3f420c-de38-4d22-a167-fdca07babd17,network=Network(e19cb2bb-1445-4ff3-babe-23d0e2c23362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e3f420c-de') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG os_vif [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:44:1f,bridge_name='br-int',has_traffic_filtering=True,id=0e3f420c-de38-4d22-a167-fdca07babd17,network=Network(e19cb2bb-1445-4ff3-babe-23d0e2c23362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e3f420c-de') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e3f420c-de, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:35:27 user nova-compute[73091]: INFO os_vif [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:44:1f,bridge_name='br-int',has_traffic_filtering=True,id=0e3f420c-de38-4d22-a167-fdca07babd17,network=Network(e19cb2bb-1445-4ff3-babe-23d0e2c23362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e3f420c-de')
Aug 09 16:35:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:35:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJqGsVIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:35:27 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:35:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '26430353534343739', 'path': '/dev/sdh'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430353534343739', 'path': '/dev/sdh'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.597s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[277dfcac-e4c6-4775-9292-ed279b8e1c22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "address": "fa:16:3e:30:e8:27", "network": {"id": "41f77be1-0754-463b-a14d-b199368ae881", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-32585978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9e1fe5-ad", "ovs_interfaceid": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "address": "fa:16:3e:30:e8:27", "network": {"id": "41f77be1-0754-463b-a14d-b199368ae881", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-32585978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9e1fe5-ad", "ovs_interfaceid": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:e8:27,bridge_name='br-int',has_traffic_filtering=True,id=7f9e1fe5-ad99-4c58-9181-0caeb7675dab,network=Network(41f77be1-0754-463b-a14d-b199368ae881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9e1fe5-ad') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "address": "fa:16:3e:a0:6f:69", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eac408-ec", "ovs_interfaceid": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "address": "fa:16:3e:a0:6f:69", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eac408-ec", "ovs_interfaceid": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6f:69,bridge_name='br-int',has_traffic_filtering=True,id=f3eac408-ecc9-4f3f-a64d-4364c91bf697,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3eac408-ec') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "address": "fa:16:3e:db:ca:02", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847e88af-f8", "ovs_interfaceid": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "address": "fa:16:3e:db:ca:02", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847e88af-f8", "ovs_interfaceid": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:ca:02,bridge_name='br-int',has_traffic_filtering=True,id=847e88af-f82a-4a2d-aa96-7e3dd512e055,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap847e88af-f8') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f37bd5d-1587-4aad-9da4-892334eadaad", "address": "fa:16:3e:79:2d:22", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f37bd5d-15", "ovs_interfaceid": "9f37bd5d-1587-4aad-9da4-892334eadaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "9f37bd5d-1587-4aad-9da4-892334eadaad", "address": "fa:16:3e:79:2d:22", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f37bd5d-15", "ovs_interfaceid": "9f37bd5d-1587-4aad-9da4-892334eadaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:2d:22,bridge_name='br-int',has_traffic_filtering=True,id=9f37bd5d-1587-4aad-9da4-892334eadaad,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f37bd5d-15') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "address": "fa:16:3e:05:45:18", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f12e06-60", "ovs_interfaceid": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "address": "fa:16:3e:05:45:18", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f12e06-60", "ovs_interfaceid": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:45:18,bridge_name='br-int',has_traffic_filtering=True,id=09f12e06-60f3-4e4d-b8c0-929fb56b0afd,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f12e06-60') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc6e7056-4650-4973-be22-b1d98c14149f", "address": "fa:16:3e:af:95:d3", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc6e7056-46", "ovs_interfaceid": "dc6e7056-4650-4973-be22-b1d98c14149f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "dc6e7056-4650-4973-be22-b1d98c14149f", "address": "fa:16:3e:af:95:d3", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc6e7056-46", "ovs_interfaceid": "dc6e7056-4650-4973-be22-b1d98c14149f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=dc6e7056-4650-4973-be22-b1d98c14149f,network=Network(6acf27ea-51af-4bf4-824d-86b1ae394d4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc6e7056-46') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1128f26c-215d-4940-8772-886149c34785", "address": "fa:16:3e:18:47:aa", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1128f26c-21", "ovs_interfaceid": "1128f26c-215d-4940-8772-886149c34785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "1128f26c-215d-4940-8772-886149c34785", "address": "fa:16:3e:18:47:aa", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1128f26c-21", "ovs_interfaceid": "1128f26c-215d-4940-8772-886149c34785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:47:aa,bridge_name='br-int',has_traffic_filtering=True,id=1128f26c-215d-4940-8772-886149c34785,network=Network(6acf27ea-51af-4bf4-824d-86b1ae394d4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1128f26c-21') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.objects.instance [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c8b5adc-d13f-4d9f-a878-e59dd52550c3 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf83038-5e30-43de-b2db-c264272d9b85]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:28 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:28 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:28 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:28 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 (non-flash)
Aug 09 16:35:28 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:28 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:28 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:28 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:28 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:28 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 (non-flash)
Aug 09 16:35:28 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:28 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0802ef250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716'): ({'sdf'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Removing single pathed devices sdf {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:35:28 user nova-compute[73091]:   <uuid>9c8b5adc-d13f-4d9f-a878-e59dd52550c3</uuid>
Aug 09 16:35:28 user nova-compute[73091]:   <name>instance-0000000a</name>
Aug 09 16:35:28 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:35:28 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:35:28 user nova-compute[73091]:   <metadata>
Aug 09 16:35:28 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:35:28 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:35:28 user nova-compute[73091]:       <nova:name>tempest-device-tagging-server-1985190096</nova:name>
Aug 09 16:35:28 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:35:22</nova:creationTime>
Aug 09 16:35:28 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:35:28 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:35:28 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:35:28 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:35:28 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:35:28 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:35:28 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:35:28 user nova-compute[73091]:       <nova:owner>
Aug 09 16:35:28 user nova-compute[73091]:         <nova:user uuid="ed205e5075de4f48b629121cc0cce798">tempest-TaggedBootDevicesTest_v242-297450497-project-member</nova:user>
Aug 09 16:35:28 user nova-compute[73091]:         <nova:project uuid="19a0681774fe4557921515e98144b9d1">tempest-TaggedBootDevicesTest_v242-297450497</nova:project>
Aug 09 16:35:28 user nova-compute[73091]:       </nova:owner>
Aug 09 16:35:28 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:35:28 user nova-compute[73091]:       <nova:ports>
Aug 09 16:35:28 user nova-compute[73091]:         <nova:port uuid="7f9e1fe5-ad99-4c58-9181-0caeb7675dab">
Aug 09 16:35:28 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 16:35:28 user nova-compute[73091]:         </nova:port>
Aug 09 16:35:28 user nova-compute[73091]:         <nova:port uuid="f3eac408-ecc9-4f3f-a64d-4364c91bf697">
Aug 09 16:35:28 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.77" ipVersion="4"/>
Aug 09 16:35:28 user nova-compute[73091]:         </nova:port>
Aug 09 16:35:28 user nova-compute[73091]:         <nova:port uuid="847e88af-f82a-4a2d-aa96-7e3dd512e055">
Aug 09 16:35:28 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.15" ipVersion="4"/>
Aug 09 16:35:28 user nova-compute[73091]:         </nova:port>
Aug 09 16:35:28 user nova-compute[73091]:         <nova:port uuid="9f37bd5d-1587-4aad-9da4-892334eadaad">
Aug 09 16:35:28 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.252" ipVersion="4"/>
Aug 09 16:35:28 user nova-compute[73091]:         </nova:port>
Aug 09 16:35:28 user nova-compute[73091]:         <nova:port uuid="09f12e06-60f3-4e4d-b8c0-929fb56b0afd">
Aug 09 16:35:28 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.43" ipVersion="4"/>
Aug 09 16:35:28 user nova-compute[73091]:         </nova:port>
Aug 09 16:35:28 user nova-compute[73091]:         <nova:port uuid="dc6e7056-4650-4973-be22-b1d98c14149f">
Aug 09 16:35:28 user nova-compute[73091]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 09 16:35:28 user nova-compute[73091]:         </nova:port>
Aug 09 16:35:28 user nova-compute[73091]:         <nova:port uuid="1128f26c-215d-4940-8772-886149c34785">
Aug 09 16:35:28 user nova-compute[73091]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 09 16:35:28 user nova-compute[73091]:         </nova:port>
Aug 09 16:35:28 user nova-compute[73091]:       </nova:ports>
Aug 09 16:35:28 user nova-compute[73091]:     </nova:instance>
Aug 09 16:35:28 user nova-compute[73091]:   </metadata>
Aug 09 16:35:28 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:35:28 user nova-compute[73091]:     <system>
Aug 09 16:35:28 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:35:28 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:35:28 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:35:28 user nova-compute[73091]:       <entry name="serial">9c8b5adc-d13f-4d9f-a878-e59dd52550c3</entry>
Aug 09 16:35:28 user nova-compute[73091]:       <entry name="uuid">9c8b5adc-d13f-4d9f-a878-e59dd52550c3</entry>
Aug 09 16:35:28 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:35:28 user nova-compute[73091]:     </system>
Aug 09 16:35:28 user nova-compute[73091]:   </sysinfo>
Aug 09 16:35:28 user nova-compute[73091]:   <os>
Aug 09 16:35:28 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:35:28 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:35:28 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:35:28 user nova-compute[73091]:   </os>
Aug 09 16:35:28 user nova-compute[73091]:   <features>
Aug 09 16:35:28 user nova-compute[73091]:     <acpi/>
Aug 09 16:35:28 user nova-compute[73091]:     <apic/>
Aug 09 16:35:28 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:35:28 user nova-compute[73091]:   </features>
Aug 09 16:35:28 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:35:28 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:35:28 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:35:28 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:35:28 user nova-compute[73091]:   </clock>
Aug 09 16:35:28 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:35:28 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:35:28 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:35:28 user nova-compute[73091]:   </cpu>
Aug 09 16:35:28 user nova-compute[73091]:   <devices>
Aug 09 16:35:28 user nova-compute[73091]:     <disk type="file" device="cdrom">
Aug 09 16:35:28 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 16:35:28 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/9c8b5adc-d13f-4d9f-a878-e59dd52550c3/disk.config"/>
Aug 09 16:35:28 user nova-compute[73091]:       <target dev="hda" bus="ide"/>
Aug 09 16:35:28 user nova-compute[73091]:     </disk>
Aug 09 16:35:28 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:35:28 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:35:28 user nova-compute[73091]:       <source dev="/dev/sde"/>
Aug 09 16:35:28 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:35:28 user nova-compute[73091]:       <serial>6bcd953f-ccea-4ad0-8470-2afa38d7e172</serial>
Aug 09 16:35:28 user nova-compute[73091]:     </disk>
Aug 09 16:35:28 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:35:28 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:35:28 user nova-compute[73091]:       <source dev="/dev/sdg"/>
Aug 09 16:35:28 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 09 16:35:28 user nova-compute[73091]:       <serial>261a4d27-c0c4-4c3f-95d5-bd82c38f07b5</serial>
Aug 09 16:35:28 user nova-compute[73091]:     </disk>
Aug 09 16:35:28 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:35:28 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:35:28 user nova-compute[73091]:       <source dev="/dev/sdh"/>
Aug 09 16:35:28 user nova-compute[73091]:       <target dev="vdc" bus="virtio"/>
Aug 09 16:35:28 user nova-compute[73091]:       <serial>7972dac2-c9ab-407d-95d9-977d6529d2c3</serial>
Aug 09 16:35:28 user nova-compute[73091]:     </disk>
Aug 09 16:35:28 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:35:28 user nova-compute[73091]:       <mac address="fa:16:3e:30:e8:27"/>
Aug 09 16:35:28 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:35:28 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:35:28 user nova-compute[73091]:       <target dev="tap7f9e1fe5-ad"/>
Aug 09 16:35:28 user nova-compute[73091]:     </interface>
Aug 09 16:35:28 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:35:28 user nova-compute[73091]:       <mac address="fa:16:3e:a0:6f:69"/>
Aug 09 16:35:28 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:35:28 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:35:28 user nova-compute[73091]:       <target dev="tapf3eac408-ec"/>
Aug 09 16:35:28 user nova-compute[73091]:     </interface>
Aug 09 16:35:28 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:35:28 user nova-compute[73091]:       <mac address="fa:16:3e:db:ca:02"/>
Aug 09 16:35:28 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:35:28 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:35:28 user nova-compute[73091]:       <target dev="tap847e88af-f8"/>
Aug 09 16:35:28 user nova-compute[73091]:     </interface>
Aug 09 16:35:28 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:35:28 user nova-compute[73091]:       <mac address="fa:16:3e:79:2d:22"/>
Aug 09 16:35:28 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:35:28 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:35:28 user nova-compute[73091]:       <target dev="tap9f37bd5d-15"/>
Aug 09 16:35:28 user nova-compute[73091]:     </interface>
Aug 09 16:35:28 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:35:28 user nova-compute[73091]:       <mac address="fa:16:3e:05:45:18"/>
Aug 09 16:35:28 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:35:28 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:35:28 user nova-compute[73091]:       <target dev="tap09f12e06-60"/>
Aug 09 16:35:28 user nova-compute[73091]:     </interface>
Aug 09 16:35:28 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:35:28 user nova-compute[73091]:       <mac address="fa:16:3e:af:95:d3"/>
Aug 09 16:35:28 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:35:28 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:35:28 user nova-compute[73091]:       <target dev="tapdc6e7056-46"/>
Aug 09 16:35:28 user nova-compute[73091]:     </interface>
Aug 09 16:35:28 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:35:28 user nova-compute[73091]:       <mac address="fa:16:3e:18:47:aa"/>
Aug 09 16:35:28 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:35:28 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:35:28 user nova-compute[73091]:       <target dev="tap1128f26c-21"/>
Aug 09 16:35:28 user nova-compute[73091]:     </interface>
Aug 09 16:35:28 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:35:28 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/9c8b5adc-d13f-4d9f-a878-e59dd52550c3/console.log" append="off"/>
Aug 09 16:35:28 user nova-compute[73091]:     </serial>
Aug 09 16:35:28 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:35:28 user nova-compute[73091]:     <video>
Aug 09 16:35:28 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:35:28 user nova-compute[73091]:     </video>
Aug 09 16:35:28 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:35:28 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:35:28 user nova-compute[73091]:     </rng>
Aug 09 16:35:28 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:35:28 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:35:28 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:35:28 user nova-compute[73091]:     </memballoon>
Aug 09 16:35:28 user nova-compute[73091]:   </devices>
Aug 09 16:35:28 user nova-compute[73091]: </domain>
Aug 09 16:35:28 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "address": "fa:16:3e:30:e8:27", "network": {"id": "41f77be1-0754-463b-a14d-b199368ae881", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-32585978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9e1fe5-ad", "ovs_interfaceid": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "address": "fa:16:3e:30:e8:27", "network": {"id": "41f77be1-0754-463b-a14d-b199368ae881", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-32585978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9e1fe5-ad", "ovs_interfaceid": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:e8:27,bridge_name='br-int',has_traffic_filtering=True,id=7f9e1fe5-ad99-4c58-9181-0caeb7675dab,network=Network(41f77be1-0754-463b-a14d-b199368ae881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9e1fe5-ad') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:e8:27,bridge_name='br-int',has_traffic_filtering=True,id=7f9e1fe5-ad99-4c58-9181-0caeb7675dab,network=Network(41f77be1-0754-463b-a14d-b199368ae881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9e1fe5-ad') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f9e1fe5-ad, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f9e1fe5-ad, col_values=(('external_ids', {'iface-id': '7f9e1fe5-ad99-4c58-9181-0caeb7675dab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:e8:27', 'vm-uuid': '9c8b5adc-d13f-4d9f-a878-e59dd52550c3'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aedfe52-f043-4b2e-818d-ec065b055fe9]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: INFO os_vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:e8:27,bridge_name='br-int',has_traffic_filtering=True,id=7f9e1fe5-ad99-4c58-9181-0caeb7675dab,network=Network(41f77be1-0754-463b-a14d-b199368ae881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9e1fe5-ad')
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "address": "fa:16:3e:a0:6f:69", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eac408-ec", "ovs_interfaceid": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "address": "fa:16:3e:a0:6f:69", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eac408-ec", "ovs_interfaceid": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6f:69,bridge_name='br-int',has_traffic_filtering=True,id=f3eac408-ecc9-4f3f-a64d-4364c91bf697,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3eac408-ec') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6f:69,bridge_name='br-int',has_traffic_filtering=True,id=f3eac408-ecc9-4f3f-a64d-4364c91bf697,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3eac408-ec') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3eac408-ec, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3eac408-ec, col_values=(('external_ids', {'iface-id': 'f3eac408-ecc9-4f3f-a64d-4364c91bf697', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:6f:69', 'vm-uuid': '9c8b5adc-d13f-4d9f-a878-e59dd52550c3'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fbf819-1779-4a6d-a434-76edfd748397]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Flushing IO for device /dev/sdf {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: INFO os_vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6f:69,bridge_name='br-int',has_traffic_filtering=True,id=f3eac408-ecc9-4f3f-a64d-4364c91bf697,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3eac408-ec')
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "address": "fa:16:3e:db:ca:02", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847e88af-f8", "ovs_interfaceid": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "address": "fa:16:3e:db:ca:02", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847e88af-f8", "ovs_interfaceid": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:ca:02,bridge_name='br-int',has_traffic_filtering=True,id=847e88af-f82a-4a2d-aa96-7e3dd512e055,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap847e88af-f8') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:ca:02,bridge_name='br-int',has_traffic_filtering=True,id=847e88af-f82a-4a2d-aa96-7e3dd512e055,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap847e88af-f8') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6786a4-c79e-4e62-bd1c-1ae07335f6e3]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap847e88af-f8, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap847e88af-f8, col_values=(('external_ids', {'iface-id': '847e88af-f82a-4a2d-aa96-7e3dd512e055', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:ca:02', 'vm-uuid': '9c8b5adc-d13f-4d9f-a878-e59dd52550c3'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: INFO os_vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:ca:02,bridge_name='br-int',has_traffic_filtering=True,id=847e88af-f82a-4a2d-aa96-7e3dd512e055,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap847e88af-f8')
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f37bd5d-1587-4aad-9da4-892334eadaad", "address": "fa:16:3e:79:2d:22", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f37bd5d-15", "ovs_interfaceid": "9f37bd5d-1587-4aad-9da4-892334eadaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "9f37bd5d-1587-4aad-9da4-892334eadaad", "address": "fa:16:3e:79:2d:22", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f37bd5d-15", "ovs_interfaceid": "9f37bd5d-1587-4aad-9da4-892334eadaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:2d:22,bridge_name='br-int',has_traffic_filtering=True,id=9f37bd5d-1587-4aad-9da4-892334eadaad,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f37bd5d-15') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:2d:22,bridge_name='br-int',has_traffic_filtering=True,id=9f37bd5d-1587-4aad-9da4-892334eadaad,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f37bd5d-15') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f37bd5d-15, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f37bd5d-15, col_values=(('external_ids', {'iface-id': '9f37bd5d-1587-4aad-9da4-892334eadaad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:2d:22', 'vm-uuid': '9c8b5adc-d13f-4d9f-a878-e59dd52550c3'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d242b54-6144-44d8-a0b7-00a3cb569dfe]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c010c4-a222-400b-9432-2a7f41f1e30e]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: INFO os_vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:2d:22,bridge_name='br-int',has_traffic_filtering=True,id=9f37bd5d-1587-4aad-9da4-892334eadaad,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f37bd5d-15')
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "address": "fa:16:3e:05:45:18", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f12e06-60", "ovs_interfaceid": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "address": "fa:16:3e:05:45:18", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f12e06-60", "ovs_interfaceid": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:45:18,bridge_name='br-int',has_traffic_filtering=True,id=09f12e06-60f3-4e4d-b8c0-929fb56b0afd,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f12e06-60') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:45:18,bridge_name='br-int',has_traffic_filtering=True,id=09f12e06-60f3-4e4d-b8c0-929fb56b0afd,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f12e06-60') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09f12e06-60, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09f12e06-60, col_values=(('external_ids', {'iface-id': '09f12e06-60f3-4e4d-b8c0-929fb56b0afd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:45:18', 'vm-uuid': '9c8b5adc-d13f-4d9f-a878-e59dd52550c3'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7898c9de-169f-4099-835e-65a62bd648e9]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716, portal: 172.16.0.220,3260]
Aug 09 16:35:28 user nova-compute[73091]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716, portal: 172.16.0.220,3260] successful.
Aug 09 16:35:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: INFO os_vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:45:18,bridge_name='br-int',has_traffic_filtering=True,id=09f12e06-60f3-4e4d-b8c0-929fb56b0afd,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f12e06-60')
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc6e7056-4650-4973-be22-b1d98c14149f", "address": "fa:16:3e:af:95:d3", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc6e7056-46", "ovs_interfaceid": "dc6e7056-4650-4973-be22-b1d98c14149f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "dc6e7056-4650-4973-be22-b1d98c14149f", "address": "fa:16:3e:af:95:d3", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc6e7056-46", "ovs_interfaceid": "dc6e7056-4650-4973-be22-b1d98c14149f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=dc6e7056-4650-4973-be22-b1d98c14149f,network=Network(6acf27ea-51af-4bf4-824d-86b1ae394d4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc6e7056-46') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=dc6e7056-4650-4973-be22-b1d98c14149f,network=Network(6acf27ea-51af-4bf4-824d-86b1ae394d4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc6e7056-46') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc6e7056-46, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc6e7056-46, col_values=(('external_ids', {'iface-id': 'dc6e7056-4650-4973-be22-b1d98c14149f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:95:d3', 'vm-uuid': '9c8b5adc-d13f-4d9f-a878-e59dd52550c3'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83195218-7b4e-407a-a75d-65eb41470716 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6ffd50-1521-45fb-adae-7fa30d112344]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] <== disconnect_volume: return (952ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:35:28 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Deleting instance files /opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483_del
Aug 09 16:35:28 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Deletion of /opt/stack/data/nova/instances/e4ec0db9-740e-4047-8cab-ac60a1681483_del complete
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: INFO os_vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=dc6e7056-4650-4973-be22-b1d98c14149f,network=Network(6acf27ea-51af-4bf4-824d-86b1ae394d4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc6e7056-46')
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1128f26c-215d-4940-8772-886149c34785", "address": "fa:16:3e:18:47:aa", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1128f26c-21", "ovs_interfaceid": "1128f26c-215d-4940-8772-886149c34785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "1128f26c-215d-4940-8772-886149c34785", "address": "fa:16:3e:18:47:aa", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1128f26c-21", "ovs_interfaceid": "1128f26c-215d-4940-8772-886149c34785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:47:aa,bridge_name='br-int',has_traffic_filtering=True,id=1128f26c-215d-4940-8772-886149c34785,network=Network(6acf27ea-51af-4bf4-824d-86b1ae394d4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1128f26c-21') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG os_vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:47:aa,bridge_name='br-int',has_traffic_filtering=True,id=1128f26c-215d-4940-8772-886149c34785,network=Network(6acf27ea-51af-4bf4-824d-86b1ae394d4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1128f26c-21') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1128f26c-21, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1128f26c-21, col_values=(('external_ids', {'iface-id': '1128f26c-215d-4940-8772-886149c34785', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:47:aa', 'vm-uuid': '9c8b5adc-d13f-4d9f-a878-e59dd52550c3'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:35:28 user nova-compute[73091]: INFO nova.compute.manager [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Took 1.99 seconds to destroy the instance on the hypervisor.
Aug 09 16:35:28 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:28 user nova-compute[73091]: INFO os_vif [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:47:aa,bridge_name='br-int',has_traffic_filtering=True,id=1128f26c-215d-4940-8772-886149c34785,network=Network(6acf27ea-51af-4bf4-824d-86b1ae394d4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1128f26c-21')
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] No BDM found with device name hda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] No VIF found with MAC fa:16:3e:30:e8:27, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:35:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] No VIF found with MAC fa:16:3e:05:45:18, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:35:28 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Using config drive
Aug 09 16:35:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-fe6a1e72-996f-4dc2-bd71-b4f5877376ef req-58f78f7b-8596-440c-b301-9e387820923f service nova] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Received event network-vif-plugged-0e3f420c-de38-4d22-a167-fdca07babd17 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fe6a1e72-996f-4dc2-bd71-b4f5877376ef req-58f78f7b-8596-440c-b301-9e387820923f service nova] Acquiring lock "e4ec0db9-740e-4047-8cab-ac60a1681483-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fe6a1e72-996f-4dc2-bd71-b4f5877376ef req-58f78f7b-8596-440c-b301-9e387820923f service nova] Lock "e4ec0db9-740e-4047-8cab-ac60a1681483-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fe6a1e72-996f-4dc2-bd71-b4f5877376ef req-58f78f7b-8596-440c-b301-9e387820923f service nova] Lock "e4ec0db9-740e-4047-8cab-ac60a1681483-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-fe6a1e72-996f-4dc2-bd71-b4f5877376ef req-58f78f7b-8596-440c-b301-9e387820923f service nova] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] No waiting events found dispatching network-vif-plugged-0e3f420c-de38-4d22-a167-fdca07babd17 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:29 user nova-compute[73091]: WARNING nova.compute.manager [req-fe6a1e72-996f-4dc2-bd71-b4f5877376ef req-58f78f7b-8596-440c-b301-9e387820923f service nova] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Received unexpected event network-vif-plugged-0e3f420c-de38-4d22-a167-fdca07babd17 for instance with vm_state active and task_state deleting.
Aug 09 16:35:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:29 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Creating config drive at /opt/stack/data/nova/instances/9c8b5adc-d13f-4d9f-a878-e59dd52550c3/disk.config
Aug 09 16:35:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9c8b5adc-d13f-4d9f-a878-e59dd52550c3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3ekb3k_r {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9c8b5adc-d13f-4d9f-a878-e59dd52550c3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3ekb3k_r" returned: 0 in 0.055s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:29 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:35:29 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Took 1.29 seconds to deallocate network for instance.
Aug 09 16:35:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-a50397f7-057a-4b32-8613-49467e3a704b req-8537c3a3-ae58-455a-881b-14c84c77d67f service nova] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Received event network-vif-deleted-0e3f420c-de38-4d22-a167-fdca07babd17 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Acquiring lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:30 user nova-compute[73091]: DEBUG nova.objects.instance [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Lazy-loading 'flavor' on Instance uuid 7bcc1e42-532f-4fb6-984e-cdf659cfef7c {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:35:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:30 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691598915.9039965, f3e2ea27-5fa4-4437-83d0-2eeda59506a9 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:35:30 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] VM Stopped (Lifecycle Event)
Aug 09 16:35:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9e279a00-d7fb-461e-849a-0e54e277646e None None] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:35:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Acquiring lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:30 user nova-compute[73091]: INFO nova.compute.manager [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Attaching volume fd397f93-610f-4b6b-952d-fc70642b02fe to /dev/vdb
Aug 09 16:35:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG os_brick.utils [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf3224d-6850-44cd-b917-ab926688d12d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[587f5550-ebeb-4156-8d54-168282d059df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3600e26f-1db1-42f1-86f2-6e4861cf8865]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[99903176-252c-44e9-8a2f-8aa628a502a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:35:31 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:35:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a699b0e2-2a77-4a30-b0ae-a1efa792ce97]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG os_brick.utils [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Updating existing volume attachment record: 369f5d5a-e0b9-4365-bbbf-a9f505fb7245 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-c4e84a35-0736-4684-b4e7-d7bb48ba652a req-95ad4883-e238-46bc-bd76-31ec324e77c3 service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Received event network-changed-0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-c4e84a35-0736-4684-b4e7-d7bb48ba652a req-95ad4883-e238-46bc-bd76-31ec324e77c3 service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Refreshing instance network info cache due to event network-changed-0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c4e84a35-0736-4684-b4e7-d7bb48ba652a req-95ad4883-e238-46bc-bd76-31ec324e77c3 service nova] Acquiring lock "refresh_cache-7bcc1e42-532f-4fb6-984e-cdf659cfef7c" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c4e84a35-0736-4684-b4e7-d7bb48ba652a req-95ad4883-e238-46bc-bd76-31ec324e77c3 service nova] Acquired lock "refresh_cache-7bcc1e42-532f-4fb6-984e-cdf659cfef7c" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-c4e84a35-0736-4684-b4e7-d7bb48ba652a req-95ad4883-e238-46bc-bd76-31ec324e77c3 service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Refreshing network info cache for port 0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-ce7fdc7a-0f85-432d-98ad-397793e0e28d req-69b9ed3a-09af-4b59-b9d3-15d60e84f350 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-7f9e1fe5-ad99-4c58-9181-0caeb7675dab {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce7fdc7a-0f85-432d-98ad-397793e0e28d req-69b9ed3a-09af-4b59-b9d3-15d60e84f350 service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce7fdc7a-0f85-432d-98ad-397793e0e28d req-69b9ed3a-09af-4b59-b9d3-15d60e84f350 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce7fdc7a-0f85-432d-98ad-397793e0e28d req-69b9ed3a-09af-4b59-b9d3-15d60e84f350 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-ce7fdc7a-0f85-432d-98ad-397793e0e28d req-69b9ed3a-09af-4b59-b9d3-15d60e84f350 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-7f9e1fe5-ad99-4c58-9181-0caeb7675dab {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:31 user nova-compute[73091]: WARNING nova.compute.manager [req-ce7fdc7a-0f85-432d-98ad-397793e0e28d req-69b9ed3a-09af-4b59-b9d3-15d60e84f350 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-7f9e1fe5-ad99-4c58-9181-0caeb7675dab for instance with vm_state building and task_state spawning.
Aug 09 16:35:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:32 user nova-compute[73091]: DEBUG nova.network.neutron [req-c4e84a35-0736-4684-b4e7-d7bb48ba652a req-95ad4883-e238-46bc-bd76-31ec324e77c3 service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Updated VIF entry in instance network info cache for port 0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:35:32 user nova-compute[73091]: DEBUG nova.network.neutron [req-c4e84a35-0736-4684-b4e7-d7bb48ba652a req-95ad4883-e238-46bc-bd76-31ec324e77c3 service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Updating instance_info_cache with network_info: [{"id": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "address": "fa:16:3e:11:4b:40", "network": {"id": "4ec80c56-7d1a-4fbe-81a2-7d12e69c94e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5225565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d63eb933f4d40cdb34d3a27c76c9720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d2e6e-6d", "ovs_interfaceid": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:35:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c4e84a35-0736-4684-b4e7-d7bb48ba652a req-95ad4883-e238-46bc-bd76-31ec324e77c3 service nova] Releasing lock "refresh_cache-7bcc1e42-532f-4fb6-984e-cdf659cfef7c" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:35:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-db6b0c42-2044-40dc-8a58-168a24be53ee req-6495c760-a0f0-4e08-8bf8-aa1a83b7e267 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-dc6e7056-4650-4973-be22-b1d98c14149f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-db6b0c42-2044-40dc-8a58-168a24be53ee req-6495c760-a0f0-4e08-8bf8-aa1a83b7e267 service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-db6b0c42-2044-40dc-8a58-168a24be53ee req-6495c760-a0f0-4e08-8bf8-aa1a83b7e267 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-db6b0c42-2044-40dc-8a58-168a24be53ee req-6495c760-a0f0-4e08-8bf8-aa1a83b7e267 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-db6b0c42-2044-40dc-8a58-168a24be53ee req-6495c760-a0f0-4e08-8bf8-aa1a83b7e267 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-dc6e7056-4650-4973-be22-b1d98c14149f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:33 user nova-compute[73091]: WARNING nova.compute.manager [req-db6b0c42-2044-40dc-8a58-168a24be53ee req-6495c760-a0f0-4e08-8bf8-aa1a83b7e267 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-dc6e7056-4650-4973-be22-b1d98c14149f for instance with vm_state building and task_state spawning.
Aug 09 16:35:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-f3eac408-ecc9-4f3f-a64d-4364c91bf697 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-f3eac408-ecc9-4f3f-a64d-4364c91bf697 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:33 user nova-compute[73091]: WARNING nova.compute.manager [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-f3eac408-ecc9-4f3f-a64d-4364c91bf697 for instance with vm_state building and task_state spawning.
Aug 09 16:35:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Received event network-changed-d368f4bb-4681-4152-b639-3be5601c73b9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Refreshing instance network info cache due to event network-changed-d368f4bb-4681-4152-b639-3be5601c73b9. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] Acquiring lock "refresh_cache-b791bded-3eb5-4bf8-a14e-eae269ae2043" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] Acquired lock "refresh_cache-b791bded-3eb5-4bf8-a14e-eae269ae2043" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG nova.network.neutron [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Refreshing network info cache for port d368f4bb-4681-4152-b639-3be5601c73b9 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-7f9e1fe5-ad99-4c58-9181-0caeb7675dab {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-7f9e1fe5-ad99-4c58-9181-0caeb7675dab {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:33 user nova-compute[73091]: WARNING nova.compute.manager [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-7f9e1fe5-ad99-4c58-9181-0caeb7675dab for instance with vm_state building and task_state spawning.
Aug 09 16:35:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-9f37bd5d-1587-4aad-9da4-892334eadaad {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-9f37bd5d-1587-4aad-9da4-892334eadaad {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:33 user nova-compute[73091]: WARNING nova.compute.manager [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-9f37bd5d-1587-4aad-9da4-892334eadaad for instance with vm_state building and task_state spawning.
Aug 09 16:35:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-9f37bd5d-1587-4aad-9da4-892334eadaad {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-9f37bd5d-1587-4aad-9da4-892334eadaad {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:33 user nova-compute[73091]: WARNING nova.compute.manager [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-9f37bd5d-1587-4aad-9da4-892334eadaad for instance with vm_state building and task_state spawning.
Aug 09 16:35:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-1128f26c-215d-4940-8772-886149c34785 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-1128f26c-215d-4940-8772-886149c34785 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:33 user nova-compute[73091]: WARNING nova.compute.manager [req-15e8c902-e4c9-4bcc-b70e-4c15da1690d4 req-d8320bc1-e4ae-4ac1-b2a3-0240ae97dd2d service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-1128f26c-215d-4940-8772-886149c34785 for instance with vm_state building and task_state spawning.
Aug 09 16:35:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:34 user nova-compute[73091]: DEBUG nova.network.neutron [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Updated VIF entry in instance network info cache for port d368f4bb-4681-4152-b639-3be5601c73b9. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:35:34 user nova-compute[73091]: DEBUG nova.network.neutron [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Updating instance_info_cache with network_info: [{"id": "d368f4bb-4681-4152-b639-3be5601c73b9", "address": "fa:16:3e:8c:25:9d", "network": {"id": "9d0306b7-548e-47e5-b869-9d479e62278a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-633341944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea346b28dbcf4ba6b8de576c3326328e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd368f4bb-46", "ovs_interfaceid": "d368f4bb-4681-4152-b639-3be5601c73b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:35:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] Releasing lock "refresh_cache-b791bded-3eb5-4bf8-a14e-eae269ae2043" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:35:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-f3eac408-ecc9-4f3f-a64d-4364c91bf697 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-f3eac408-ecc9-4f3f-a64d-4364c91bf697 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:34 user nova-compute[73091]: WARNING nova.compute.manager [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-f3eac408-ecc9-4f3f-a64d-4364c91bf697 for instance with vm_state building and task_state spawning.
Aug 09 16:35:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-847e88af-f82a-4a2d-aa96-7e3dd512e055 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-847e88af-f82a-4a2d-aa96-7e3dd512e055 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:34 user nova-compute[73091]: WARNING nova.compute.manager [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-847e88af-f82a-4a2d-aa96-7e3dd512e055 for instance with vm_state building and task_state spawning.
Aug 09 16:35:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-847e88af-f82a-4a2d-aa96-7e3dd512e055 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-847e88af-f82a-4a2d-aa96-7e3dd512e055 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:34 user nova-compute[73091]: WARNING nova.compute.manager [req-c9641387-6038-4b12-959a-881df3592fdf req-c3350d80-0fe1-4972-be87-4b0bb8959a54 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-847e88af-f82a-4a2d-aa96-7e3dd512e055 for instance with vm_state building and task_state spawning.
Aug 09 16:35:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-4a594abc-5d68-4820-93f8-7bdb01b30b2e req-21e50501-9017-49aa-a78d-b4958bc14fe7 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-dc6e7056-4650-4973-be22-b1d98c14149f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4a594abc-5d68-4820-93f8-7bdb01b30b2e req-21e50501-9017-49aa-a78d-b4958bc14fe7 service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4a594abc-5d68-4820-93f8-7bdb01b30b2e req-21e50501-9017-49aa-a78d-b4958bc14fe7 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4a594abc-5d68-4820-93f8-7bdb01b30b2e req-21e50501-9017-49aa-a78d-b4958bc14fe7 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-4a594abc-5d68-4820-93f8-7bdb01b30b2e req-21e50501-9017-49aa-a78d-b4958bc14fe7 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-dc6e7056-4650-4973-be22-b1d98c14149f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:35 user nova-compute[73091]: WARNING nova.compute.manager [req-4a594abc-5d68-4820-93f8-7bdb01b30b2e req-21e50501-9017-49aa-a78d-b4958bc14fe7 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-dc6e7056-4650-4973-be22-b1d98c14149f for instance with vm_state building and task_state spawning.
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598935.3639429, 9c8b5adc-d13f-4d9f-a878-e59dd52550c3 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:35:35 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] VM Resumed (Lifecycle Event)
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:35:35 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Instance spawned successfully.
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-42aed5a6-5e6c-4e59-b32b-9b0f9a302db2 req-1be81c50-d8ab-40e2-b7db-01cee5fb456e service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-09f12e06-60f3-4e4d-b8c0-929fb56b0afd {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-42aed5a6-5e6c-4e59-b32b-9b0f9a302db2 req-1be81c50-d8ab-40e2-b7db-01cee5fb456e service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-42aed5a6-5e6c-4e59-b32b-9b0f9a302db2 req-1be81c50-d8ab-40e2-b7db-01cee5fb456e service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-42aed5a6-5e6c-4e59-b32b-9b0f9a302db2 req-1be81c50-d8ab-40e2-b7db-01cee5fb456e service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-42aed5a6-5e6c-4e59-b32b-9b0f9a302db2 req-1be81c50-d8ab-40e2-b7db-01cee5fb456e service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-09f12e06-60f3-4e4d-b8c0-929fb56b0afd {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:35 user nova-compute[73091]: WARNING nova.compute.manager [req-42aed5a6-5e6c-4e59-b32b-9b0f9a302db2 req-1be81c50-d8ab-40e2-b7db-01cee5fb456e service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-09f12e06-60f3-4e4d-b8c0-929fb56b0afd for instance with vm_state building and task_state spawning.
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-42aed5a6-5e6c-4e59-b32b-9b0f9a302db2 req-1be81c50-d8ab-40e2-b7db-01cee5fb456e service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-09f12e06-60f3-4e4d-b8c0-929fb56b0afd {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-42aed5a6-5e6c-4e59-b32b-9b0f9a302db2 req-1be81c50-d8ab-40e2-b7db-01cee5fb456e service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-42aed5a6-5e6c-4e59-b32b-9b0f9a302db2 req-1be81c50-d8ab-40e2-b7db-01cee5fb456e service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-42aed5a6-5e6c-4e59-b32b-9b0f9a302db2 req-1be81c50-d8ab-40e2-b7db-01cee5fb456e service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-42aed5a6-5e6c-4e59-b32b-9b0f9a302db2 req-1be81c50-d8ab-40e2-b7db-01cee5fb456e service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-09f12e06-60f3-4e4d-b8c0-929fb56b0afd {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:35 user nova-compute[73091]: WARNING nova.compute.manager [req-42aed5a6-5e6c-4e59-b32b-9b0f9a302db2 req-1be81c50-d8ab-40e2-b7db-01cee5fb456e service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-09f12e06-60f3-4e4d-b8c0-929fb56b0afd for instance with vm_state building and task_state spawning.
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:35:35 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598935.3655574, 9c8b5adc-d13f-4d9f-a878-e59dd52550c3 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:35:35 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] VM Started (Lifecycle Event)
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:35:35 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-3eb98d7f-a084-4536-a6b9-54c31edb4b5c req-01ad835b-c85a-419b-8897-dd8b0e5ec562 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-1128f26c-215d-4940-8772-886149c34785 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3eb98d7f-a084-4536-a6b9-54c31edb4b5c req-01ad835b-c85a-419b-8897-dd8b0e5ec562 service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3eb98d7f-a084-4536-a6b9-54c31edb4b5c req-01ad835b-c85a-419b-8897-dd8b0e5ec562 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3eb98d7f-a084-4536-a6b9-54c31edb4b5c req-01ad835b-c85a-419b-8897-dd8b0e5ec562 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-3eb98d7f-a084-4536-a6b9-54c31edb4b5c req-01ad835b-c85a-419b-8897-dd8b0e5ec562 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-1128f26c-215d-4940-8772-886149c34785 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:35 user nova-compute[73091]: WARNING nova.compute.manager [req-3eb98d7f-a084-4536-a6b9-54c31edb4b5c req-01ad835b-c85a-419b-8897-dd8b0e5ec562 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-1128f26c-215d-4940-8772-886149c34785 for instance with vm_state building and task_state spawning.
Aug 09 16:35:35 user nova-compute[73091]: INFO nova.compute.manager [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Took 13.17 seconds to spawn the instance on the hypervisor.
Aug 09 16:35:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:35:35 user nova-compute[73091]: INFO nova.compute.manager [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Took 60.49 seconds to build instance.
Aug 09 16:35:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbbfc8e7-70b8-477c-be32-d449d9ea9e87 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 60.589s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:36 user nova-compute[73091]: INFO nova.compute.manager [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Took 6.90 seconds to detach 1 volumes for instance.
Aug 09 16:35:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.018s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Acquiring lock "b791bded-3eb5-4bf8-a14e-eae269ae2043" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "b791bded-3eb5-4bf8-a14e-eae269ae2043" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:37 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Deleted allocations for instance e4ec0db9-740e-4047-8cab-ac60a1681483
Aug 09 16:35:37 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lazy-loading 'flavor' on Instance uuid b791bded-3eb5-4bf8-a14e-eae269ae2043 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "b791bded-3eb5-4bf8-a14e-eae269ae2043" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.108s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1d9a7d72-485f-4b2f-bc72-c2e62b3d6cfa tempest-DeleteServersTestJSON-1124556085 tempest-DeleteServersTestJSON-1124556085-project-member] Lock "e4ec0db9-740e-4047-8cab-ac60a1681483" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.929s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-7258906f-1d6a-4167-b8c2-071b5963a2f7 req-5f381a8e-859a-4ff9-b79c-08f32dcbaeaf service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received event network-changed-416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-7258906f-1d6a-4167-b8c2-071b5963a2f7 req-5f381a8e-859a-4ff9-b79c-08f32dcbaeaf service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Refreshing instance network info cache due to event network-changed-416fe3a2-a0ea-4c8e-81c6-7374e6205456. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7258906f-1d6a-4167-b8c2-071b5963a2f7 req-5f381a8e-859a-4ff9-b79c-08f32dcbaeaf service nova] Acquiring lock "refresh_cache-ec2187af-1b88-4c23-abba-2f09db3057d6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7258906f-1d6a-4167-b8c2-071b5963a2f7 req-5f381a8e-859a-4ff9-b79c-08f32dcbaeaf service nova] Acquired lock "refresh_cache-ec2187af-1b88-4c23-abba-2f09db3057d6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-7258906f-1d6a-4167-b8c2-071b5963a2f7 req-5f381a8e-859a-4ff9-b79c-08f32dcbaeaf service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Refreshing network info cache for port 416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Acquiring lock "b791bded-3eb5-4bf8-a14e-eae269ae2043" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "b791bded-3eb5-4bf8-a14e-eae269ae2043" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:37 user nova-compute[73091]: INFO nova.compute.manager [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Attaching volume 07c30d93-8250-469a-8557-3a52a98e9b51 to /dev/sdc
Aug 09 16:35:37 user nova-compute[73091]: DEBUG os_brick.utils [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquiring lock "interface-ec2187af-1b88-4c23-abba-2f09db3057d6-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "interface-ec2187af-1b88-4c23-abba-2f09db3057d6-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.003s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG nova.objects.instance [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lazy-loading 'flavor' on Instance uuid ec2187af-1b88-4c23-abba-2f09db3057d6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[092b73c9-4970-4f5c-87b8-d07119b7f98d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f0918d-729f-4486-a2d3-c6292b765b2a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8733a9-9a7e-40cb-a5c2-2ab82ee127e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[327850bf-fe7c-4ebc-bb06-48c2dbc5d64f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:35:37 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:35:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb337af7-1203-44b7-8668-a060762e36ef]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG os_brick.utils [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:35:37 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Updating existing volume attachment record: b75bdaa9-7edc-476a-a2c0-04ca207f9071 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:35:38 user nova-compute[73091]: DEBUG nova.objects.instance [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lazy-loading 'pci_requests' on Instance uuid ec2187af-1b88-4c23-abba-2f09db3057d6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:35:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:35:38 user nova-compute[73091]: DEBUG nova.policy [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc4caea945424320a1b8ed52721c0ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ef9b2241b143deb605e774ce34998e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:35:38 user nova-compute[73091]: DEBUG nova.network.neutron [req-7258906f-1d6a-4167-b8c2-071b5963a2f7 req-5f381a8e-859a-4ff9-b79c-08f32dcbaeaf service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Updated VIF entry in instance network info cache for port 416fe3a2-a0ea-4c8e-81c6-7374e6205456. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:35:38 user nova-compute[73091]: DEBUG nova.network.neutron [req-7258906f-1d6a-4167-b8c2-071b5963a2f7 req-5f381a8e-859a-4ff9-b79c-08f32dcbaeaf service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Updating instance_info_cache with network_info: [{"id": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "address": "fa:16:3e:f3:65:dc", "network": {"id": "4d26b33a-b351-4595-a0c5-788f2ecb7732", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-549846585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe3a2-a0", "ovs_interfaceid": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:35:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7258906f-1d6a-4167-b8c2-071b5963a2f7 req-5f381a8e-859a-4ff9-b79c-08f32dcbaeaf service nova] Releasing lock "refresh_cache-ec2187af-1b88-4c23-abba-2f09db3057d6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:35:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Successfully created port: 6415d3ca-e310-4a5f-bce7-daef45247643 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:35:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Successfully updated port: 6415d3ca-e310-4a5f-bce7-daef45247643 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:35:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquiring lock "refresh_cache-ec2187af-1b88-4c23-abba-2f09db3057d6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:35:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquired lock "refresh_cache-ec2187af-1b88-4c23-abba-2f09db3057d6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:35:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:35:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f51286e-b091-4be7-8485-c0eb4ff75981 req-1f5cd3bb-acb4-439f-bb56-03bef68452b8 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received event network-changed-6415d3ca-e310-4a5f-bce7-daef45247643 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f51286e-b091-4be7-8485-c0eb4ff75981 req-1f5cd3bb-acb4-439f-bb56-03bef68452b8 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Refreshing instance network info cache due to event network-changed-6415d3ca-e310-4a5f-bce7-daef45247643. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:35:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f51286e-b091-4be7-8485-c0eb4ff75981 req-1f5cd3bb-acb4-439f-bb56-03bef68452b8 service nova] Acquiring lock "refresh_cache-ec2187af-1b88-4c23-abba-2f09db3057d6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:35:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-f095baac-5a2c-4c18-b492-56ec0dd9ebc9 req-9f290138-6035-4cb2-9446-e62a14ca4957 service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Received event network-changed-218c7585-7957-41e4-88d8-6f04e4d4a9bc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-f095baac-5a2c-4c18-b492-56ec0dd9ebc9 req-9f290138-6035-4cb2-9446-e62a14ca4957 service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Refreshing instance network info cache due to event network-changed-218c7585-7957-41e4-88d8-6f04e4d4a9bc. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:35:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f095baac-5a2c-4c18-b492-56ec0dd9ebc9 req-9f290138-6035-4cb2-9446-e62a14ca4957 service nova] Acquiring lock "refresh_cache-50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:35:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f095baac-5a2c-4c18-b492-56ec0dd9ebc9 req-9f290138-6035-4cb2-9446-e62a14ca4957 service nova] Acquired lock "refresh_cache-50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:35:40 user nova-compute[73091]: DEBUG nova.network.neutron [req-f095baac-5a2c-4c18-b492-56ec0dd9ebc9 req-9f290138-6035-4cb2-9446-e62a14ca4957 service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Refreshing network info cache for port 218c7585-7957-41e4-88d8-6f04e4d4a9bc {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Acquiring lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lazy-loading 'flavor' on Instance uuid 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Acquiring lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:41 user nova-compute[73091]: INFO nova.compute.manager [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Attaching volume 6c311244-3b9e-4d97-b85a-c9b72f143e90 to /dev/vdb
Aug 09 16:35:41 user nova-compute[73091]: DEBUG os_brick.utils [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1bf983-2517-4d54-bd88-189c4306f335]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[616a208b-a8db-45ac-878d-1583323570fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e44e235-a557-40e0-a008-2a7707b99bd7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2361215f-936d-4b6b-8718-324f93a8444d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG nova.network.neutron [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Updating instance_info_cache with network_info: [{"id": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "address": "fa:16:3e:f3:65:dc", "network": {"id": "4d26b33a-b351-4595-a0c5-788f2ecb7732", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-549846585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe3a2-a0", "ovs_interfaceid": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6415d3ca-e310-4a5f-bce7-daef45247643", "address": "fa:16:3e:9f:13:67", "network": {"id": "253a307f-589a-4828-90e2-b4db1ddad191", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159303419", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6415d3ca-e3", "ovs_interfaceid": "6415d3ca-e310-4a5f-bce7-daef45247643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:35:41 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[995ac8d8-6ec2-402d-9a46-8932083ba3fe]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG os_brick.utils [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Updating existing volume attachment record: 775a42b5-234d-4a83-8983-9f1baccc7681 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Releasing lock "refresh_cache-ec2187af-1b88-4c23-abba-2f09db3057d6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f51286e-b091-4be7-8485-c0eb4ff75981 req-1f5cd3bb-acb4-439f-bb56-03bef68452b8 service nova] Acquired lock "refresh_cache-ec2187af-1b88-4c23-abba-2f09db3057d6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG nova.network.neutron [req-3f51286e-b091-4be7-8485-c0eb4ff75981 req-1f5cd3bb-acb4-439f-bb56-03bef68452b8 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Refreshing network info cache for port 6415d3ca-e310-4a5f-bce7-daef45247643 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:33:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-232794309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-232794309',id=6,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKvUekvW9eV5PNFmOyGiNtiOlJk5szt6jF7Nn2Cjo8H7lw7fn57Jt1UoYyP8a1MRbAqNPdKj8VAN21vacR3qFtYUOYtrJGDNRvt4Yzt0u8rIA+SenASC0Z9S6AJgV5gFw==',key_name='tempest-keypair-1792812162',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:33:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3ef9b2241b143deb605e774ce34998e',ramdisk_id='',reservation_id='r-yr1ytpcl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-357169138',owner_user_name='tempest-TaggedAttachmentsTest-357169138-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc4caea945424320a1b8ed52721c0ccf',uuid=ec2187af-1b88-4c23-abba-2f09db3057d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6415d3ca-e310-4a5f-bce7-daef45247643", "address": "fa:16:3e:9f:13:67", "network": {"id": "253a307f-589a-4828-90e2-b4db1ddad191", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159303419", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6415d3ca-e3", "ovs_interfaceid": "6415d3ca-e310-4a5f-bce7-daef45247643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Converting VIF {"id": "6415d3ca-e310-4a5f-bce7-daef45247643", "address": "fa:16:3e:9f:13:67", "network": {"id": "253a307f-589a-4828-90e2-b4db1ddad191", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159303419", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6415d3ca-e3", "ovs_interfaceid": "6415d3ca-e310-4a5f-bce7-daef45247643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:13:67,bridge_name='br-int',has_traffic_filtering=True,id=6415d3ca-e310-4a5f-bce7-daef45247643,network=Network(253a307f-589a-4828-90e2-b4db1ddad191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6415d3ca-e3') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG os_vif [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:13:67,bridge_name='br-int',has_traffic_filtering=True,id=6415d3ca-e310-4a5f-bce7-daef45247643,network=Network(253a307f-589a-4828-90e2-b4db1ddad191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6415d3ca-e3') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6415d3ca-e3, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6415d3ca-e3, col_values=(('external_ids', {'iface-id': '6415d3ca-e310-4a5f-bce7-daef45247643', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:13:67', 'vm-uuid': 'ec2187af-1b88-4c23-abba-2f09db3057d6'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:41 user nova-compute[73091]: INFO os_vif [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:13:67,bridge_name='br-int',has_traffic_filtering=True,id=6415d3ca-e310-4a5f-bce7-daef45247643,network=Network(253a307f-589a-4828-90e2-b4db1ddad191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6415d3ca-e3')
Aug 09 16:35:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:33:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-232794309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-232794309',id=6,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKvUekvW9eV5PNFmOyGiNtiOlJk5szt6jF7Nn2Cjo8H7lw7fn57Jt1UoYyP8a1MRbAqNPdKj8VAN21vacR3qFtYUOYtrJGDNRvt4Yzt0u8rIA+SenASC0Z9S6AJgV5gFw==',key_name='tempest-keypair-1792812162',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:33:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3ef9b2241b143deb605e774ce34998e',ramdisk_id='',reservation_id='r-yr1ytpcl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-357169138',owner_user_name='tempest-TaggedAttachmentsTest-357169138-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc4caea945424320a1b8ed52721c0ccf',uuid=ec2187af-1b88-4c23-abba-2f09db3057d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6415d3ca-e310-4a5f-bce7-daef45247643", "address": "fa:16:3e:9f:13:67", "network": {"id": "253a307f-589a-4828-90e2-b4db1ddad191", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159303419", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6415d3ca-e3", "ovs_interfaceid": "6415d3ca-e310-4a5f-bce7-daef45247643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Converting VIF {"id": "6415d3ca-e310-4a5f-bce7-daef45247643", "address": "fa:16:3e:9f:13:67", "network": {"id": "253a307f-589a-4828-90e2-b4db1ddad191", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159303419", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6415d3ca-e3", "ovs_interfaceid": "6415d3ca-e310-4a5f-bce7-daef45247643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:13:67,bridge_name='br-int',has_traffic_filtering=True,id=6415d3ca-e310-4a5f-bce7-daef45247643,network=Network(253a307f-589a-4828-90e2-b4db1ddad191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6415d3ca-e3') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:35:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] attach device xml: <interface type="ethernet">
Aug 09 16:35:41 user nova-compute[73091]:   <mac address="fa:16:3e:9f:13:67"/>
Aug 09 16:35:41 user nova-compute[73091]:   <model type="virtio"/>
Aug 09 16:35:41 user nova-compute[73091]:   <mtu size="1442"/>
Aug 09 16:35:41 user nova-compute[73091]:   <target dev="tap6415d3ca-e3"/>
Aug 09 16:35:41 user nova-compute[73091]: </interface>
Aug 09 16:35:41 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG nova.network.neutron [req-f095baac-5a2c-4c18-b492-56ec0dd9ebc9 req-9f290138-6035-4cb2-9446-e62a14ca4957 service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Updated VIF entry in instance network info cache for port 218c7585-7957-41e4-88d8-6f04e4d4a9bc. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG nova.network.neutron [req-f095baac-5a2c-4c18-b492-56ec0dd9ebc9 req-9f290138-6035-4cb2-9446-e62a14ca4957 service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Updating instance_info_cache with network_info: [{"id": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "address": "fa:16:3e:fa:39:24", "network": {"id": "a2babb7a-2af8-4453-abd7-e1a3f193d026", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1066415352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7167f5fdba4476783c578e63f388618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218c7585-79", "ovs_interfaceid": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f095baac-5a2c-4c18-b492-56ec0dd9ebc9 req-9f290138-6035-4cb2-9446-e62a14ca4957 service nova] Releasing lock "refresh_cache-50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] No BDM found with device name hda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] No VIF found with MAC fa:16:3e:f3:65:dc, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:35:42 user nova-compute[73091]:   <nova:package version="0.0.0"/>
Aug 09 16:35:42 user nova-compute[73091]:   <nova:name>tempest-device-tagging-server-232794309</nova:name>
Aug 09 16:35:42 user nova-compute[73091]:   <nova:creationTime>2023-08-09 16:35:42</nova:creationTime>
Aug 09 16:35:42 user nova-compute[73091]:   <nova:flavor name="m1.tiny">
Aug 09 16:35:42 user nova-compute[73091]:     <nova:memory>512</nova:memory>
Aug 09 16:35:42 user nova-compute[73091]:     <nova:disk>1</nova:disk>
Aug 09 16:35:42 user nova-compute[73091]:     <nova:swap>0</nova:swap>
Aug 09 16:35:42 user nova-compute[73091]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:35:42 user nova-compute[73091]:     <nova:vcpus>1</nova:vcpus>
Aug 09 16:35:42 user nova-compute[73091]:   </nova:flavor>
Aug 09 16:35:42 user nova-compute[73091]:   <nova:owner>
Aug 09 16:35:42 user nova-compute[73091]:     <nova:user uuid="bc4caea945424320a1b8ed52721c0ccf">tempest-TaggedAttachmentsTest-357169138-project-member</nova:user>
Aug 09 16:35:42 user nova-compute[73091]:     <nova:project uuid="a3ef9b2241b143deb605e774ce34998e">tempest-TaggedAttachmentsTest-357169138</nova:project>
Aug 09 16:35:42 user nova-compute[73091]:   </nova:owner>
Aug 09 16:35:42 user nova-compute[73091]:   <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:35:42 user nova-compute[73091]:   <nova:ports>
Aug 09 16:35:42 user nova-compute[73091]:     <nova:port uuid="416fe3a2-a0ea-4c8e-81c6-7374e6205456">
Aug 09 16:35:42 user nova-compute[73091]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 16:35:42 user nova-compute[73091]:     </nova:port>
Aug 09 16:35:42 user nova-compute[73091]:     <nova:port uuid="6415d3ca-e310-4a5f-bce7-daef45247643">
Aug 09 16:35:42 user nova-compute[73091]:       <nova:ip type="fixed" address="10.10.10.241" ipVersion="4"/>
Aug 09 16:35:42 user nova-compute[73091]:     </nova:port>
Aug 09 16:35:42 user nova-compute[73091]:   </nova:ports>
Aug 09 16:35:42 user nova-compute[73091]: </nova:instance>
Aug 09 16:35:42 user nova-compute[73091]:  {{(pid=73091) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691598927.5766802, e4ec0db9-740e-4047-8cab-ac60a1681483 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:35:42 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] VM Stopped (Lifecycle Event)
Aug 09 16:35:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHApdrlc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:35:42 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:35:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:35:42 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:35:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:35:42 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:35:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-380c49b7-e08d-4821-b540-a5277a6ac9f2 None None] [instance: e4ec0db9-740e-4047-8cab-ac60a1681483] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-39d28791-f47d-4e13-8fce-37ee4a8beb84 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "interface-ec2187af-1b88-4c23-abba-2f09db3057d6-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.792s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e52f908-281c-4dd0-86ea-1c50a071e766]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:35:42 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[77660c8c-2cd0-4609-9c66-f66147ab069d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe] added
Aug 09 16:35:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86f6242-1f6b-4a98-b5f0-4f4c40dd16c9]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[db926c46-2566-46f4-91d2-be8e58cedae0]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG nova.network.neutron [req-3f51286e-b091-4be7-8485-c0eb4ff75981 req-1f5cd3bb-acb4-439f-bb56-03bef68452b8 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Updated VIF entry in instance network info cache for port 6415d3ca-e310-4a5f-bce7-daef45247643. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG nova.network.neutron [req-3f51286e-b091-4be7-8485-c0eb4ff75981 req-1f5cd3bb-acb4-439f-bb56-03bef68452b8 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Updating instance_info_cache with network_info: [{"id": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "address": "fa:16:3e:f3:65:dc", "network": {"id": "4d26b33a-b351-4595-a0c5-788f2ecb7732", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-549846585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe3a2-a0", "ovs_interfaceid": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6415d3ca-e310-4a5f-bce7-daef45247643", "address": "fa:16:3e:9f:13:67", "network": {"id": "253a307f-589a-4828-90e2-b4db1ddad191", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159303419", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6415d3ca-e3", "ovs_interfaceid": "6415d3ca-e310-4a5f-bce7-daef45247643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nHApdrlc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f51286e-b091-4be7-8485-c0eb4ff75981 req-1f5cd3bb-acb4-439f-bb56-03bef68452b8 service nova] Releasing lock "refresh_cache-ec2187af-1b88-4c23-abba-2f09db3057d6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nHApdrlc" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e763f4-7292-4e46-856c-c7f0ca693d77]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nHApdrlc'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf9e24d-64e6-41dd-93cf-9fd109741607]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7b7f9a-3f72-4bcb-99b2-db8d87cf6f97]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:42 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:42 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:42 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:42 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:42 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:42 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:42 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:42 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:42 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:42 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 --login" returned: 0 in 0.115s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedb8eaa-d795-42f8-bf23-41410e770479]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe, portal: 172.16.0.220,3260]
Aug 09 16:35:42 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe, portal: 172.16.0.220,3260] successful.
Aug 09 16:35:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8abde5-768f-4368-aba0-a31f40aca158]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-67ded5ee-9784-46a4-bee4-ae4792fa2b27 req-4f9a7275-fe94-4537-93e7-3d75e43499db service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received event network-vif-plugged-6415d3ca-e310-4a5f-bce7-daef45247643 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-67ded5ee-9784-46a4-bee4-ae4792fa2b27 req-4f9a7275-fe94-4537-93e7-3d75e43499db service nova] Acquiring lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-67ded5ee-9784-46a4-bee4-ae4792fa2b27 req-4f9a7275-fe94-4537-93e7-3d75e43499db service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-67ded5ee-9784-46a4-bee4-ae4792fa2b27 req-4f9a7275-fe94-4537-93e7-3d75e43499db service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-67ded5ee-9784-46a4-bee4-ae4792fa2b27 req-4f9a7275-fe94-4537-93e7-3d75e43499db service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] No waiting events found dispatching network-vif-plugged-6415d3ca-e310-4a5f-bce7-daef45247643 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:42 user nova-compute[73091]: WARNING nova.compute.manager [req-67ded5ee-9784-46a4-bee4-ae4792fa2b27 req-4f9a7275-fe94-4537-93e7-3d75e43499db service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received unexpected event network-vif-plugged-6415d3ca-e310-4a5f-bce7-daef45247643 for instance with vm_state active and task_state None.
Aug 09 16:35:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-67ded5ee-9784-46a4-bee4-ae4792fa2b27 req-4f9a7275-fe94-4537-93e7-3d75e43499db service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received event network-vif-plugged-6415d3ca-e310-4a5f-bce7-daef45247643 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-67ded5ee-9784-46a4-bee4-ae4792fa2b27 req-4f9a7275-fe94-4537-93e7-3d75e43499db service nova] Acquiring lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-67ded5ee-9784-46a4-bee4-ae4792fa2b27 req-4f9a7275-fe94-4537-93e7-3d75e43499db service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-67ded5ee-9784-46a4-bee4-ae4792fa2b27 req-4f9a7275-fe94-4537-93e7-3d75e43499db service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-67ded5ee-9784-46a4-bee4-ae4792fa2b27 req-4f9a7275-fe94-4537-93e7-3d75e43499db service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] No waiting events found dispatching network-vif-plugged-6415d3ca-e310-4a5f-bce7-daef45247643 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:35:42 user nova-compute[73091]: WARNING nova.compute.manager [req-67ded5ee-9784-46a4-bee4-ae4792fa2b27 req-4f9a7275-fe94-4537-93e7-3d75e43499db service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received unexpected event network-vif-plugged-6415d3ca-e310-4a5f-bce7-daef45247643 for instance with vm_state active and task_state None.
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ce1351-fb56-447b-b767-747a7641b333]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:43 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:43 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:43 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:43 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:43 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:43 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)
Aug 09 16:35:43 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:43 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:43 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:43 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:43 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:43 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:43 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)
Aug 09 16:35:43 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[641a37b9-9066-4682-82ab-157e085b5c07]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHApdrlc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquiring lock "ec2187af-1b88-4c23-abba-2f09db3057d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lazy-loading 'flavor' on Instance uuid ec2187af-1b88-4c23-abba-2f09db3057d6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquiring lock "ec2187af-1b88-4c23-abba-2f09db3057d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:43 user nova-compute[73091]: INFO nova.compute.manager [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Attaching volume 7fbf81b6-11d5-447b-b5ef-246569cac626 to /dev/vdb
Aug 09 16:35:43 user nova-compute[73091]: DEBUG os_brick.utils [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7621812-5c5f-45fe-8780-ad81f49628a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0532ec73-7d62-4ca2-88d2-f418672785f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b84aa8e-75ad-45e8-85a5-a6b2ad822945]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[912e548b-3323-40cb-818f-005022897619]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:35:43 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:35:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad84bdfe-02b1-44f9-b4e7-859802d33bd9]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG os_brick.utils [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:35:43 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Updating existing volume attachment record: b12c2405-9c6c-491f-ad01-ccdd0ab235e3 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:35:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '23231346336343336', 'path': '/dev/sdf'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:35:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231346336343336', 'path': '/dev/sdf'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:35:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Lazy-loading 'flavor' on Instance uuid 7bcc1e42-532f-4fb6-984e-cdf659cfef7c {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:35:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] attach device xml: <disk type="block" device="disk">
Aug 09 16:35:44 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:35:44 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 09 16:35:44 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:35:44 user nova-compute[73091]:   <serial>fd397f93-610f-4b6b-952d-fc70642b02fe</serial>
Aug 09 16:35:44 user nova-compute[73091]: </disk>
Aug 09 16:35:44 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:35:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:35:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:35:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] No VIF found with MAC fa:16:3e:11:4b:40, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:35:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TksBofOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:35:52 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:35:52 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:35:52 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhTeyGin', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:35:52 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a943f7fa-7e5e-4bbd-8c5e-d1f2bacefb58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:35:52 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f0658e-e0dc-4c6d-8633-c565e5d1e5e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90] added
Aug 09 16:35:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6f6ec1-5898-4a1b-b113-767948a22cf8]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce63639-76e9-455f-8f41-91fe72a7fde3]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TksBofOC {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TksBofOC" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e6c7d9-22e2-434b-9a91-530240c5ec6e]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TksBofOC'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[58946b2c-b53b-4ee4-a9a0-0d7e642e2871]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-519d3922-56e9-429f-9bd5-d701f9197695 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.678s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef1b990-ac75-4a04-956c-ee305429e888]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)
Aug 09 16:35:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)
Aug 09 16:35:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bf41cd-b12c-4a4f-b245-9f5041bf9e26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90, portal: 172.16.0.220,3260]
Aug 09 16:35:52 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90, portal: 172.16.0.220,3260] successful.
Aug 09 16:35:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd70b4a8-dfec-4a7a-b50f-1e3772ea3a6c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[946e5202-da76-4be2-a6a2-eae182c45d38]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)
Aug 09 16:35:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:52 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)
Aug 09 16:35:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[38174638-e2a4-4dc8-9d6f-d99364d3ea6a]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:35:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TksBofOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'paMtNDlc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:35:53 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:35:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a4d0853c-ab2d-4e8a-8ce2-7b86dd97e811 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] volume_snapshot_create: create_info: {'snapshot_id': '57e46e00-4b7d-4b97-ba57-0236d1caf9f5', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73091) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a4d0853c-ab2d-4e8a-8ce2-7b86dd97e811 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] snap xml: <domainsnapshot>
Aug 09 16:35:53 user nova-compute[73091]:   <disks>
Aug 09 16:35:53 user nova-compute[73091]:     <disk name="/dev/sdf" snapshot="external" type="file">
Aug 09 16:35:53 user nova-compute[73091]:       <source file="/dev/new_file"/>
Aug 09 16:35:53 user nova-compute[73091]:     </disk>
Aug 09 16:35:53 user nova-compute[73091]:     <disk name="vda" snapshot="no"/>
Aug 09 16:35:53 user nova-compute[73091]:   </disks>
Aug 09 16:35:53 user nova-compute[73091]: </domainsnapshot>
Aug 09 16:35:53 user nova-compute[73091]:  {{(pid=73091) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a4d0853c-ab2d-4e8a-8ce2-7b86dd97e811 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Lazy-loading 'system_metadata' on Instance uuid 7bcc1e42-532f-4fb6-984e-cdf659cfef7c {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:35:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a4d0853c-ab2d-4e8a-8ce2-7b86dd97e811 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [None req-a4d0853c-ab2d-4e8a-8ce2-7b86dd97e811 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Traceback (most recent call last):
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]     rv = execute(f, *args, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]     six.reraise(c, e, tb)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]     raise value
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]     rv = meth(*args, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] 
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [None req-a4d0853c-ab2d-4e8a-8ce2-7b86dd97e811 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Traceback (most recent call last):
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]     self._volume_snapshot_create(context, instance, guest,
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]     rv = execute(f, *args, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]     six.reraise(c, e, tb)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]     raise value
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]     rv = meth(*args, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] 
Aug 09 16:35:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-263b7a0e-ece5-44c0-b204-b78cee56ab35 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] volume_snapshot_delete: delete_info: {'volume_id': 'fd397f93-610f-4b6b-952d-fc70642b02fe'} {{(pid=73091) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [None req-263b7a0e-ece5-44c0-b204-b78cee56ab35 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Traceback (most recent call last):
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c]     if delete_info['type'] != 'qcow2':
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] KeyError: 'type'
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] 
Aug 09 16:35:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26231393364366465', 'path': '/dev/sdi'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231393364366465', 'path': '/dev/sdi'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.369s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:35:53 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:35:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:35:53 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:35:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lazy-loading 'flavor' on Instance uuid 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [None req-a4d0853c-ab2d-4e8a-8ce2-7b86dd97e811 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 57e46e00-4b7d-4b97-ba57-0236d1caf9f5 could not be found.
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise value
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 57e46e00-4b7d-4b97-ba57-0236d1caf9f5 could not be found. (HTTP 404) (Request-ID: req-56bf58ff-6b27-484e-9858-c6f30e40f24b)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 57e46e00-4b7d-4b97-ba57-0236d1caf9f5 could not be found.
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server [None req-a4d0853c-ab2d-4e8a-8ce2-7b86dd97e811 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise value
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server 
Aug 09 16:35:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e25888-759d-414c-87f6-e54dfbc6532a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:35:53 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [None req-263b7a0e-ece5-44c0-b204-b78cee56ab35 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-9b92247c-a431-4115-af21-4844199c4a28)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 09 16:35:53 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server [None req-263b7a0e-ece5-44c0-b204-b78cee56ab35 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Exception during message handling: KeyError: 'type'
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 09 16:35:53 user nova-compute[73091]: ERROR oslo_messaging.rpc.server 
Aug 09 16:35:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:35:53 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:35:53 user nova-compute[73091]:   <source dev="/dev/sdi"/>
Aug 09 16:35:53 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:35:53 user nova-compute[73091]:   <serial>6c311244-3b9e-4d97-b85a-c9b72f143e90</serial>
Aug 09 16:35:53 user nova-compute[73091]: </disk>
Aug 09 16:35:53 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1611df0-50cc-423e-aa8b-6134d9e6fc44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51] added
Aug 09 16:35:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdc4cf6-20d2-4b0e-9647-c69a0d0638b0]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ecd7b1-ff71-4a20-8cb0-9bdebfe4a533]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fhTeyGin {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fhTeyGin" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c901a03-a1b6-400a-b84f-f0ea64b92a93]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fhTeyGin'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[70baf879-eb07-40bb-804c-8bb29a0670d3]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7181d85b-c396-4ddf-afd4-5bf2392ec864]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)
Aug 09 16:35:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)
Aug 09 16:35:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[226f9311-12f4-45c4-a940-0a744dc2a128]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51, portal: 172.16.0.220,3260]
Aug 09 16:35:54 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51, portal: 172.16.0.220,3260] successful.
Aug 09 16:35:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dc01b0-8907-4d64-b203-153e2de0acca]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Acquiring lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:54 user nova-compute[73091]: INFO nova.compute.manager [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Detaching volume fd397f93-610f-4b6b-952d-fc70642b02fe
Aug 09 16:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e003c96-a93e-41ba-9911-11331d93df0c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)
Aug 09 16:35:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:54 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)
Aug 09 16:35:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a705f0e-7bc7-4a30-b26f-4abbb9426b89]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhTeyGin', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:35:54 user nova-compute[73091]: INFO nova.virt.block_device [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Attempting to driver detach volume fd397f93-610f-4b6b-952d-fc70642b02fe from mountpoint /dev/vdb
Aug 09 16:35:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Attempting to detach device vdb from instance 7bcc1e42-532f-4fb6-984e-cdf659cfef7c from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] detach device xml: <disk type="block" device="disk">
Aug 09 16:35:54 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:35:54 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 09 16:35:54 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:35:54 user nova-compute[73091]:   <serial>fd397f93-610f-4b6b-952d-fc70642b02fe</serial>
Aug 09 16:35:54 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:35:54 user nova-compute[73091]: </disk>
Aug 09 16:35:54 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:35:54 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Successfully detached device vdb from instance 7bcc1e42-532f-4fb6-984e-cdf659cfef7c from the persistent domain config.
Aug 09 16:35:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7bcc1e42-532f-4fb6-984e-cdf659cfef7c from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] detach device xml: <disk type="block" device="disk">
Aug 09 16:35:54 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:35:54 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 09 16:35:54 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:35:54 user nova-compute[73091]:   <serial>fd397f93-610f-4b6b-952d-fc70642b02fe</serial>
Aug 09 16:35:54 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:35:54 user nova-compute[73091]: </disk>
Aug 09 16:35:54 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] No VIF found with MAC fa:16:3e:fa:39:24, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6d45036e-c3ba-46ce-a0aa-99fae968ef46 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.896s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691598954.7582335, 7bcc1e42-532f-4fb6-984e-cdf659cfef7c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7bcc1e42-532f-4fb6-984e-cdf659cfef7c {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:35:54 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Successfully detached device vdb from instance 7bcc1e42-532f-4fb6-984e-cdf659cfef7c from the live domain config.
Aug 09 16:35:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:35:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHApdrlc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:35:54 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:35:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] <== connect_volume: return (2820ms) {'type': 'block', 'scsi_wwn': '23361666334343762', 'path': '/dev/sdj'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361666334343762', 'path': '/dev/sdj'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.629s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:35:55 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:35:55 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lazy-loading 'flavor' on Instance uuid b791bded-3eb5-4bf8-a14e-eae269ae2043 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15c70a8-bfaa-49e4-a87d-0c6c788c0a86]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:35:55 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:35:55 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:35:55 user nova-compute[73091]:   <source dev="/dev/sdj"/>
Aug 09 16:35:55 user nova-compute[73091]:   <target dev="sdc" bus="scsi"/>
Aug 09 16:35:55 user nova-compute[73091]:   <serial>07c30d93-8250-469a-8557-3a52a98e9b51</serial>
Aug 09 16:35:55 user nova-compute[73091]:   <address type="drive" controller="0" unit="2"/>
Aug 09 16:35:55 user nova-compute[73091]: </disk>
Aug 09 16:35:55 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9693d8-140e-4c54-9d55-38cf85749058]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626] added
Aug 09 16:35:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Acquiring lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.utils [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0cefa7-4c21-43ae-bc43-fa9d2103f691]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[891da7cc-bcd1-4e77-9fa6-5b3f66e66ce1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd01c94d-8271-4490-a9e0-3df388a4b4f3]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v paMtNDlc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cc41b9-0dbd-4587-b6d4-091cdf521dc0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v paMtNDlc" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[449ac8dc-b7c3-42ad-8d19-b5871f1f34f7]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f124d6f-bca2-4939-85ec-43a0ed931b05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'paMtNDlc'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a98ffe1-662f-4f32-b8d4-3148ebf02e0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[098dd3e3-6119-4286-ad2c-eda09ea6c8da]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:35:55 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dadd06-caa4-439b-bb56-b9ae88567127]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.utils [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f739a27c-767a-481a-8ea0-bf83575af84c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)
Aug 09 16:35:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)
Aug 09 16:35:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad3772c-fa94-454c-a12e-ac034ebbd4e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626, portal: 172.16.0.220,3260]
Aug 09 16:35:55 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626, portal: 172.16.0.220,3260] successful.
Aug 09 16:35:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:55 user nova-compute[73091]: INFO nova.compute.manager [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Swapping volume 6c311244-3b9e-4d97-b85a-c9b72f143e90 for b0edf64d-c049-4bac-ab0f-db636e4f4568
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc52926-5521-41e4-b7d4-4070b127854a]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6447626f-a570-40fd-8666-c477def8d116]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)
Aug 09 16:35:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:55 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)
Aug 09 16:35:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.417s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bffe5e-fd4e-4907-8751-dc07e320b811]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'paMtNDlc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] No BDM found with device name sda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] No VIF found with MAC fa:16:3e:8c:25:9d, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:35:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d76d6cb8-ca03-483a-8234-9139c389508b tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "b791bded-3eb5-4bf8-a14e-eae269ae2043" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.211s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.467s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] <== connect_volume: return (3097ms) {'type': 'block', 'scsi_wwn': '26439636665333536', 'path': '/dev/sdk'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439636665333536', 'path': '/dev/sdk'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.986s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lazy-loading 'flavor' on Instance uuid ec2187af-1b88-4c23-abba-2f09db3057d6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b83de89-6210-4f31-a4a3-635bc3689cf6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:35:56 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:35:56 user nova-compute[73091]:   <source dev="/dev/sdk"/>
Aug 09 16:35:56 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:35:56 user nova-compute[73091]:   <serial>7fbf81b6-11d5-447b-b5ef-246569cac626</serial>
Aug 09 16:35:56 user nova-compute[73091]: </disk>
Aug 09 16:35:56 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce26a043-a183-4884-af08-46722e271b97]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:35:56 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 (non-flash)
Aug 09 16:35:56 user nova-compute[73091]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 (non-flash)
Aug 09 16:35:56 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:56 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:56 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:56 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:56 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:56 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:56 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)
Aug 09 16:35:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:35:56 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 (non-flash)
Aug 09 16:35:56 user nova-compute[73091]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 (non-flash)
Aug 09 16:35:56 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:56 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:56 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:56 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:56 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:56 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:56 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe (non-flash)
Aug 09 16:35:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff060389d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe'): ({'sdf'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Removing single pathed devices sdf {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b284c9e-5bd8-40dc-ba61-6f376d54ab24]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[341bf4dd-fccb-408b-891e-9ef57ca2906c]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Flushing IO for device /dev/sdf {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d7925e-df43-4042-8425-28579759b028]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ce9b16-0cdb-44b6-b26e-bb4762fa0e36]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:35:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3948a6ad-4363-42dd-9df4-960b49e6f075]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e181bde-b194-455e-909d-af82a5bdf44c]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe, portal: 172.16.0.220,3260]
Aug 09 16:35:57 user nova-compute[73091]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe, portal: 172.16.0.220,3260] successful.
Aug 09 16:35:57 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd397f93-610f-4b6b-952d-fc70642b02fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[152dd799-eb86-43c4-a86c-b081800cb203]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] <== disconnect_volume: return (2396ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] No BDM found with device name hda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] No VIF found with MAC fa:16:3e:f3:65:dc, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f6c2fcf6-a39f-444b-b629-27b6b077d5e1 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.055s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Acquiring lock "b791bded-3eb5-4bf8-a14e-eae269ae2043" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "b791bded-3eb5-4bf8-a14e-eae269ae2043" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:57 user nova-compute[73091]: INFO nova.compute.manager [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Detaching volume 07c30d93-8250-469a-8557-3a52a98e9b51
Aug 09 16:35:57 user nova-compute[73091]: INFO nova.virt.block_device [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Attempting to driver detach volume 07c30d93-8250-469a-8557-3a52a98e9b51 from mountpoint /dev/sdc
Aug 09 16:35:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Attempting to detach device sdc from instance b791bded-3eb5-4bf8-a14e-eae269ae2043 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:35:57 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:35:57 user nova-compute[73091]:   <source dev="/dev/sdj"/>
Aug 09 16:35:57 user nova-compute[73091]:   <target dev="sdc" bus="scsi"/>
Aug 09 16:35:57 user nova-compute[73091]:   <serial>07c30d93-8250-469a-8557-3a52a98e9b51</serial>
Aug 09 16:35:57 user nova-compute[73091]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 09 16:35:57 user nova-compute[73091]: </disk>
Aug 09 16:35:57 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:35:57 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Successfully detached device sdc from instance b791bded-3eb5-4bf8-a14e-eae269ae2043 from the persistent domain config.
Aug 09 16:35:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance b791bded-3eb5-4bf8-a14e-eae269ae2043 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:35:57 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:35:57 user nova-compute[73091]:   <source dev="/dev/sdj"/>
Aug 09 16:35:57 user nova-compute[73091]:   <target dev="sdc" bus="scsi"/>
Aug 09 16:35:57 user nova-compute[73091]:   <serial>07c30d93-8250-469a-8557-3a52a98e9b51</serial>
Aug 09 16:35:57 user nova-compute[73091]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 09 16:35:57 user nova-compute[73091]: </disk>
Aug 09 16:35:57 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:35:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Lazy-loading 'flavor' on Instance uuid 7bcc1e42-532f-4fb6-984e-cdf659cfef7c {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691598958.1462514, b791bded-3eb5-4bf8-a14e-eae269ae2043 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance b791bded-3eb5-4bf8-a14e-eae269ae2043 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:35:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Successfully detached device sdc from instance b791bded-3eb5-4bf8-a14e-eae269ae2043 from the live domain config.
Aug 09 16:35:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhTeyGin', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:35:58 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:35:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e367876-23fb-48de-94a4-c43a16afb5d1 tempest-VolumesAssistedSnapshotsTest-611166175 tempest-VolumesAssistedSnapshotsTest-611166175-project-admin] Lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.958s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab3f46a-97e6-417a-837b-cdc0573b42e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c78f35-8478-44d0-9f1f-91133438e9ba]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:35:58 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 (non-flash)
Aug 09 16:35:58 user nova-compute[73091]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 (non-flash)
Aug 09 16:35:58 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:58 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:58 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:58 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:58 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:58 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:35:58 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 (non-flash)
Aug 09 16:35:58 user nova-compute[73091]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 (non-flash)
Aug 09 16:35:58 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:58 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:58 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:58 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:58 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:58 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff06032f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51'): ({'sdj'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Removing single pathed devices sdj {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[af56f3b8-a4f2-4e71-81ca-7adbafc454aa]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[74730137-31c6-4bbf-98d3-10978e48efb0]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Flushing IO for device /dev/sdj {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc63aef-41ad-4de1-9533-9064c5dab5c7]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.044s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[13db42f1-c088-4aa5-9dec-c1182f442eb3]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] SCSI volumes sdj have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dd42c1-22de-4c33-b6ac-4f7dbf74ffba]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bb0fc9-b8ba-40ee-bba0-b36c44e72211]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51, portal: 172.16.0.220,3260]
Aug 09 16:35:58 user nova-compute[73091]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51, portal: 172.16.0.220,3260] successful.
Aug 09 16:35:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07c30d93-8250-469a-8557-3a52a98e9b51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[89696978-1e3e-4d47-861e-1279fc64297c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] <== disconnect_volume: return (371ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquiring lock "ec2187af-1b88-4c23-abba-2f09db3057d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:35:58 user nova-compute[73091]: INFO nova.compute.manager [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Detaching volume 7fbf81b6-11d5-447b-b5ef-246569cac626
Aug 09 16:35:58 user nova-compute[73091]: INFO nova.virt.block_device [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Attempting to driver detach volume 7fbf81b6-11d5-447b-b5ef-246569cac626 from mountpoint /dev/vdb
Aug 09 16:35:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Attempting to detach device vdb from instance ec2187af-1b88-4c23-abba-2f09db3057d6 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:35:58 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:35:58 user nova-compute[73091]:   <source dev="/dev/sdk"/>
Aug 09 16:35:58 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:35:58 user nova-compute[73091]:   <serial>7fbf81b6-11d5-447b-b5ef-246569cac626</serial>
Aug 09 16:35:58 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 16:35:58 user nova-compute[73091]: </disk>
Aug 09 16:35:58 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:35:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Successfully detached device vdb from instance ec2187af-1b88-4c23-abba-2f09db3057d6 from the persistent domain config.
Aug 09 16:35:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ec2187af-1b88-4c23-abba-2f09db3057d6 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:35:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:35:58 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:35:58 user nova-compute[73091]:   <source dev="/dev/sdk"/>
Aug 09 16:35:58 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:35:58 user nova-compute[73091]:   <serial>7fbf81b6-11d5-447b-b5ef-246569cac626</serial>
Aug 09 16:35:58 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 16:35:58 user nova-compute[73091]: </disk>
Aug 09 16:35:58 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG nova.objects.instance [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lazy-loading 'flavor' on Instance uuid b791bded-3eb5-4bf8-a14e-eae269ae2043 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9eff2069-4ec8-4fb6-aa1d-5273a403e4e1 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "b791bded-3eb5-4bf8-a14e-eae269ae2043" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.970s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691598959.5521407, ec2187af-1b88-4c23-abba-2f09db3057d6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ec2187af-1b88-4c23-abba-2f09db3057d6 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:35:59 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Successfully detached device vdb from instance ec2187af-1b88-4c23-abba-2f09db3057d6 from the live domain config.
Aug 09 16:35:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'paMtNDlc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:35:59 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:35:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dff655-c911-4b52-ac31-c0ffc1f963a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b166ae45-da8d-464a-8371-06ae264923e6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:35:59 user nova-compute[73091]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 (non-flash)
Aug 09 16:35:59 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:59 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:59 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:59 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:59 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:59 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:35:59 user nova-compute[73091]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 (non-flash)
Aug 09 16:35:59 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:35:59 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:35:59 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:35:59 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:35:59 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:35:59 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:35:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff08041ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626'): ({'sdk'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Removing single pathed devices sdk {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a41570-7b78-4ec4-9ded-763b29f34073]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2979b3f3-ba39-4755-a529-2e4403ebdacf]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Flushing IO for device /dev/sdk {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[599bef10-983c-4165-bea7-3abbbbc0ef34]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.037s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bfa041-241f-4e5c-94b2-5a8c41d7ed43]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] SCSI volumes sdk have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd51bab-ce5c-4934-9ade-3b8cc60a0601]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bbb1f7-b14c-43c7-84b3-1f5bd400d270]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626, portal: 172.16.0.220,3260]
Aug 09 16:35:59 user nova-compute[73091]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626, portal: 172.16.0.220,3260] successful.
Aug 09 16:35:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fbf81b6-11d5-447b-b5ef-246569cac626 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[569ae8d0-b2e3-46c2-8666-7c585937592c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] <== disconnect_volume: return (331ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:35:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Skipping network cache update for instance because it has been migrated to another host. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 09 16:36:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-7bcc1e42-532f-4fb6-984e-cdf659cfef7c" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:36:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-7bcc1e42-532f-4fb6-984e-cdf659cfef7c" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:36:00 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:36:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Acquiring lock "b791bded-3eb5-4bf8-a14e-eae269ae2043" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "b791bded-3eb5-4bf8-a14e-eae269ae2043" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Acquiring lock "b791bded-3eb5-4bf8-a14e-eae269ae2043-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "b791bded-3eb5-4bf8-a14e-eae269ae2043-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "b791bded-3eb5-4bf8-a14e-eae269ae2043-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:00 user nova-compute[73091]: INFO nova.compute.manager [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Terminating instance
Aug 09 16:36:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:36:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:00 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lazy-loading 'flavor' on Instance uuid ec2187af-1b88-4c23-abba-2f09db3057d6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:36:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7d23b002-a0dd-4723-b888-cdb2a29434cf tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.038s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:00 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Updating instance_info_cache with network_info: [{"id": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "address": "fa:16:3e:11:4b:40", "network": {"id": "4ec80c56-7d1a-4fbe-81a2-7d12e69c94e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5225565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d63eb933f4d40cdb34d3a27c76c9720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d2e6e-6d", "ovs_interfaceid": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:36:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-7bcc1e42-532f-4fb6-984e-cdf659cfef7c" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:36:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:36:00 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-6e2b6730-ddd3-4094-9d47-5992b483559a req-b8e23b25-4a38-4357-a52a-4617e34de527 service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Received event network-vif-unplugged-d368f4bb-4681-4152-b639-3be5601c73b9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6e2b6730-ddd3-4094-9d47-5992b483559a req-b8e23b25-4a38-4357-a52a-4617e34de527 service nova] Acquiring lock "b791bded-3eb5-4bf8-a14e-eae269ae2043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6e2b6730-ddd3-4094-9d47-5992b483559a req-b8e23b25-4a38-4357-a52a-4617e34de527 service nova] Lock "b791bded-3eb5-4bf8-a14e-eae269ae2043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6e2b6730-ddd3-4094-9d47-5992b483559a req-b8e23b25-4a38-4357-a52a-4617e34de527 service nova] Lock "b791bded-3eb5-4bf8-a14e-eae269ae2043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-6e2b6730-ddd3-4094-9d47-5992b483559a req-b8e23b25-4a38-4357-a52a-4617e34de527 service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] No waiting events found dispatching network-vif-unplugged-d368f4bb-4681-4152-b639-3be5601c73b9 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-6e2b6730-ddd3-4094-9d47-5992b483559a req-b8e23b25-4a38-4357-a52a-4617e34de527 service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Received event network-vif-unplugged-d368f4bb-4681-4152-b639-3be5601c73b9 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:36:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Instance destroyed successfully.
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lazy-loading 'resources' on Instance uuid b791bded-3eb5-4bf8-a14e-eae269ae2043 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:33:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-546596736',display_name='tempest-AttachSCSIVolumeTestJSON-server-546596736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-546596736',id=5,image_ref='c965e1a3-11e6-4bd9-aeec-2895d651c85f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgjvs5xoAjoaV9QOLh1ZIEL6rn1q791A4u12WEh4x7I+6m7+bo8e97IPtgmDCfyJUMD1oEL3ZBw6EWmi6Piovl3eBwkbALerIWZWni2x2r7gmcJLseLnvlbOFysVwQJ0w==',key_name='tempest-keypair-1544024463',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:33:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea346b28dbcf4ba6b8de576c3326328e',ramdisk_id='',reservation_id='r-7izc9bze',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c965e1a3-11e6-4bd9-aeec-2895d651c85f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1618710579',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1618710579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:33:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19667f77ab164d97851ee7a334141bf5',uuid=b791bded-3eb5-4bf8-a14e-eae269ae2043,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d368f4bb-4681-4152-b639-3be5601c73b9", "address": "fa:16:3e:8c:25:9d", "network": {"id": "9d0306b7-548e-47e5-b869-9d479e62278a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-633341944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea346b28dbcf4ba6b8de576c3326328e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd368f4bb-46", "ovs_interfaceid": "d368f4bb-4681-4152-b639-3be5601c73b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Converting VIF {"id": "d368f4bb-4681-4152-b639-3be5601c73b9", "address": "fa:16:3e:8c:25:9d", "network": {"id": "9d0306b7-548e-47e5-b869-9d479e62278a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-633341944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea346b28dbcf4ba6b8de576c3326328e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd368f4bb-46", "ovs_interfaceid": "d368f4bb-4681-4152-b639-3be5601c73b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:25:9d,bridge_name='br-int',has_traffic_filtering=True,id=d368f4bb-4681-4152-b639-3be5601c73b9,network=Network(9d0306b7-548e-47e5-b869-9d479e62278a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd368f4bb-46') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG os_vif [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:25:9d,bridge_name='br-int',has_traffic_filtering=True,id=d368f4bb-4681-4152-b639-3be5601c73b9,network=Network(9d0306b7-548e-47e5-b869-9d479e62278a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd368f4bb-46') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd368f4bb-46, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquiring lock "interface-ec2187af-1b88-4c23-abba-2f09db3057d6-6415d3ca-e310-4a5f-bce7-daef45247643" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "interface-ec2187af-1b88-4c23-abba-2f09db3057d6-6415d3ca-e310-4a5f-bce7-daef45247643" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:36:01 user nova-compute[73091]: INFO os_vif [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:25:9d,bridge_name='br-int',has_traffic_filtering=True,id=d368f4bb-4681-4152-b639-3be5601c73b9,network=Network(9d0306b7-548e-47e5-b869-9d479e62278a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd368f4bb-46')
Aug 09 16:36:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Deleting instance files /opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043_del
Aug 09 16:36:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Deletion of /opt/stack/data/nova/instances/b791bded-3eb5-4bf8-a14e-eae269ae2043_del complete
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lazy-loading 'flavor' on Instance uuid ec2187af-1b88-4c23-abba-2f09db3057d6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:33:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-232794309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-232794309',id=6,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKvUekvW9eV5PNFmOyGiNtiOlJk5szt6jF7Nn2Cjo8H7lw7fn57Jt1UoYyP8a1MRbAqNPdKj8VAN21vacR3qFtYUOYtrJGDNRvt4Yzt0u8rIA+SenASC0Z9S6AJgV5gFw==',key_name='tempest-keypair-1792812162',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:33:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3ef9b2241b143deb605e774ce34998e',ramdisk_id='',reservation_id='r-yr1ytpcl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-357169138',owner_user_name='tempest-TaggedAttachmentsTest-357169138-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc4caea945424320a1b8ed52721c0ccf',uuid=ec2187af-1b88-4c23-abba-2f09db3057d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6415d3ca-e310-4a5f-bce7-daef45247643", "address": "fa:16:3e:9f:13:67", "network": {"id": "253a307f-589a-4828-90e2-b4db1ddad191", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159303419", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6415d3ca-e3", "ovs_interfaceid": "6415d3ca-e310-4a5f-bce7-daef45247643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Converting VIF {"id": "6415d3ca-e310-4a5f-bce7-daef45247643", "address": "fa:16:3e:9f:13:67", "network": {"id": "253a307f-589a-4828-90e2-b4db1ddad191", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159303419", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6415d3ca-e3", "ovs_interfaceid": "6415d3ca-e310-4a5f-bce7-daef45247643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:13:67,bridge_name='br-int',has_traffic_filtering=True,id=6415d3ca-e310-4a5f-bce7-daef45247643,network=Network(253a307f-589a-4828-90e2-b4db1ddad191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6415d3ca-e3') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9f:13:67"/><model type="virtio"/><mtu size="1442"/><target dev="tap6415d3ca-e3"/></interface> {{(pid=73091) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9f:13:67"/><model type="virtio"/><mtu size="1442"/><target dev="tap6415d3ca-e3"/></interface> {{(pid=73091) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Attempting to detach device tap6415d3ca-e3 from instance ec2187af-1b88-4c23-abba-2f09db3057d6 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] detach device xml: <interface type="ethernet">
Aug 09 16:36:01 user nova-compute[73091]:   <mac address="fa:16:3e:9f:13:67"/>
Aug 09 16:36:01 user nova-compute[73091]:   <model type="virtio"/>
Aug 09 16:36:01 user nova-compute[73091]:   <mtu size="1442"/>
Aug 09 16:36:01 user nova-compute[73091]:   <target dev="tap6415d3ca-e3"/>
Aug 09 16:36:01 user nova-compute[73091]: </interface>
Aug 09 16:36:01 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9f:13:67"/><model type="virtio"/><mtu size="1442"/><target dev="tap6415d3ca-e3"/></interface> {{(pid=73091) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9f:13:67"/><model type="virtio"/><mtu size="1442"/><target dev="tap6415d3ca-e3"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 09 16:36:01 user nova-compute[73091]:   <name>instance-00000006</name>
Aug 09 16:36:01 user nova-compute[73091]:   <uuid>ec2187af-1b88-4c23-abba-2f09db3057d6</uuid>
Aug 09 16:36:01 user nova-compute[73091]:   <metadata>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:36:01 user nova-compute[73091]:   <nova:package version="0.0.0"/>
Aug 09 16:36:01 user nova-compute[73091]:   <nova:name>tempest-device-tagging-server-232794309</nova:name>
Aug 09 16:36:01 user nova-compute[73091]:   <nova:creationTime>2023-08-09 16:35:42</nova:creationTime>
Aug 09 16:36:01 user nova-compute[73091]:   <nova:flavor name="m1.tiny">
Aug 09 16:36:01 user nova-compute[73091]:     <nova:memory>512</nova:memory>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:disk>1</nova:disk>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:swap>0</nova:swap>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:vcpus>1</nova:vcpus>
Aug 09 16:36:01 user nova-compute[73091]:   </nova:flavor>
Aug 09 16:36:01 user nova-compute[73091]:   <nova:owner>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:user uuid="bc4caea945424320a1b8ed52721c0ccf">tempest-TaggedAttachmentsTest-357169138-project-member</nova:user>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:project uuid="a3ef9b2241b143deb605e774ce34998e">tempest-TaggedAttachmentsTest-357169138</nova:project>
Aug 09 16:36:01 user nova-compute[73091]:   </nova:owner>
Aug 09 16:36:01 user nova-compute[73091]:   <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:36:01 user nova-compute[73091]:   <nova:ports>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:port uuid="416fe3a2-a0ea-4c8e-81c6-7374e6205456">
Aug 09 16:36:01 user nova-compute[73091]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 16:36:01 user nova-compute[73091]:     </nova:port>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:port uuid="6415d3ca-e310-4a5f-bce7-daef45247643">
Aug 09 16:36:01 user nova-compute[73091]:       <nova:ip type="fixed" address="10.10.10.241" ipVersion="4"/>
Aug 09 16:36:01 user nova-compute[73091]:     </nova:port>
Aug 09 16:36:01 user nova-compute[73091]:   </nova:ports>
Aug 09 16:36:01 user nova-compute[73091]: </nova:instance>
Aug 09 16:36:01 user nova-compute[73091]:   </metadata>
Aug 09 16:36:01 user nova-compute[73091]:   <memory unit='KiB'>524288</memory>
Aug 09 16:36:01 user nova-compute[73091]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 16:36:01 user nova-compute[73091]:   <vcpu placement='static'>1</vcpu>
Aug 09 16:36:01 user nova-compute[73091]:   <resource>
Aug 09 16:36:01 user nova-compute[73091]:     <partition>/machine</partition>
Aug 09 16:36:01 user nova-compute[73091]:   </resource>
Aug 09 16:36:01 user nova-compute[73091]:   <sysinfo type='smbios'>
Aug 09 16:36:01 user nova-compute[73091]:     <system>
Aug 09 16:36:01 user nova-compute[73091]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 16:36:01 user nova-compute[73091]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 16:36:01 user nova-compute[73091]:       <entry name='version'>0.0.0</entry>
Aug 09 16:36:01 user nova-compute[73091]:       <entry name='serial'>ec2187af-1b88-4c23-abba-2f09db3057d6</entry>
Aug 09 16:36:01 user nova-compute[73091]:       <entry name='uuid'>ec2187af-1b88-4c23-abba-2f09db3057d6</entry>
Aug 09 16:36:01 user nova-compute[73091]:       <entry name='family'>Virtual Machine</entry>
Aug 09 16:36:01 user nova-compute[73091]:     </system>
Aug 09 16:36:01 user nova-compute[73091]:   </sysinfo>
Aug 09 16:36:01 user nova-compute[73091]:   <os>
Aug 09 16:36:01 user nova-compute[73091]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 16:36:01 user nova-compute[73091]:     <boot dev='hd'/>
Aug 09 16:36:01 user nova-compute[73091]:     <smbios mode='sysinfo'/>
Aug 09 16:36:01 user nova-compute[73091]:   </os>
Aug 09 16:36:01 user nova-compute[73091]:   <features>
Aug 09 16:36:01 user nova-compute[73091]:     <acpi/>
Aug 09 16:36:01 user nova-compute[73091]:     <apic/>
Aug 09 16:36:01 user nova-compute[73091]:     <vmcoreinfo state='on'/>
Aug 09 16:36:01 user nova-compute[73091]:   </features>
Aug 09 16:36:01 user nova-compute[73091]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 16:36:01 user nova-compute[73091]:     <model fallback='forbid'>Nehalem</model>
Aug 09 16:36:01 user nova-compute[73091]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 16:36:01 user nova-compute[73091]:     <feature policy='require' name='vme'/>
Aug 09 16:36:01 user nova-compute[73091]:     <feature policy='require' name='x2apic'/>
Aug 09 16:36:01 user nova-compute[73091]:     <feature policy='require' name='hypervisor'/>
Aug 09 16:36:01 user nova-compute[73091]:   </cpu>
Aug 09 16:36:01 user nova-compute[73091]:   <clock offset='utc'>
Aug 09 16:36:01 user nova-compute[73091]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 16:36:01 user nova-compute[73091]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 16:36:01 user nova-compute[73091]:     <timer name='hpet' present='no'/>
Aug 09 16:36:01 user nova-compute[73091]:   </clock>
Aug 09 16:36:01 user nova-compute[73091]:   <on_poweroff>destroy</on_poweroff>
Aug 09 16:36:01 user nova-compute[73091]:   <on_reboot>restart</on_reboot>
Aug 09 16:36:01 user nova-compute[73091]:   <on_crash>destroy</on_crash>
Aug 09 16:36:01 user nova-compute[73091]:   <devices>
Aug 09 16:36:01 user nova-compute[73091]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 16:36:01 user nova-compute[73091]:     <disk type='file' device='disk'>
Aug 09 16:36:01 user nova-compute[73091]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 16:36:01 user nova-compute[73091]:       <source file='/opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk' index='2'/>
Aug 09 16:36:01 user nova-compute[73091]:       <backingStore type='file' index='3'>
Aug 09 16:36:01 user nova-compute[73091]:         <format type='raw'/>
Aug 09 16:36:01 user nova-compute[73091]:         <source file='/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff'/>
Aug 09 16:36:01 user nova-compute[73091]:         <backingStore/>
Aug 09 16:36:01 user nova-compute[73091]:       </backingStore>
Aug 09 16:36:01 user nova-compute[73091]:       <target dev='vda' bus='virtio'/>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='virtio-disk0'/>
Aug 09 16:36:01 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </disk>
Aug 09 16:36:01 user nova-compute[73091]:     <disk type='file' device='cdrom'>
Aug 09 16:36:01 user nova-compute[73091]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 16:36:01 user nova-compute[73091]:       <source file='/opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk.config' index='1'/>
Aug 09 16:36:01 user nova-compute[73091]:       <backingStore/>
Aug 09 16:36:01 user nova-compute[73091]:       <target dev='hda' bus='ide'/>
Aug 09 16:36:01 user nova-compute[73091]:       <readonly/>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='ide0-0-0'/>
Aug 09 16:36:01 user nova-compute[73091]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </disk>
Aug 09 16:36:01 user nova-compute[73091]:     <controller type='usb' index='0' model='none'>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='usb'/>
Aug 09 16:36:01 user nova-compute[73091]:     </controller>
Aug 09 16:36:01 user nova-compute[73091]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='pci.0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </controller>
Aug 09 16:36:01 user nova-compute[73091]:     <controller type='ide' index='0'>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='ide'/>
Aug 09 16:36:01 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 16:36:01 user nova-compute[73091]:     </controller>
Aug 09 16:36:01 user nova-compute[73091]:     <interface type='ethernet'>
Aug 09 16:36:01 user nova-compute[73091]:       <mac address='fa:16:3e:f3:65:dc'/>
Aug 09 16:36:01 user nova-compute[73091]:       <target dev='tap416fe3a2-a0'/>
Aug 09 16:36:01 user nova-compute[73091]:       <model type='virtio'/>
Aug 09 16:36:01 user nova-compute[73091]:       <mtu size='1442'/>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='net0'/>
Aug 09 16:36:01 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </interface>
Aug 09 16:36:01 user nova-compute[73091]:     <interface type='ethernet'>
Aug 09 16:36:01 user nova-compute[73091]:       <mac address='fa:16:3e:9f:13:67'/>
Aug 09 16:36:01 user nova-compute[73091]:       <target dev='tap6415d3ca-e3'/>
Aug 09 16:36:01 user nova-compute[73091]:       <model type='virtio'/>
Aug 09 16:36:01 user nova-compute[73091]:       <mtu size='1442'/>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='net1'/>
Aug 09 16:36:01 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </interface>
Aug 09 16:36:01 user nova-compute[73091]:     <serial type='pty'>
Aug 09 16:36:01 user nova-compute[73091]:       <source path='/dev/pts/5'/>
Aug 09 16:36:01 user nova-compute[73091]:       <log file='/opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/console.log' append='off'/>
Aug 09 16:36:01 user nova-compute[73091]:       <target type='isa-serial' port='0'>
Aug 09 16:36:01 user nova-compute[73091]:         <model name='isa-serial'/>
Aug 09 16:36:01 user nova-compute[73091]:       </target>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='serial0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </serial>
Aug 09 16:36:01 user nova-compute[73091]:     <console type='pty' tty='/dev/pts/5'>
Aug 09 16:36:01 user nova-compute[73091]:       <source path='/dev/pts/5'/>
Aug 09 16:36:01 user nova-compute[73091]:       <log file='/opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/console.log' append='off'/>
Aug 09 16:36:01 user nova-compute[73091]:       <target type='serial' port='0'/>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='serial0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </console>
Aug 09 16:36:01 user nova-compute[73091]:     <input type='mouse' bus='ps2'>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='input0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </input>
Aug 09 16:36:01 user nova-compute[73091]:     <input type='keyboard' bus='ps2'>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='input1'/>
Aug 09 16:36:01 user nova-compute[73091]:     </input>
Aug 09 16:36:01 user nova-compute[73091]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 09 16:36:01 user nova-compute[73091]:       <listen type='address' address='0.0.0.0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </graphics>
Aug 09 16:36:01 user nova-compute[73091]:     <audio id='1' type='none'/>
Aug 09 16:36:01 user nova-compute[73091]:     <video>
Aug 09 16:36:01 user nova-compute[73091]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='video0'/>
Aug 09 16:36:01 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </video>
Aug 09 16:36:01 user nova-compute[73091]:     <memballoon model='virtio'>
Aug 09 16:36:01 user nova-compute[73091]:       <stats period='10'/>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='balloon0'/>
Aug 09 16:36:01 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </memballoon>
Aug 09 16:36:01 user nova-compute[73091]:     <rng model='virtio'>
Aug 09 16:36:01 user nova-compute[73091]:       <backend model='random'>/dev/urandom</backend>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='rng0'/>
Aug 09 16:36:01 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </rng>
Aug 09 16:36:01 user nova-compute[73091]:   </devices>
Aug 09 16:36:01 user nova-compute[73091]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 16:36:01 user nova-compute[73091]:     <label>libvirt-ec2187af-1b88-4c23-abba-2f09db3057d6</label>
Aug 09 16:36:01 user nova-compute[73091]:     <imagelabel>libvirt-ec2187af-1b88-4c23-abba-2f09db3057d6</imagelabel>
Aug 09 16:36:01 user nova-compute[73091]:   </seclabel>
Aug 09 16:36:01 user nova-compute[73091]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 16:36:01 user nova-compute[73091]:     <label>+64055:+108</label>
Aug 09 16:36:01 user nova-compute[73091]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 16:36:01 user nova-compute[73091]:   </seclabel>
Aug 09 16:36:01 user nova-compute[73091]: </domain>
Aug 09 16:36:01 user nova-compute[73091]:  {{(pid=73091) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 16:36:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Successfully detached device tap6415d3ca-e3 from instance ec2187af-1b88-4c23-abba-2f09db3057d6 from the persistent domain config.
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] (1/8): Attempting to detach device tap6415d3ca-e3 with device alias net1 from instance ec2187af-1b88-4c23-abba-2f09db3057d6 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] detach device xml: <interface type="ethernet">
Aug 09 16:36:01 user nova-compute[73091]:   <mac address="fa:16:3e:9f:13:67"/>
Aug 09 16:36:01 user nova-compute[73091]:   <model type="virtio"/>
Aug 09 16:36:01 user nova-compute[73091]:   <mtu size="1442"/>
Aug 09 16:36:01 user nova-compute[73091]:   <target dev="tap6415d3ca-e3"/>
Aug 09 16:36:01 user nova-compute[73091]: </interface>
Aug 09 16:36:01 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:36:01 user nova-compute[73091]: INFO nova.compute.manager [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 09 16:36:01 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691598961.6018462, ec2187af-1b88-4c23-abba-2f09db3057d6 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Start waiting for the detach event from libvirt for device tap6415d3ca-e3 with device alias net1 for instance ec2187af-1b88-4c23-abba-2f09db3057d6 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9f:13:67"/><model type="virtio"/><mtu size="1442"/><target dev="tap6415d3ca-e3"/></interface> {{(pid=73091) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9f:13:67"/><model type="virtio"/><mtu size="1442"/><target dev="tap6415d3ca-e3"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 09 16:36:01 user nova-compute[73091]:   <name>instance-00000006</name>
Aug 09 16:36:01 user nova-compute[73091]:   <uuid>ec2187af-1b88-4c23-abba-2f09db3057d6</uuid>
Aug 09 16:36:01 user nova-compute[73091]:   <metadata>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:36:01 user nova-compute[73091]:   <nova:package version="0.0.0"/>
Aug 09 16:36:01 user nova-compute[73091]:   <nova:name>tempest-device-tagging-server-232794309</nova:name>
Aug 09 16:36:01 user nova-compute[73091]:   <nova:creationTime>2023-08-09 16:35:42</nova:creationTime>
Aug 09 16:36:01 user nova-compute[73091]:   <nova:flavor name="m1.tiny">
Aug 09 16:36:01 user nova-compute[73091]:     <nova:memory>512</nova:memory>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:disk>1</nova:disk>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:swap>0</nova:swap>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:vcpus>1</nova:vcpus>
Aug 09 16:36:01 user nova-compute[73091]:   </nova:flavor>
Aug 09 16:36:01 user nova-compute[73091]:   <nova:owner>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:user uuid="bc4caea945424320a1b8ed52721c0ccf">tempest-TaggedAttachmentsTest-357169138-project-member</nova:user>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:project uuid="a3ef9b2241b143deb605e774ce34998e">tempest-TaggedAttachmentsTest-357169138</nova:project>
Aug 09 16:36:01 user nova-compute[73091]:   </nova:owner>
Aug 09 16:36:01 user nova-compute[73091]:   <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:36:01 user nova-compute[73091]:   <nova:ports>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:port uuid="416fe3a2-a0ea-4c8e-81c6-7374e6205456">
Aug 09 16:36:01 user nova-compute[73091]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 16:36:01 user nova-compute[73091]:     </nova:port>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:port uuid="6415d3ca-e310-4a5f-bce7-daef45247643">
Aug 09 16:36:01 user nova-compute[73091]:       <nova:ip type="fixed" address="10.10.10.241" ipVersion="4"/>
Aug 09 16:36:01 user nova-compute[73091]:     </nova:port>
Aug 09 16:36:01 user nova-compute[73091]:   </nova:ports>
Aug 09 16:36:01 user nova-compute[73091]: </nova:instance>
Aug 09 16:36:01 user nova-compute[73091]:   </metadata>
Aug 09 16:36:01 user nova-compute[73091]:   <memory unit='KiB'>524288</memory>
Aug 09 16:36:01 user nova-compute[73091]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 16:36:01 user nova-compute[73091]:   <vcpu placement='static'>1</vcpu>
Aug 09 16:36:01 user nova-compute[73091]:   <resource>
Aug 09 16:36:01 user nova-compute[73091]:     <partition>/machine</partition>
Aug 09 16:36:01 user nova-compute[73091]:   </resource>
Aug 09 16:36:01 user nova-compute[73091]:   <sysinfo type='smbios'>
Aug 09 16:36:01 user nova-compute[73091]:     <system>
Aug 09 16:36:01 user nova-compute[73091]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 16:36:01 user nova-compute[73091]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 16:36:01 user nova-compute[73091]:       <entry name='version'>0.0.0</entry>
Aug 09 16:36:01 user nova-compute[73091]:       <entry name='serial'>ec2187af-1b88-4c23-abba-2f09db3057d6</entry>
Aug 09 16:36:01 user nova-compute[73091]:       <entry name='uuid'>ec2187af-1b88-4c23-abba-2f09db3057d6</entry>
Aug 09 16:36:01 user nova-compute[73091]:       <entry name='family'>Virtual Machine</entry>
Aug 09 16:36:01 user nova-compute[73091]:     </system>
Aug 09 16:36:01 user nova-compute[73091]:   </sysinfo>
Aug 09 16:36:01 user nova-compute[73091]:   <os>
Aug 09 16:36:01 user nova-compute[73091]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 16:36:01 user nova-compute[73091]:     <boot dev='hd'/>
Aug 09 16:36:01 user nova-compute[73091]:     <smbios mode='sysinfo'/>
Aug 09 16:36:01 user nova-compute[73091]:   </os>
Aug 09 16:36:01 user nova-compute[73091]:   <features>
Aug 09 16:36:01 user nova-compute[73091]:     <acpi/>
Aug 09 16:36:01 user nova-compute[73091]:     <apic/>
Aug 09 16:36:01 user nova-compute[73091]:     <vmcoreinfo state='on'/>
Aug 09 16:36:01 user nova-compute[73091]:   </features>
Aug 09 16:36:01 user nova-compute[73091]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 16:36:01 user nova-compute[73091]:     <model fallback='forbid'>Nehalem</model>
Aug 09 16:36:01 user nova-compute[73091]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 16:36:01 user nova-compute[73091]:     <feature policy='require' name='vme'/>
Aug 09 16:36:01 user nova-compute[73091]:     <feature policy='require' name='x2apic'/>
Aug 09 16:36:01 user nova-compute[73091]:     <feature policy='require' name='hypervisor'/>
Aug 09 16:36:01 user nova-compute[73091]:   </cpu>
Aug 09 16:36:01 user nova-compute[73091]:   <clock offset='utc'>
Aug 09 16:36:01 user nova-compute[73091]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 16:36:01 user nova-compute[73091]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 16:36:01 user nova-compute[73091]:     <timer name='hpet' present='no'/>
Aug 09 16:36:01 user nova-compute[73091]:   </clock>
Aug 09 16:36:01 user nova-compute[73091]:   <on_poweroff>destroy</on_poweroff>
Aug 09 16:36:01 user nova-compute[73091]:   <on_reboot>restart</on_reboot>
Aug 09 16:36:01 user nova-compute[73091]:   <on_crash>destroy</on_crash>
Aug 09 16:36:01 user nova-compute[73091]:   <devices>
Aug 09 16:36:01 user nova-compute[73091]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 16:36:01 user nova-compute[73091]:     <disk type='file' device='disk'>
Aug 09 16:36:01 user nova-compute[73091]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 16:36:01 user nova-compute[73091]:       <source file='/opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk' index='2'/>
Aug 09 16:36:01 user nova-compute[73091]:       <backingStore type='file' index='3'>
Aug 09 16:36:01 user nova-compute[73091]:         <format type='raw'/>
Aug 09 16:36:01 user nova-compute[73091]:         <source file='/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff'/>
Aug 09 16:36:01 user nova-compute[73091]:         <backingStore/>
Aug 09 16:36:01 user nova-compute[73091]:       </backingStore>
Aug 09 16:36:01 user nova-compute[73091]:       <target dev='vda' bus='virtio'/>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='virtio-disk0'/>
Aug 09 16:36:01 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </disk>
Aug 09 16:36:01 user nova-compute[73091]:     <disk type='file' device='cdrom'>
Aug 09 16:36:01 user nova-compute[73091]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 16:36:01 user nova-compute[73091]:       <source file='/opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk.config' index='1'/>
Aug 09 16:36:01 user nova-compute[73091]:       <backingStore/>
Aug 09 16:36:01 user nova-compute[73091]:       <target dev='hda' bus='ide'/>
Aug 09 16:36:01 user nova-compute[73091]:       <readonly/>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='ide0-0-0'/>
Aug 09 16:36:01 user nova-compute[73091]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </disk>
Aug 09 16:36:01 user nova-compute[73091]:     <controller type='usb' index='0' model='none'>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='usb'/>
Aug 09 16:36:01 user nova-compute[73091]:     </controller>
Aug 09 16:36:01 user nova-compute[73091]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='pci.0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </controller>
Aug 09 16:36:01 user nova-compute[73091]:     <controller type='ide' index='0'>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='ide'/>
Aug 09 16:36:01 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 16:36:01 user nova-compute[73091]:     </controller>
Aug 09 16:36:01 user nova-compute[73091]:     <interface type='ethernet'>
Aug 09 16:36:01 user nova-compute[73091]:       <mac address='fa:16:3e:f3:65:dc'/>
Aug 09 16:36:01 user nova-compute[73091]:       <target dev='tap416fe3a2-a0'/>
Aug 09 16:36:01 user nova-compute[73091]:       <model type='virtio'/>
Aug 09 16:36:01 user nova-compute[73091]:       <mtu size='1442'/>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='net0'/>
Aug 09 16:36:01 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </interface>
Aug 09 16:36:01 user nova-compute[73091]:     <serial type='pty'>
Aug 09 16:36:01 user nova-compute[73091]:       <source path='/dev/pts/5'/>
Aug 09 16:36:01 user nova-compute[73091]:       <log file='/opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/console.log' append='off'/>
Aug 09 16:36:01 user nova-compute[73091]:       <target type='isa-serial' port='0'>
Aug 09 16:36:01 user nova-compute[73091]:         <model name='isa-serial'/>
Aug 09 16:36:01 user nova-compute[73091]:       </target>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='serial0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </serial>
Aug 09 16:36:01 user nova-compute[73091]:     <console type='pty' tty='/dev/pts/5'>
Aug 09 16:36:01 user nova-compute[73091]:       <source path='/dev/pts/5'/>
Aug 09 16:36:01 user nova-compute[73091]:       <log file='/opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/console.log' append='off'/>
Aug 09 16:36:01 user nova-compute[73091]:       <target type='serial' port='0'/>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='serial0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </console>
Aug 09 16:36:01 user nova-compute[73091]:     <input type='mouse' bus='ps2'>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='input0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </input>
Aug 09 16:36:01 user nova-compute[73091]:     <input type='keyboard' bus='ps2'>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='input1'/>
Aug 09 16:36:01 user nova-compute[73091]:     </input>
Aug 09 16:36:01 user nova-compute[73091]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 09 16:36:01 user nova-compute[73091]:       <listen type='address' address='0.0.0.0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </graphics>
Aug 09 16:36:01 user nova-compute[73091]:     <audio id='1' type='none'/>
Aug 09 16:36:01 user nova-compute[73091]:     <video>
Aug 09 16:36:01 user nova-compute[73091]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='video0'/>
Aug 09 16:36:01 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </video>
Aug 09 16:36:01 user nova-compute[73091]:     <memballoon model='virtio'>
Aug 09 16:36:01 user nova-compute[73091]:       <stats period='10'/>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='balloon0'/>
Aug 09 16:36:01 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </memballoon>
Aug 09 16:36:01 user nova-compute[73091]:     <rng model='virtio'>
Aug 09 16:36:01 user nova-compute[73091]:       <backend model='random'>/dev/urandom</backend>
Aug 09 16:36:01 user nova-compute[73091]:       <alias name='rng0'/>
Aug 09 16:36:01 user nova-compute[73091]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 16:36:01 user nova-compute[73091]:     </rng>
Aug 09 16:36:01 user nova-compute[73091]:   </devices>
Aug 09 16:36:01 user nova-compute[73091]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 16:36:01 user nova-compute[73091]:     <label>libvirt-ec2187af-1b88-4c23-abba-2f09db3057d6</label>
Aug 09 16:36:01 user nova-compute[73091]:     <imagelabel>libvirt-ec2187af-1b88-4c23-abba-2f09db3057d6</imagelabel>
Aug 09 16:36:01 user nova-compute[73091]:   </seclabel>
Aug 09 16:36:01 user nova-compute[73091]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 16:36:01 user nova-compute[73091]:     <label>+64055:+108</label>
Aug 09 16:36:01 user nova-compute[73091]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 16:36:01 user nova-compute[73091]:   </seclabel>
Aug 09 16:36:01 user nova-compute[73091]: </domain>
Aug 09 16:36:01 user nova-compute[73091]:  {{(pid=73091) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 16:36:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Successfully detached device tap6415d3ca-e3 from instance ec2187af-1b88-4c23-abba-2f09db3057d6 from the live domain config.
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:33:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-232794309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-232794309',id=6,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKvUekvW9eV5PNFmOyGiNtiOlJk5szt6jF7Nn2Cjo8H7lw7fn57Jt1UoYyP8a1MRbAqNPdKj8VAN21vacR3qFtYUOYtrJGDNRvt4Yzt0u8rIA+SenASC0Z9S6AJgV5gFw==',key_name='tempest-keypair-1792812162',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:33:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3ef9b2241b143deb605e774ce34998e',ramdisk_id='',reservation_id='r-yr1ytpcl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-357169138',owner_user_name='tempest-TaggedAttachmentsTest-357169138-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc4caea945424320a1b8ed52721c0ccf',uuid=ec2187af-1b88-4c23-abba-2f09db3057d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6415d3ca-e310-4a5f-bce7-daef45247643", "address": "fa:16:3e:9f:13:67", "network": {"id": "253a307f-589a-4828-90e2-b4db1ddad191", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159303419", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6415d3ca-e3", "ovs_interfaceid": "6415d3ca-e310-4a5f-bce7-daef45247643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Converting VIF {"id": "6415d3ca-e310-4a5f-bce7-daef45247643", "address": "fa:16:3e:9f:13:67", "network": {"id": "253a307f-589a-4828-90e2-b4db1ddad191", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159303419", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6415d3ca-e3", "ovs_interfaceid": "6415d3ca-e310-4a5f-bce7-daef45247643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:13:67,bridge_name='br-int',has_traffic_filtering=True,id=6415d3ca-e310-4a5f-bce7-daef45247643,network=Network(253a307f-589a-4828-90e2-b4db1ddad191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6415d3ca-e3') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG os_vif [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:13:67,bridge_name='br-int',has_traffic_filtering=True,id=6415d3ca-e310-4a5f-bce7-daef45247643,network=Network(253a307f-589a-4828-90e2-b4db1ddad191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6415d3ca-e3') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6415d3ca-e3, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:36:01 user nova-compute[73091]: INFO os_vif [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:13:67,bridge_name='br-int',has_traffic_filtering=True,id=6415d3ca-e310-4a5f-bce7-daef45247643,network=Network(253a307f-589a-4828-90e2-b4db1ddad191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6415d3ca-e3')
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:36:01 user nova-compute[73091]:   <nova:package version="0.0.0"/>
Aug 09 16:36:01 user nova-compute[73091]:   <nova:name>tempest-device-tagging-server-232794309</nova:name>
Aug 09 16:36:01 user nova-compute[73091]:   <nova:creationTime>2023-08-09 16:36:01</nova:creationTime>
Aug 09 16:36:01 user nova-compute[73091]:   <nova:flavor name="m1.tiny">
Aug 09 16:36:01 user nova-compute[73091]:     <nova:memory>512</nova:memory>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:disk>1</nova:disk>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:swap>0</nova:swap>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:vcpus>1</nova:vcpus>
Aug 09 16:36:01 user nova-compute[73091]:   </nova:flavor>
Aug 09 16:36:01 user nova-compute[73091]:   <nova:owner>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:user uuid="bc4caea945424320a1b8ed52721c0ccf">tempest-TaggedAttachmentsTest-357169138-project-member</nova:user>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:project uuid="a3ef9b2241b143deb605e774ce34998e">tempest-TaggedAttachmentsTest-357169138</nova:project>
Aug 09 16:36:01 user nova-compute[73091]:   </nova:owner>
Aug 09 16:36:01 user nova-compute[73091]:   <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:36:01 user nova-compute[73091]:   <nova:ports>
Aug 09 16:36:01 user nova-compute[73091]:     <nova:port uuid="416fe3a2-a0ea-4c8e-81c6-7374e6205456">
Aug 09 16:36:01 user nova-compute[73091]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 16:36:01 user nova-compute[73091]:     </nova:port>
Aug 09 16:36:01 user nova-compute[73091]:   </nova:ports>
Aug 09 16:36:01 user nova-compute[73091]: </nova:instance>
Aug 09 16:36:01 user nova-compute[73091]:  {{(pid=73091) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-21410d19-43ee-45a0-84b9-728efebe453f req-fc1e19cb-491f-4608-940a-8e4a68b02a7b service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received event network-vif-unplugged-6415d3ca-e310-4a5f-bce7-daef45247643 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-21410d19-43ee-45a0-84b9-728efebe453f req-fc1e19cb-491f-4608-940a-8e4a68b02a7b service nova] Acquiring lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-21410d19-43ee-45a0-84b9-728efebe453f req-fc1e19cb-491f-4608-940a-8e4a68b02a7b service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-21410d19-43ee-45a0-84b9-728efebe453f req-fc1e19cb-491f-4608-940a-8e4a68b02a7b service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-21410d19-43ee-45a0-84b9-728efebe453f req-fc1e19cb-491f-4608-940a-8e4a68b02a7b service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] No waiting events found dispatching network-vif-unplugged-6415d3ca-e310-4a5f-bce7-daef45247643 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:01 user nova-compute[73091]: WARNING nova.compute.manager [req-21410d19-43ee-45a0-84b9-728efebe453f req-fc1e19cb-491f-4608-940a-8e4a68b02a7b service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received unexpected event network-vif-unplugged-6415d3ca-e310-4a5f-bce7-daef45247643 for instance with vm_state active and task_state None.
Aug 09 16:36:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:36:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:36:02 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:36:02 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:36:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:02 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:36:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-ec73dcc0-f783-4e11-8781-e0af50d11f88 req-04f8dbc2-613d-4884-b503-7684e9c13138 service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Received event network-vif-plugged-d368f4bb-4681-4152-b639-3be5601c73b9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ec73dcc0-f783-4e11-8781-e0af50d11f88 req-04f8dbc2-613d-4884-b503-7684e9c13138 service nova] Acquiring lock "b791bded-3eb5-4bf8-a14e-eae269ae2043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ec73dcc0-f783-4e11-8781-e0af50d11f88 req-04f8dbc2-613d-4884-b503-7684e9c13138 service nova] Lock "b791bded-3eb5-4bf8-a14e-eae269ae2043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ec73dcc0-f783-4e11-8781-e0af50d11f88 req-04f8dbc2-613d-4884-b503-7684e9c13138 service nova] Lock "b791bded-3eb5-4bf8-a14e-eae269ae2043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-ec73dcc0-f783-4e11-8781-e0af50d11f88 req-04f8dbc2-613d-4884-b503-7684e9c13138 service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] No waiting events found dispatching network-vif-plugged-d368f4bb-4681-4152-b639-3be5601c73b9 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:03 user nova-compute[73091]: WARNING nova.compute.manager [req-ec73dcc0-f783-4e11-8781-e0af50d11f88 req-04f8dbc2-613d-4884-b503-7684e9c13138 service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Received unexpected event network-vif-plugged-d368f4bb-4681-4152-b639-3be5601c73b9 for instance with vm_state active and task_state deleting.
Aug 09 16:36:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquiring lock "refresh_cache-ec2187af-1b88-4c23-abba-2f09db3057d6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquired lock "refresh_cache-ec2187af-1b88-4c23-abba-2f09db3057d6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-abc205e8-68ad-4177-90a4-25b9a2e2dab0 req-b4dd2232-9586-4a2f-9794-5ac8a76ebe9d service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received event network-vif-plugged-6415d3ca-e310-4a5f-bce7-daef45247643 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-abc205e8-68ad-4177-90a4-25b9a2e2dab0 req-b4dd2232-9586-4a2f-9794-5ac8a76ebe9d service nova] Acquiring lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-abc205e8-68ad-4177-90a4-25b9a2e2dab0 req-b4dd2232-9586-4a2f-9794-5ac8a76ebe9d service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-abc205e8-68ad-4177-90a4-25b9a2e2dab0 req-b4dd2232-9586-4a2f-9794-5ac8a76ebe9d service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-abc205e8-68ad-4177-90a4-25b9a2e2dab0 req-b4dd2232-9586-4a2f-9794-5ac8a76ebe9d service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] No waiting events found dispatching network-vif-plugged-6415d3ca-e310-4a5f-bce7-daef45247643 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:03 user nova-compute[73091]: WARNING nova.compute.manager [req-abc205e8-68ad-4177-90a4-25b9a2e2dab0 req-b4dd2232-9586-4a2f-9794-5ac8a76ebe9d service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received unexpected event network-vif-plugged-6415d3ca-e310-4a5f-bce7-daef45247643 for instance with vm_state active and task_state None.
Aug 09 16:36:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:36:04 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Took 2.98 seconds to deallocate network for instance.
Aug 09 16:36:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:04 user nova-compute[73091]: INFO nova.network.neutron [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Port 6415d3ca-e310-4a5f-bce7-daef45247643 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 09 16:36:04 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Updating instance_info_cache with network_info: [{"id": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "address": "fa:16:3e:f3:65:dc", "network": {"id": "4d26b33a-b351-4595-a0c5-788f2ecb7732", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-549846585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe3a2-a0", "ovs_interfaceid": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Releasing lock "refresh_cache-ec2187af-1b88-4c23-abba-2f09db3057d6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e8c6d3eb-eab5-4a10-9fb6-729a7c52a099 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "interface-ec2187af-1b88-4c23-abba-2f09db3057d6-6415d3ca-e310-4a5f-bce7-daef45247643" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 3.548s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:04 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Deleted allocations for instance b791bded-3eb5-4bf8-a14e-eae269ae2043
Aug 09 16:36:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2018b8b9-85d1-461a-91ce-f3686e4d0c28 tempest-AttachSCSIVolumeTestJSON-1618710579 tempest-AttachSCSIVolumeTestJSON-1618710579-project-member] Lock "b791bded-3eb5-4bf8-a14e-eae269ae2043" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.738s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-13edf214-59c6-4757-8dc9-fbeb6034b264 req-740cdf76-5626-4ccc-b957-f6c4e4616a36 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received event network-vif-deleted-6415d3ca-e310-4a5f-bce7-daef45247643 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-13edf214-59c6-4757-8dc9-fbeb6034b264 req-740cdf76-5626-4ccc-b957-f6c4e4616a36 service nova] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Received event network-vif-deleted-d368f4bb-4681-4152-b639-3be5601c73b9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:05 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:36:05 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:36:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7335MB free_disk=25.574249267578125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:36:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:36:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 7bcc1e42-532f-4fb6-984e-cdf659cfef7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:36:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance ec2187af-1b88-4c23-abba-2f09db3057d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:36:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:36:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 7e75e099-39c8-4cc4-b3dd-50c67e1b4857 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:36:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c4f1da39-1fb7-4551-8be0-10216ab423ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:36:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 9c8b5adc-d13f-4d9f-a878-e59dd52550c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:36:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 117928be-d7c7-4d40-a0ef-2a88c360cfec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:36:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:36:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.640s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCALxzED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0edf64d-c049-4bac-ab0f-db636e4f4568', 'serial': 'b0edf64d-c049-4bac-ab0f-db636e4f4568'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TksBofOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb', 'attached_at': '', 'detached_at': '', 'volume_id': '6c311244-3b9e-4d97-b85a-c9b72f143e90', 'serial'} {{(pid=73091) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCALxzED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:36:06 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:36:06 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:36:06 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c06a9a-7e18-4d28-82e2-aca8692a6255]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:36:06 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[228b07a7-508a-4e60-a2c7-a804e0f6f19d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568] added
Aug 09 16:36:06 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3d4215-c3ed-4956-b2c4-b411bbcad6d0]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38aae54-f798-46fd-bfa0-fe47dc68333f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCALxzED {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCALxzED" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[44911224-c10b-4f76-8cd6-6ff8e70f2290]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cCALxzED'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[72702476-3176-4987-968d-a7debd300ee0]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d48fcb-8310-41fc-a2fe-119c9be8fb86]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd15762-779d-4fd8-a476-cef2449b3d43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568, portal: 172.16.0.220,3260]
Aug 09 16:36:06 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568, portal: 172.16.0.220,3260] successful.
Aug 09 16:36:06 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[39eb5827-50f3-4c11-ba58-435b501546ad]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5443069b-6126-44ee-9979-2f87c0245047]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:36:06 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] HCTL ('37', '-', '-', 0) found on session 13 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf71ad2-3fe7-4143-8616-d4931a852556]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:06 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Acquiring lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Acquiring lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:07 user nova-compute[73091]: INFO nova.compute.manager [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Terminating instance
Aug 09 16:36:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Instance destroyed successfully.
Aug 09 16:36:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Lazy-loading 'resources' on Instance uuid 7e75e099-39c8-4cc4-b3dd-50c67e1b4857 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1007298400',display_name='tempest-VolumesActionsTest-instance-1007298400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1007298400',id=8,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:34:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e278f46f2e84bb9ab3024f296069bb2',ramdisk_id='',reservation_id='r-iy5vd3oh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-845829776',owner_user_name='tempest-VolumesActionsTest-845829776-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:34:14Z,user_data=None,user_id='f3685faa4ed244e7b8e6ac55ba8289b7',uuid=7e75e099-39c8-4cc4-b3dd-50c67e1b4857,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "930e8561-36ee-4a9b-b084-5ace1f7d155f", "address": "fa:16:3e:0b:c6:dd", "network": {"id": "6cb7f365-bee2-404f-b559-84f622cdafaf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-653553987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e278f46f2e84bb9ab3024f296069bb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap930e8561-36", "ovs_interfaceid": "930e8561-36ee-4a9b-b084-5ace1f7d155f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Converting VIF {"id": "930e8561-36ee-4a9b-b084-5ace1f7d155f", "address": "fa:16:3e:0b:c6:dd", "network": {"id": "6cb7f365-bee2-404f-b559-84f622cdafaf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-653553987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e278f46f2e84bb9ab3024f296069bb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap930e8561-36", "ovs_interfaceid": "930e8561-36ee-4a9b-b084-5ace1f7d155f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:dd,bridge_name='br-int',has_traffic_filtering=True,id=930e8561-36ee-4a9b-b084-5ace1f7d155f,network=Network(6cb7f365-bee2-404f-b559-84f622cdafaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap930e8561-36') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG os_vif [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:dd,bridge_name='br-int',has_traffic_filtering=True,id=930e8561-36ee-4a9b-b084-5ace1f7d155f,network=Network(6cb7f365-bee2-404f-b559-84f622cdafaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap930e8561-36') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap930e8561-36, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:07 user nova-compute[73091]: INFO os_vif [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:dd,bridge_name='br-int',has_traffic_filtering=True,id=930e8561-36ee-4a9b-b084-5ace1f7d155f,network=Network(6cb7f365-bee2-404f-b559-84f622cdafaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap930e8561-36')
Aug 09 16:36:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Deleting instance files /opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857_del
Aug 09 16:36:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Deletion of /opt/stack/data/nova/instances/7e75e099-39c8-4cc4-b3dd-50c67e1b4857_del complete
Aug 09 16:36:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-08997f9b-065c-45ea-8cf0-0c6c524b0d28 req-0968ca0e-ddbb-44df-b41a-69442062f7fd service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Received event network-vif-unplugged-930e8561-36ee-4a9b-b084-5ace1f7d155f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-08997f9b-065c-45ea-8cf0-0c6c524b0d28 req-0968ca0e-ddbb-44df-b41a-69442062f7fd service nova] Acquiring lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-08997f9b-065c-45ea-8cf0-0c6c524b0d28 req-0968ca0e-ddbb-44df-b41a-69442062f7fd service nova] Lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-08997f9b-065c-45ea-8cf0-0c6c524b0d28 req-0968ca0e-ddbb-44df-b41a-69442062f7fd service nova] Lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-08997f9b-065c-45ea-8cf0-0c6c524b0d28 req-0968ca0e-ddbb-44df-b41a-69442062f7fd service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] No waiting events found dispatching network-vif-unplugged-930e8561-36ee-4a9b-b084-5ace1f7d155f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-08997f9b-065c-45ea-8cf0-0c6c524b0d28 req-0968ca0e-ddbb-44df-b41a-69442062f7fd service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Received event network-vif-unplugged-930e8561-36ee-4a9b-b084-5ace1f7d155f for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:36:07 user nova-compute[73091]: INFO nova.compute.manager [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Took 0.66 seconds to destroy the instance on the hypervisor.
Aug 09 16:36:07 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCALxzED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23934386535613762', 'path': '/dev/sdf'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934386535613762', 'path': '/dev/sdf'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:36:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Lazy-loading 'flavor' on Instance uuid 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:36:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:36:08 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:36:08 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:36:08 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Took 0.63 seconds to deallocate network for instance.
Aug 09 16:36:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-f7f1aad0-a121-4f1d-af2e-688359630253 req-297f9f5b-8e78-4202-9bd2-768d83365e37 service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Received event network-vif-deleted-930e8561-36ee-4a9b-b084-5ace1f7d155f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:08 user nova-compute[73091]: INFO nova.compute.manager [req-f7f1aad0-a121-4f1d-af2e-688359630253 req-297f9f5b-8e78-4202-9bd2-768d83365e37 service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Neutron deleted interface 930e8561-36ee-4a9b-b084-5ace1f7d155f; detaching it from the instance and deleting it from the info cache
Aug 09 16:36:08 user nova-compute[73091]: DEBUG nova.network.neutron [req-f7f1aad0-a121-4f1d-af2e-688359630253 req-297f9f5b-8e78-4202-9bd2-768d83365e37 service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:36:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-f7f1aad0-a121-4f1d-af2e-688359630253 req-297f9f5b-8e78-4202-9bd2-768d83365e37 service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Detach interface failed, port_id=930e8561-36ee-4a9b-b084-5ace1f7d155f, reason: Instance 7e75e099-39c8-4cc4-b3dd-50c67e1b4857 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 16:36:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] COPY block job progress, current cursor: 145752064 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:36:08 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:36:08 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:36:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:09 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Deleted allocations for instance 7e75e099-39c8-4cc4-b3dd-50c67e1b4857
Aug 09 16:36:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8d054e0-0218-4614-a748-8b5943fb041b tempest-VolumesActionsTest-845829776 tempest-VolumesActionsTest-845829776-project-member] Lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.947s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Acquiring lock "84a64e32-752d-4deb-8364-8889209a97a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "84a64e32-752d-4deb-8364-8889209a97a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:36:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] COPY block job progress, current cursor: 288358400 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:36:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:36:09 user nova-compute[73091]: INFO nova.compute.claims [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Claim successful on node user
Aug 09 16:36:09 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:36:09 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:36:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] COPY block job progress, current cursor: 418381824 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:36:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:36:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-749c0efa-3903-4420-825b-9ce4eafdec1e req-fbc1bfa5-ef7d-4fba-823c-00004d3b83e4 service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Received event network-vif-plugged-930e8561-36ee-4a9b-b084-5ace1f7d155f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-749c0efa-3903-4420-825b-9ce4eafdec1e req-fbc1bfa5-ef7d-4fba-823c-00004d3b83e4 service nova] Acquiring lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-749c0efa-3903-4420-825b-9ce4eafdec1e req-fbc1bfa5-ef7d-4fba-823c-00004d3b83e4 service nova] Lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-749c0efa-3903-4420-825b-9ce4eafdec1e req-fbc1bfa5-ef7d-4fba-823c-00004d3b83e4 service nova] Lock "7e75e099-39c8-4cc4-b3dd-50c67e1b4857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-749c0efa-3903-4420-825b-9ce4eafdec1e req-fbc1bfa5-ef7d-4fba-823c-00004d3b83e4 service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] No waiting events found dispatching network-vif-plugged-930e8561-36ee-4a9b-b084-5ace1f7d155f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:09 user nova-compute[73091]: WARNING nova.compute.manager [req-749c0efa-3903-4420-825b-9ce4eafdec1e req-fbc1bfa5-ef7d-4fba-823c-00004d3b83e4 service nova] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Received unexpected event network-vif-plugged-930e8561-36ee-4a9b-b084-5ace1f7d155f for instance with vm_state deleted and task_state None.
Aug 09 16:36:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:36:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:36:09 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:36:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG nova.policy [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54214e99474245ff8c66816e1a103260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c24350e3214cfe89b2a4e2f1298121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:36:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Creating image(s)
Aug 09 16:36:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Acquiring lock "/opt/stack/data/nova/instances/84a64e32-752d-4deb-8364-8889209a97a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "/opt/stack/data/nova/instances/84a64e32-752d-4deb-8364-8889209a97a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "/opt/stack/data/nova/instances/84a64e32-752d-4deb-8364-8889209a97a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.156s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] COPY block job progress, current cursor: 595591168 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.151s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/84a64e32-752d-4deb-8364-8889209a97a2/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/84a64e32-752d-4deb-8364-8889209a97a2/disk 1073741824" returned: 0 in 0.065s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84a64e32-752d-4deb-8364-8889209a97a2/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84a64e32-752d-4deb-8364-8889209a97a2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] COPY block job progress, current cursor: 748683264 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84a64e32-752d-4deb-8364-8889209a97a2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Cannot resize image /opt/stack/data/nova/instances/84a64e32-752d-4deb-8364-8889209a97a2/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG nova.objects.instance [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lazy-loading 'migration_context' on Instance uuid 84a64e32-752d-4deb-8364-8889209a97a2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Ensure instance console log exists: /opt/stack/data/nova/instances/84a64e32-752d-4deb-8364-8889209a97a2/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:11 user nova-compute[73091]: DEBUG nova.network.neutron [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Successfully created port: cf196e19-6250-442f-86ab-ed00224a3b72 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:36:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] COPY block job progress, current cursor: 901775360 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:36:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] COPY block job progress, current cursor: 931135488 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:36:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Successfully updated port: cf196e19-6250-442f-86ab-ed00224a3b72 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:36:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Acquiring lock "refresh_cache-84a64e32-752d-4deb-8364-8889209a97a2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:36:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Acquired lock "refresh_cache-84a64e32-752d-4deb-8364-8889209a97a2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:36:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:36:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-c37f0944-d820-466c-8ce4-998beb664271 req-9f5608cf-c0df-4f03-9ec7-92adce2376b0 service nova] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Received event network-changed-cf196e19-6250-442f-86ab-ed00224a3b72 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-c37f0944-d820-466c-8ce4-998beb664271 req-9f5608cf-c0df-4f03-9ec7-92adce2376b0 service nova] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Refreshing instance network info cache due to event network-changed-cf196e19-6250-442f-86ab-ed00224a3b72. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:36:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c37f0944-d820-466c-8ce4-998beb664271 req-9f5608cf-c0df-4f03-9ec7-92adce2376b0 service nova] Acquiring lock "refresh_cache-84a64e32-752d-4deb-8364-8889209a97a2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:36:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:36:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] COPY block job progress, current cursor: 1063256064 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:36:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TksBofOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:36:13 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:36:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15262c4-d802-4a0f-9ffe-56434ead4ff0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee8d147-2e51-43cc-83a0-dec5cab62bfa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:36:13 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)
Aug 09 16:36:13 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:36:13 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:36:13 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:36:13 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:36:13 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:36:13 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:36:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:36:13 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)
Aug 09 16:36:13 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:36:13 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:36:13 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:36:13 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:36:13 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:36:13 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:36:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff06038a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90'): ({'sdi'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Removing single pathed devices sdi {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6e65b3-8659-48c7-8b80-13ac26c60644]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Updating instance_info_cache with network_info: [{"id": "cf196e19-6250-442f-86ab-ed00224a3b72", "address": "fa:16:3e:f2:e9:24", "network": {"id": "5bae1654-cc49-420b-ab90-299d2f87c8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-433837263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c24350e3214cfe89b2a4e2f1298121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf196e19-62", "ovs_interfaceid": "cf196e19-6250-442f-86ab-ed00224a3b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de5755f-fce1-47cb-bedf-eb339c0ae942]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Flushing IO for device /dev/sdi {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Releasing lock "refresh_cache-84a64e32-752d-4deb-8364-8889209a97a2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Instance network_info: |[{"id": "cf196e19-6250-442f-86ab-ed00224a3b72", "address": "fa:16:3e:f2:e9:24", "network": {"id": "5bae1654-cc49-420b-ab90-299d2f87c8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-433837263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c24350e3214cfe89b2a4e2f1298121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf196e19-62", "ovs_interfaceid": "cf196e19-6250-442f-86ab-ed00224a3b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c37f0944-d820-466c-8ce4-998beb664271 req-9f5608cf-c0df-4f03-9ec7-92adce2376b0 service nova] Acquired lock "refresh_cache-84a64e32-752d-4deb-8364-8889209a97a2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.network.neutron [req-c37f0944-d820-466c-8ce4-998beb664271 req-9f5608cf-c0df-4f03-9ec7-92adce2376b0 service nova] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Refreshing network info cache for port cf196e19-6250-442f-86ab-ed00224a3b72 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Start _get_guest_xml network_info=[{"id": "cf196e19-6250-442f-86ab-ed00224a3b72", "address": "fa:16:3e:f2:e9:24", "network": {"id": "5bae1654-cc49-420b-ab90-299d2f87c8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-433837263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c24350e3214cfe89b2a4e2f1298121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf196e19-62", "ovs_interfaceid": "cf196e19-6250-442f-86ab-ed00224a3b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ac5f42-3cad-4835-bae6-7aa103ea516c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:13 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:36:13 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-642570949',display_name='tempest-VolumesActionsTest-instance-642570949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-642570949',id=12,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4c24350e3214cfe89b2a4e2f1298121',ramdisk_id='',reservation_id='r-uypj0yyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1284523061',owner_user_name='tempest-VolumesActionsTest-1284523061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:36:10Z,user_data=None,user_id='54214e99474245ff8c66816e1a103260',uuid=84a64e32-752d-4deb-8364-8889209a97a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf196e19-6250-442f-86ab-ed00224a3b72", "address": "fa:16:3e:f2:e9:24", "network": {"id": "5bae1654-cc49-420b-ab90-299d2f87c8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-433837263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c24350e3214cfe89b2a4e2f1298121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf196e19-62", "ovs_interfaceid": "cf196e19-6250-442f-86ab-ed00224a3b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Converting VIF {"id": "cf196e19-6250-442f-86ab-ed00224a3b72", "address": "fa:16:3e:f2:e9:24", "network": {"id": "5bae1654-cc49-420b-ab90-299d2f87c8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-433837263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c24350e3214cfe89b2a4e2f1298121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf196e19-62", "ovs_interfaceid": "cf196e19-6250-442f-86ab-ed00224a3b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:e9:24,bridge_name='br-int',has_traffic_filtering=True,id=cf196e19-6250-442f-86ab-ed00224a3b72,network=Network(5bae1654-cc49-420b-ab90-299d2f87c8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf196e19-62') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.objects.instance [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lazy-loading 'pci_devices' on Instance uuid 84a64e32-752d-4deb-8364-8889209a97a2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.047s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d4ca64-8691-4de4-a858-098e7aa740cb]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] SCSI volumes sdi have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:36:13 user nova-compute[73091]:   <uuid>84a64e32-752d-4deb-8364-8889209a97a2</uuid>
Aug 09 16:36:13 user nova-compute[73091]:   <name>instance-0000000c</name>
Aug 09 16:36:13 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:36:13 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:36:13 user nova-compute[73091]:   <metadata>
Aug 09 16:36:13 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:36:13 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:36:13 user nova-compute[73091]:       <nova:name>tempest-VolumesActionsTest-instance-642570949</nova:name>
Aug 09 16:36:13 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:36:13</nova:creationTime>
Aug 09 16:36:13 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:36:13 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:36:13 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:36:13 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:36:13 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:36:13 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:36:13 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:36:13 user nova-compute[73091]:       <nova:owner>
Aug 09 16:36:13 user nova-compute[73091]:         <nova:user uuid="54214e99474245ff8c66816e1a103260">tempest-VolumesActionsTest-1284523061-project-member</nova:user>
Aug 09 16:36:13 user nova-compute[73091]:         <nova:project uuid="b4c24350e3214cfe89b2a4e2f1298121">tempest-VolumesActionsTest-1284523061</nova:project>
Aug 09 16:36:13 user nova-compute[73091]:       </nova:owner>
Aug 09 16:36:13 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:36:13 user nova-compute[73091]:       <nova:ports>
Aug 09 16:36:13 user nova-compute[73091]:         <nova:port uuid="cf196e19-6250-442f-86ab-ed00224a3b72">
Aug 09 16:36:13 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 16:36:13 user nova-compute[73091]:         </nova:port>
Aug 09 16:36:13 user nova-compute[73091]:       </nova:ports>
Aug 09 16:36:13 user nova-compute[73091]:     </nova:instance>
Aug 09 16:36:13 user nova-compute[73091]:   </metadata>
Aug 09 16:36:13 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:36:13 user nova-compute[73091]:     <system>
Aug 09 16:36:13 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:36:13 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:36:13 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:36:13 user nova-compute[73091]:       <entry name="serial">84a64e32-752d-4deb-8364-8889209a97a2</entry>
Aug 09 16:36:13 user nova-compute[73091]:       <entry name="uuid">84a64e32-752d-4deb-8364-8889209a97a2</entry>
Aug 09 16:36:13 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:36:13 user nova-compute[73091]:     </system>
Aug 09 16:36:13 user nova-compute[73091]:   </sysinfo>
Aug 09 16:36:13 user nova-compute[73091]:   <os>
Aug 09 16:36:13 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:36:13 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:36:13 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:36:13 user nova-compute[73091]:   </os>
Aug 09 16:36:13 user nova-compute[73091]:   <features>
Aug 09 16:36:13 user nova-compute[73091]:     <acpi/>
Aug 09 16:36:13 user nova-compute[73091]:     <apic/>
Aug 09 16:36:13 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:36:13 user nova-compute[73091]:   </features>
Aug 09 16:36:13 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:36:13 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:36:13 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:36:13 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:36:13 user nova-compute[73091]:   </clock>
Aug 09 16:36:13 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:36:13 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:36:13 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:36:13 user nova-compute[73091]:   </cpu>
Aug 09 16:36:13 user nova-compute[73091]:   <devices>
Aug 09 16:36:13 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:36:13 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:36:13 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/84a64e32-752d-4deb-8364-8889209a97a2/disk"/>
Aug 09 16:36:13 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:36:13 user nova-compute[73091]:     </disk>
Aug 09 16:36:13 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:36:13 user nova-compute[73091]:       <mac address="fa:16:3e:f2:e9:24"/>
Aug 09 16:36:13 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:36:13 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:36:13 user nova-compute[73091]:       <target dev="tapcf196e19-62"/>
Aug 09 16:36:13 user nova-compute[73091]:     </interface>
Aug 09 16:36:13 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:36:13 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/84a64e32-752d-4deb-8364-8889209a97a2/console.log" append="off"/>
Aug 09 16:36:13 user nova-compute[73091]:     </serial>
Aug 09 16:36:13 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:36:13 user nova-compute[73091]:     <video>
Aug 09 16:36:13 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:36:13 user nova-compute[73091]:     </video>
Aug 09 16:36:13 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:36:13 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:36:13 user nova-compute[73091]:     </rng>
Aug 09 16:36:13 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:36:13 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:36:13 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:36:13 user nova-compute[73091]:     </memballoon>
Aug 09 16:36:13 user nova-compute[73091]:   </devices>
Aug 09 16:36:13 user nova-compute[73091]: </domain>
Aug 09 16:36:13 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-642570949',display_name='tempest-VolumesActionsTest-instance-642570949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-642570949',id=12,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4c24350e3214cfe89b2a4e2f1298121',ramdisk_id='',reservation_id='r-uypj0yyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1284523061',owner_user_name='tempest-VolumesActionsTest-1284523061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:36:10Z,user_data=None,user_id='54214e99474245ff8c66816e1a103260',uuid=84a64e32-752d-4deb-8364-8889209a97a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf196e19-6250-442f-86ab-ed00224a3b72", "address": "fa:16:3e:f2:e9:24", "network": {"id": "5bae1654-cc49-420b-ab90-299d2f87c8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-433837263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c24350e3214cfe89b2a4e2f1298121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf196e19-62", "ovs_interfaceid": "cf196e19-6250-442f-86ab-ed00224a3b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Converting VIF {"id": "cf196e19-6250-442f-86ab-ed00224a3b72", "address": "fa:16:3e:f2:e9:24", "network": {"id": "5bae1654-cc49-420b-ab90-299d2f87c8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-433837263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c24350e3214cfe89b2a4e2f1298121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf196e19-62", "ovs_interfaceid": "cf196e19-6250-442f-86ab-ed00224a3b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:e9:24,bridge_name='br-int',has_traffic_filtering=True,id=cf196e19-6250-442f-86ab-ed00224a3b72,network=Network(5bae1654-cc49-420b-ab90-299d2f87c8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf196e19-62') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG os_vif [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:e9:24,bridge_name='br-int',has_traffic_filtering=True,id=cf196e19-6250-442f-86ab-ed00224a3b72,network=Network(5bae1654-cc49-420b-ab90-299d2f87c8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf196e19-62') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf196e19-62, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcf196e19-62, col_values=(('external_ids', {'iface-id': 'cf196e19-6250-442f-86ab-ed00224a3b72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:e9:24', 'vm-uuid': '84a64e32-752d-4deb-8364-8889209a97a2'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[94890ed5-e1a1-450e-a309-afca4c90524f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:13 user nova-compute[73091]: INFO os_vif [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:e9:24,bridge_name='br-int',has_traffic_filtering=True,id=cf196e19-6250-442f-86ab-ed00224a3b72,network=Network(5bae1654-cc49-420b-ab90-299d2f87c8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf196e19-62')
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f805fa-35b0-473f-99df-12f6229b687f]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90, portal: 172.16.0.220,3260]
Aug 09 16:36:13 user nova-compute[73091]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90, portal: 172.16.0.220,3260] successful.
Aug 09 16:36:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] No VIF found with MAC fa:16:3e:f2:e9:24, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd23b51-431e-4cec-bf38-27c0d9c306d7]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] <== disconnect_volume: return (366ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCALxzED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0edf64d-c049-4bac-ab0f-db636e4f4568', 'serial'} {{(pid=73091) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] swap_volume: removing Cinder connection for volume 6c311244-3b9e-4d97-b85a-c9b72f143e90 {{(pid=73091) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.network.neutron [req-c37f0944-d820-466c-8ce4-998beb664271 req-9f5608cf-c0df-4f03-9ec7-92adce2376b0 service nova] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Updated VIF entry in instance network info cache for port cf196e19-6250-442f-86ab-ed00224a3b72. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG nova.network.neutron [req-c37f0944-d820-466c-8ce4-998beb664271 req-9f5608cf-c0df-4f03-9ec7-92adce2376b0 service nova] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Updating instance_info_cache with network_info: [{"id": "cf196e19-6250-442f-86ab-ed00224a3b72", "address": "fa:16:3e:f2:e9:24", "network": {"id": "5bae1654-cc49-420b-ab90-299d2f87c8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-433837263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c24350e3214cfe89b2a4e2f1298121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf196e19-62", "ovs_interfaceid": "cf196e19-6250-442f-86ab-ed00224a3b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:36:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c37f0944-d820-466c-8ce4-998beb664271 req-9f5608cf-c0df-4f03-9ec7-92adce2376b0 service nova] Releasing lock "refresh_cache-84a64e32-752d-4deb-8364-8889209a97a2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:36:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] swap_volume: Updating volume 6c311244-3b9e-4d97-b85a-c9b72f143e90 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "cCALxzED", "auth_password": "ry9qTQOAUCF0PM", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "b0edf64d-c049-4bac-ab0f-db636e4f4568"}, "status": "reserved", "instance": "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb", "attached_at": "", "detached_at": "", "volume_id": "b0edf64d-c049-4bac-ab0f-db636e4f4568", "serial": "b0edf64d-c049-4bac-ab0f-db636e4f4568"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b0edf64d-c049-4bac-ab0f-db636e4f4568', 'no_device': None, 'attachment_id': '932615ba-dcc5-410d-acf7-934048c89bd9'} {{(pid=73091) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 09 16:36:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0c7dc9f1-3d92-41b4-99e3-1113485d0445 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.975s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-9482d5d3-e6a9-4b8d-8d2f-979fafb14d06 req-3aa18674-cb3b-4604-af9d-a78a29c8a8db service nova] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Received event network-vif-plugged-cf196e19-6250-442f-86ab-ed00224a3b72 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9482d5d3-e6a9-4b8d-8d2f-979fafb14d06 req-3aa18674-cb3b-4604-af9d-a78a29c8a8db service nova] Acquiring lock "84a64e32-752d-4deb-8364-8889209a97a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9482d5d3-e6a9-4b8d-8d2f-979fafb14d06 req-3aa18674-cb3b-4604-af9d-a78a29c8a8db service nova] Lock "84a64e32-752d-4deb-8364-8889209a97a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9482d5d3-e6a9-4b8d-8d2f-979fafb14d06 req-3aa18674-cb3b-4604-af9d-a78a29c8a8db service nova] Lock "84a64e32-752d-4deb-8364-8889209a97a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-9482d5d3-e6a9-4b8d-8d2f-979fafb14d06 req-3aa18674-cb3b-4604-af9d-a78a29c8a8db service nova] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] No waiting events found dispatching network-vif-plugged-cf196e19-6250-442f-86ab-ed00224a3b72 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:14 user nova-compute[73091]: WARNING nova.compute.manager [req-9482d5d3-e6a9-4b8d-8d2f-979fafb14d06 req-3aa18674-cb3b-4604-af9d-a78a29c8a8db service nova] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Received unexpected event network-vif-plugged-cf196e19-6250-442f-86ab-ed00224a3b72 for instance with vm_state building and task_state spawning.
Aug 09 16:36:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Acquiring lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG os_brick.utils [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c076a278-4f6e-4c64-bf37-0817600228c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b572a03d-ca9b-4160-ac2c-17db2f722e7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce437040-1014-4517-8744-ec7c67f8794a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde6b2ab-56cb-422d-bf76-adcf2db8a792]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:36:15 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:36:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1ccca8-b88a-4068-9ca9-b77ef913b101]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:36:15 user nova-compute[73091]: DEBUG os_brick.utils [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:36:15 user nova-compute[73091]: INFO nova.compute.manager [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Swapping volume b0edf64d-c049-4bac-ab0f-db636e4f4568 for 6c311244-3b9e-4d97-b85a-c9b72f143e90
Aug 09 16:36:16 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691598961.1480734, b791bded-3eb5-4bf8-a14e-eae269ae2043 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:36:16 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] VM Stopped (Lifecycle Event)
Aug 09 16:36:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a4e7ed93-8d03-4472-bbb0-c5e143d5f972 None None] [instance: b791bded-3eb5-4bf8-a14e-eae269ae2043] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:36:16 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598976.755844, 84a64e32-752d-4deb-8364-8889209a97a2 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:36:16 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] VM Resumed (Lifecycle Event)
Aug 09 16:36:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:36:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:36:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Instance spawned successfully.
Aug 09 16:36:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:36:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:36:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:36:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:36:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:36:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:36:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:36:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:36:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:36:16 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:36:16 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691598976.7570865, 84a64e32-752d-4deb-8364-8889209a97a2 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:36:16 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] VM Started (Lifecycle Event)
Aug 09 16:36:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:36:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:36:16 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:36:16 user nova-compute[73091]: INFO nova.compute.manager [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Took 6.74 seconds to spawn the instance on the hypervisor.
Aug 09 16:36:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:36:17 user nova-compute[73091]: INFO nova.compute.manager [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Took 7.61 seconds to build instance.
Aug 09 16:36:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-e4b14f51-a6cd-4ed0-be19-467d577177e7 req-beb717b1-2a27-4ce1-a62a-092c5f0d9739 service nova] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Received event network-vif-plugged-cf196e19-6250-442f-86ab-ed00224a3b72 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e4b14f51-a6cd-4ed0-be19-467d577177e7 req-beb717b1-2a27-4ce1-a62a-092c5f0d9739 service nova] Acquiring lock "84a64e32-752d-4deb-8364-8889209a97a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e4b14f51-a6cd-4ed0-be19-467d577177e7 req-beb717b1-2a27-4ce1-a62a-092c5f0d9739 service nova] Lock "84a64e32-752d-4deb-8364-8889209a97a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e4b14f51-a6cd-4ed0-be19-467d577177e7 req-beb717b1-2a27-4ce1-a62a-092c5f0d9739 service nova] Lock "84a64e32-752d-4deb-8364-8889209a97a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-e4b14f51-a6cd-4ed0-be19-467d577177e7 req-beb717b1-2a27-4ce1-a62a-092c5f0d9739 service nova] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] No waiting events found dispatching network-vif-plugged-cf196e19-6250-442f-86ab-ed00224a3b72 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:17 user nova-compute[73091]: WARNING nova.compute.manager [req-e4b14f51-a6cd-4ed0-be19-467d577177e7 req-beb717b1-2a27-4ce1-a62a-092c5f0d9739 service nova] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Received unexpected event network-vif-plugged-cf196e19-6250-442f-86ab-ed00224a3b72 for instance with vm_state active and task_state None.
Aug 09 16:36:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-836a20cc-d574-49f6-9ce3-f4bb9398b3d3 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "84a64e32-752d-4deb-8364-8889209a97a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.726s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-f9f17094-8546-434f-8ecd-874a0227c851 req-3d09e275-4a2f-4e1b-9eca-2276e6b329db service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-changed-2d404f54-5fe2-47d8-b036-955d05de1706 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-f9f17094-8546-434f-8ecd-874a0227c851 req-3d09e275-4a2f-4e1b-9eca-2276e6b329db service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Refreshing instance network info cache due to event network-changed-2d404f54-5fe2-47d8-b036-955d05de1706. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:36:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f9f17094-8546-434f-8ecd-874a0227c851 req-3d09e275-4a2f-4e1b-9eca-2276e6b329db service nova] Acquiring lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:36:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f9f17094-8546-434f-8ecd-874a0227c851 req-3d09e275-4a2f-4e1b-9eca-2276e6b329db service nova] Acquired lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:36:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-f9f17094-8546-434f-8ecd-874a0227c851 req-3d09e275-4a2f-4e1b-9eca-2276e6b329db service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Refreshing network info cache for port 2d404f54-5fe2-47d8-b036-955d05de1706 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:36:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-f9f17094-8546-434f-8ecd-874a0227c851 req-3d09e275-4a2f-4e1b-9eca-2276e6b329db service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Updated VIF entry in instance network info cache for port 2d404f54-5fe2-47d8-b036-955d05de1706. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:36:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-f9f17094-8546-434f-8ecd-874a0227c851 req-3d09e275-4a2f-4e1b-9eca-2276e6b329db service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Updating instance_info_cache with network_info: [{"id": "2d404f54-5fe2-47d8-b036-955d05de1706", "address": "fa:16:3e:93:70:5b", "network": {"id": "288571f5-6f90-44a8-b1a7-5a66a9a3ed4e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-506239100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d404f54-5f", "ovs_interfaceid": "2d404f54-5fe2-47d8-b036-955d05de1706", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85a99727-150d-48a7-ba46-bce583a5353b", "address": "fa:16:3e:15:52:2a", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a99727-15", "ovs_interfaceid": "85a99727-150d-48a7-ba46-bce583a5353b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "415c1381-e446-4743-8420-56093064c1cb", "address": "fa:16:3e:72:41:a4", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415c1381-e4", "ovs_interfaceid": "415c1381-e446-4743-8420-56093064c1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9274af2c-557c-4b06-a375-5006f4792f69", "address": "fa:16:3e:69:b1:a3", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9274af2c-55", "ovs_interfaceid": "9274af2c-557c-4b06-a375-5006f4792f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "271512c1-1707-48da-84cf-978ab9e0d202", "address": "fa:16:3e:45:f5:f7", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap271512c1-17", "ovs_interfaceid": "271512c1-1707-48da-84cf-978ab9e0d202", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "address": "fa:16:3e:83:c1:f4", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652f5030-20", "ovs_interfaceid": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "address": "fa:16:3e:02:41:b2", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ee120-3c", "ovs_interfaceid": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:36:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f9f17094-8546-434f-8ecd-874a0227c851 req-3d09e275-4a2f-4e1b-9eca-2276e6b329db service nova] Releasing lock "refresh_cache-c4f1da39-1fb7-4551-8be0-10216ab423ea" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:36:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:19 user nova-compute[73091]: INFO nova.compute.manager [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Terminating instance
Aug 09 16:36:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:36:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-2f66276c-08b5-45be-8df1-b7098f457fbb req-3f6fa7a4-86f6-4322-a514-10515cb29e0a service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-unplugged-2d404f54-5fe2-47d8-b036-955d05de1706 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2f66276c-08b5-45be-8df1-b7098f457fbb req-3f6fa7a4-86f6-4322-a514-10515cb29e0a service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2f66276c-08b5-45be-8df1-b7098f457fbb req-3f6fa7a4-86f6-4322-a514-10515cb29e0a service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2f66276c-08b5-45be-8df1-b7098f457fbb req-3f6fa7a4-86f6-4322-a514-10515cb29e0a service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-2f66276c-08b5-45be-8df1-b7098f457fbb req-3f6fa7a4-86f6-4322-a514-10515cb29e0a service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-unplugged-2d404f54-5fe2-47d8-b036-955d05de1706 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-2f66276c-08b5-45be-8df1-b7098f457fbb req-3f6fa7a4-86f6-4322-a514-10515cb29e0a service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-unplugged-2d404f54-5fe2-47d8-b036-955d05de1706 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:36:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-a9904099-fdbe-4c20-9418-935c9597d99a req-db00261b-5e7b-4292-99e6-38e24e59ad3b service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-unplugged-415c1381-e446-4743-8420-56093064c1cb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9904099-fdbe-4c20-9418-935c9597d99a req-db00261b-5e7b-4292-99e6-38e24e59ad3b service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9904099-fdbe-4c20-9418-935c9597d99a req-db00261b-5e7b-4292-99e6-38e24e59ad3b service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9904099-fdbe-4c20-9418-935c9597d99a req-db00261b-5e7b-4292-99e6-38e24e59ad3b service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-a9904099-fdbe-4c20-9418-935c9597d99a req-db00261b-5e7b-4292-99e6-38e24e59ad3b service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-unplugged-415c1381-e446-4743-8420-56093064c1cb {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-a9904099-fdbe-4c20-9418-935c9597d99a req-db00261b-5e7b-4292-99e6-38e24e59ad3b service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-unplugged-415c1381-e446-4743-8420-56093064c1cb for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-b4342298-9c00-4dc8-9d20-ecf5ff21062b req-805ce2fc-f3cc-40c0-a0a4-f8bfcaeaa040 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-unplugged-271512c1-1707-48da-84cf-978ab9e0d202 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b4342298-9c00-4dc8-9d20-ecf5ff21062b req-805ce2fc-f3cc-40c0-a0a4-f8bfcaeaa040 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b4342298-9c00-4dc8-9d20-ecf5ff21062b req-805ce2fc-f3cc-40c0-a0a4-f8bfcaeaa040 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b4342298-9c00-4dc8-9d20-ecf5ff21062b req-805ce2fc-f3cc-40c0-a0a4-f8bfcaeaa040 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-b4342298-9c00-4dc8-9d20-ecf5ff21062b req-805ce2fc-f3cc-40c0-a0a4-f8bfcaeaa040 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-unplugged-271512c1-1707-48da-84cf-978ab9e0d202 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-b4342298-9c00-4dc8-9d20-ecf5ff21062b req-805ce2fc-f3cc-40c0-a0a4-f8bfcaeaa040 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-unplugged-271512c1-1707-48da-84cf-978ab9e0d202 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Instance destroyed successfully.
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lazy-loading 'resources' on Instance uuid c4f1da39-1fb7-4551-8be0-10216ab423ea {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:35:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d404f54-5fe2-47d8-b036-955d05de1706", "address": "fa:16:3e:93:70:5b", "network": {"id": "288571f5-6f90-44a8-b1a7-5a66a9a3ed4e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-506239100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d404f54-5f", "ovs_interfaceid": "2d404f54-5fe2-47d8-b036-955d05de1706", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "2d404f54-5fe2-47d8-b036-955d05de1706", "address": "fa:16:3e:93:70:5b", "network": {"id": "288571f5-6f90-44a8-b1a7-5a66a9a3ed4e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-506239100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d404f54-5f", "ovs_interfaceid": "2d404f54-5fe2-47d8-b036-955d05de1706", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:70:5b,bridge_name='br-int',has_traffic_filtering=True,id=2d404f54-5fe2-47d8-b036-955d05de1706,network=Network(288571f5-6f90-44a8-b1a7-5a66a9a3ed4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d404f54-5f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:70:5b,bridge_name='br-int',has_traffic_filtering=True,id=2d404f54-5fe2-47d8-b036-955d05de1706,network=Network(288571f5-6f90-44a8-b1a7-5a66a9a3ed4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d404f54-5f') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d404f54-5f, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: INFO os_vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:70:5b,bridge_name='br-int',has_traffic_filtering=True,id=2d404f54-5fe2-47d8-b036-955d05de1706,network=Network(288571f5-6f90-44a8-b1a7-5a66a9a3ed4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d404f54-5f')
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:35:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85a99727-150d-48a7-ba46-bce583a5353b", "address": "fa:16:3e:15:52:2a", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a99727-15", "ovs_interfaceid": "85a99727-150d-48a7-ba46-bce583a5353b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "85a99727-150d-48a7-ba46-bce583a5353b", "address": "fa:16:3e:15:52:2a", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a99727-15", "ovs_interfaceid": "85a99727-150d-48a7-ba46-bce583a5353b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:52:2a,bridge_name='br-int',has_traffic_filtering=True,id=85a99727-150d-48a7-ba46-bce583a5353b,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap85a99727-15') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:52:2a,bridge_name='br-int',has_traffic_filtering=True,id=85a99727-150d-48a7-ba46-bce583a5353b,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap85a99727-15') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85a99727-15, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: INFO os_vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:52:2a,bridge_name='br-int',has_traffic_filtering=True,id=85a99727-150d-48a7-ba46-bce583a5353b,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap85a99727-15')
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:35:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "415c1381-e446-4743-8420-56093064c1cb", "address": "fa:16:3e:72:41:a4", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415c1381-e4", "ovs_interfaceid": "415c1381-e446-4743-8420-56093064c1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "415c1381-e446-4743-8420-56093064c1cb", "address": "fa:16:3e:72:41:a4", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415c1381-e4", "ovs_interfaceid": "415c1381-e446-4743-8420-56093064c1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:41:a4,bridge_name='br-int',has_traffic_filtering=True,id=415c1381-e446-4743-8420-56093064c1cb,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap415c1381-e4') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:41:a4,bridge_name='br-int',has_traffic_filtering=True,id=415c1381-e446-4743-8420-56093064c1cb,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap415c1381-e4') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap415c1381-e4, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: INFO os_vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:41:a4,bridge_name='br-int',has_traffic_filtering=True,id=415c1381-e446-4743-8420-56093064c1cb,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap415c1381-e4')
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:35:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9274af2c-557c-4b06-a375-5006f4792f69", "address": "fa:16:3e:69:b1:a3", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9274af2c-55", "ovs_interfaceid": "9274af2c-557c-4b06-a375-5006f4792f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "9274af2c-557c-4b06-a375-5006f4792f69", "address": "fa:16:3e:69:b1:a3", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9274af2c-55", "ovs_interfaceid": "9274af2c-557c-4b06-a375-5006f4792f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:b1:a3,bridge_name='br-int',has_traffic_filtering=True,id=9274af2c-557c-4b06-a375-5006f4792f69,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9274af2c-55') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:b1:a3,bridge_name='br-int',has_traffic_filtering=True,id=9274af2c-557c-4b06-a375-5006f4792f69,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9274af2c-55') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9274af2c-55, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: INFO os_vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:b1:a3,bridge_name='br-int',has_traffic_filtering=True,id=9274af2c-557c-4b06-a375-5006f4792f69,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9274af2c-55')
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:35:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "271512c1-1707-48da-84cf-978ab9e0d202", "address": "fa:16:3e:45:f5:f7", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap271512c1-17", "ovs_interfaceid": "271512c1-1707-48da-84cf-978ab9e0d202", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "271512c1-1707-48da-84cf-978ab9e0d202", "address": "fa:16:3e:45:f5:f7", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap271512c1-17", "ovs_interfaceid": "271512c1-1707-48da-84cf-978ab9e0d202", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:f5:f7,bridge_name='br-int',has_traffic_filtering=True,id=271512c1-1707-48da-84cf-978ab9e0d202,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap271512c1-17') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:f5:f7,bridge_name='br-int',has_traffic_filtering=True,id=271512c1-1707-48da-84cf-978ab9e0d202,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap271512c1-17') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap271512c1-17, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: INFO os_vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:f5:f7,bridge_name='br-int',has_traffic_filtering=True,id=271512c1-1707-48da-84cf-978ab9e0d202,network=Network(0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap271512c1-17')
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:35:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "address": "fa:16:3e:83:c1:f4", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652f5030-20", "ovs_interfaceid": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "address": "fa:16:3e:83:c1:f4", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652f5030-20", "ovs_interfaceid": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:c1:f4,bridge_name='br-int',has_traffic_filtering=True,id=652f5030-2075-40f8-ab87-f86f5dbb6e75,network=Network(d3e5957a-3aa9-4009-9f99-19f55722be34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap652f5030-20') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:c1:f4,bridge_name='br-int',has_traffic_filtering=True,id=652f5030-2075-40f8-ab87-f86f5dbb6e75,network=Network(d3e5957a-3aa9-4009-9f99-19f55722be34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap652f5030-20') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap652f5030-20, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: INFO os_vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:c1:f4,bridge_name='br-int',has_traffic_filtering=True,id=652f5030-2075-40f8-ab87-f86f5dbb6e75,network=Network(d3e5957a-3aa9-4009-9f99-19f55722be34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap652f5030-20')
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9362893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9362893',id=9,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqv32Bu5SD5fnu1aVwhY6nEpVRsTC7IsSXwSJuicLgnqESQ6uHTfwMQjsHT2gWINuHZwWmn8aFd5wxZz5NSHQ4JensBeiQW7ZQhrHx1mKrtvaSpr+C/1OQg427JaY1m1A==',key_name='tempest-keypair-691999092',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50caffcf74fb48dc9bb136c3fecc91c1',ramdisk_id='',reservation_id='r-fsw0e9nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-733706730',owner_user_name='tempest-TaggedBootDevicesTest-733706730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:35:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8ebe5c5921442db9b4ac5a7e0d6e2d',uuid=c4f1da39-1fb7-4551-8be0-10216ab423ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "address": "fa:16:3e:02:41:b2", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ee120-3c", "ovs_interfaceid": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converting VIF {"id": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "address": "fa:16:3e:02:41:b2", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ee120-3c", "ovs_interfaceid": "9c7ee120-3c19-4ba4-8f87-de7384c64d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=9c7ee120-3c19-4ba4-8f87-de7384c64d7a,network=Network(d3e5957a-3aa9-4009-9f99-19f55722be34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ee120-3c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=9c7ee120-3c19-4ba4-8f87-de7384c64d7a,network=Network(d3e5957a-3aa9-4009-9f99-19f55722be34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ee120-3c') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c7ee120-3c, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:36:21 user nova-compute[73091]: INFO os_vif [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:41:b2,bridge_name='br-int',has_traffic_filtering=True,id=9c7ee120-3c19-4ba4-8f87-de7384c64d7a,network=Network(d3e5957a-3aa9-4009-9f99-19f55722be34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ee120-3c')
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkxBeJNG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:36:21 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f9971e-7b62-43d4-9a71-773ce9bf29b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8912dfa4-6392-4177-8ac6-e0104ef179ac]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)
Aug 09 16:36:21 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:36:21 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:36:21 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:36:21 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:36:21 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:36:21 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:36:21 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)
Aug 09 16:36:21 user nova-compute[73091]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 (non-flash)
Aug 09 16:36:21 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:36:21 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:36:21 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:36:21 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:36:21 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:36:21 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0603b6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db66b23-e494-4487-a90d-9512d7b3ace1]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-2d404f54-5fe2-47d8-b036-955d05de1706 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-2d404f54-5fe2-47d8-b036-955d05de1706 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:21 user nova-compute[73091]: WARNING nova.compute.manager [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-2d404f54-5fe2-47d8-b036-955d05de1706 for instance with vm_state active and task_state deleting.
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-unplugged-85a99727-150d-48a7-ba46-bce583a5353b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-unplugged-85a99727-150d-48a7-ba46-bce583a5353b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-unplugged-85a99727-150d-48a7-ba46-bce583a5353b for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-85a99727-150d-48a7-ba46-bce583a5353b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-85a99727-150d-48a7-ba46-bce583a5353b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:21 user nova-compute[73091]: WARNING nova.compute.manager [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-85a99727-150d-48a7-ba46-bce583a5353b for instance with vm_state active and task_state deleting.
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-unplugged-9c7ee120-3c19-4ba4-8f87-de7384c64d7a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-unplugged-9c7ee120-3c19-4ba4-8f87-de7384c64d7a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-unplugged-9c7ee120-3c19-4ba4-8f87-de7384c64d7a for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-9c7ee120-3c19-4ba4-8f87-de7384c64d7a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-9c7ee120-3c19-4ba4-8f87-de7384c64d7a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:21 user nova-compute[73091]: WARNING nova.compute.manager [req-8d9d3752-c360-4abc-b1e9-3ef758f72986 req-46e26d0d-e2c2-41ed-adb8-45f80bc9a2f7 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-9c7ee120-3c19-4ba4-8f87-de7384c64d7a for instance with vm_state active and task_state deleting.
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c0df59-b07c-4e2f-9022-11bd68a6fcb0]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89e8077-f775-488a-8c8b-d70d7733afca]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dbfd92-57c4-4e6b-8d30-e2ba9fe3d1cd]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f48165-3c36-4bc3-8706-adb8c98c92a0]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a038311-8bce-4915-86d8-00018d9f297a]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33, portal: 172.16.0.220,3260]
Aug 09 16:36:22 user nova-compute[73091]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33, portal: 172.16.0.220,3260] successful.
Aug 09 16:36:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5880d5fd-ede8-402d-9010-f7536acf6d33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cb39dc-97d6-4fc6-a0c8-fb18b1f3ee7f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] <== disconnect_volume: return (367ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oshlEfaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:36:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b113a49-e516-444e-b50b-dc828d761423]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de54f61-7561-40b0-b504-f07622a3661b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)
Aug 09 16:36:22 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:36:22 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:36:22 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:36:22 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:36:22 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:36:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)
Aug 09 16:36:22 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f (non-flash)
Aug 09 16:36:22 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:36:22 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:36:22 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:36:22 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:36:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff060389c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-415c1381-e446-4743-8420-56093064c1cb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-415c1381-e446-4743-8420-56093064c1cb {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:22 user nova-compute[73091]: WARNING nova.compute.manager [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-415c1381-e446-4743-8420-56093064c1cb for instance with vm_state active and task_state deleting.
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-unplugged-9274af2c-557c-4b06-a375-5006f4792f69 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-unplugged-9274af2c-557c-4b06-a375-5006f4792f69 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-unplugged-9274af2c-557c-4b06-a375-5006f4792f69 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-9274af2c-557c-4b06-a375-5006f4792f69 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-9274af2c-557c-4b06-a375-5006f4792f69 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:22 user nova-compute[73091]: WARNING nova.compute.manager [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-9274af2c-557c-4b06-a375-5006f4792f69 for instance with vm_state active and task_state deleting.
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-unplugged-652f5030-2075-40f8-ab87-f86f5dbb6e75 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-unplugged-652f5030-2075-40f8-ab87-f86f5dbb6e75 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-unplugged-652f5030-2075-40f8-ab87-f86f5dbb6e75 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-652f5030-2075-40f8-ab87-f86f5dbb6e75 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-652f5030-2075-40f8-ab87-f86f5dbb6e75 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:22 user nova-compute[73091]: WARNING nova.compute.manager [req-4ced793c-16ab-446d-b04b-a90d88dc0ac5 req-582aaa14-bc0b-402d-8e2b-25288d80ff81 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-652f5030-2075-40f8-ab87-f86f5dbb6e75 for instance with vm_state active and task_state deleting.
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d504c69-3af9-498f-a258-b35eef527bcd]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8aa564-e197-47c6-a9cf-9f043255a83b]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7f0df5-46d7-4c79-b7a0-fc5977fcc070]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb664e14-e970-400b-9b0d-f0417d03a156]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d5cc39-249c-40d4-8ee1-c9f87aa6c32e]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-60879ba7-d944-4843-aaab-a20e11f4aec4 req-aed67d52-61f0-49a8-8847-2efc8ac72ae3 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-plugged-271512c1-1707-48da-84cf-978ab9e0d202 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60879ba7-d944-4843-aaab-a20e11f4aec4 req-aed67d52-61f0-49a8-8847-2efc8ac72ae3 service nova] Acquiring lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60879ba7-d944-4843-aaab-a20e11f4aec4 req-aed67d52-61f0-49a8-8847-2efc8ac72ae3 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60879ba7-d944-4843-aaab-a20e11f4aec4 req-aed67d52-61f0-49a8-8847-2efc8ac72ae3 service nova] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-60879ba7-d944-4843-aaab-a20e11f4aec4 req-aed67d52-61f0-49a8-8847-2efc8ac72ae3 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] No waiting events found dispatching network-vif-plugged-271512c1-1707-48da-84cf-978ab9e0d202 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:22 user nova-compute[73091]: WARNING nova.compute.manager [req-60879ba7-d944-4843-aaab-a20e11f4aec4 req-aed67d52-61f0-49a8-8847-2efc8ac72ae3 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received unexpected event network-vif-plugged-271512c1-1707-48da-84cf-978ab9e0d202 for instance with vm_state active and task_state deleting.
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5572ed2a-f3ab-4bd6-b9df-6d8c359894ab]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f, portal: 172.16.0.220,3260]
Aug 09 16:36:22 user nova-compute[73091]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f, portal: 172.16.0.220,3260] successful.
Aug 09 16:36:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44a02bc4-5692-436e-ac17-4e80de184f7f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[798d0a1a-d102-43ec-ae71-e2793d220b1c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] <== disconnect_volume: return (357ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPUsaeKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:36:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[27137202-39c5-47c8-9a3d-47b3421c453d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4cbcf3-ab2e-4706-a2d5-3f6bfd7f80c3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)
Aug 09 16:36:22 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:36:22 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:36:22 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:36:22 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:36:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)
Aug 09 16:36:22 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 (non-flash)
Aug 09 16:36:22 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:36:22 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:36:22 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:36:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff06038aa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312'): ({'sdd'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Removing single pathed devices sdd {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5a4f10-4f15-43d4-bba9-b8a9c066d4f0]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd30efa9-ac67-4aa7-a081-1ae2f6cc985b]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Flushing IO for device /dev/sdd {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd15c5d-1cf8-4525-ad60-3088b7c258bc]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[78777070-6ff0-4a80-a08d-505ed15988d5]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f37c71a-1995-4dce-b128-f231c86ca79f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c842ddb7-d677-41e5-878a-aa537698cf2f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312, portal: 172.16.0.220,3260]
Aug 09 16:36:22 user nova-compute[73091]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312, portal: 172.16.0.220,3260] successful.
Aug 09 16:36:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691598967.7437522, 7e75e099-39c8-4cc4-b3dd-50c67e1b4857 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:36:22 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] VM Stopped (Lifecycle Event)
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1b3bd38b-a3a9-4313-ac0f-f4416b99f9f9 None None] [instance: 7e75e099-39c8-4cc4-b3dd-50c67e1b4857] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91a6b7e6-0b03-4127-8480-7f49d15d5312 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ed9752-f5b8-443b-9524-eeceeafba10e]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] <== disconnect_volume: return (292ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:36:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Deleting instance files /opt/stack/data/nova/instances/c4f1da39-1fb7-4551-8be0-10216ab423ea_del
Aug 09 16:36:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Deletion of /opt/stack/data/nova/instances/c4f1da39-1fb7-4551-8be0-10216ab423ea_del complete
Aug 09 16:36:22 user nova-compute[73091]: INFO nova.compute.manager [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Took 3.36 seconds to destroy the instance on the hypervisor.
Aug 09 16:36:22 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:36:22 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:36:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-df02619b-1a73-42d6-8c58-fb249ad9a768 req-0d03db11-9050-426f-afc8-5d2a3d98acb8 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-deleted-9c7ee120-3c19-4ba4-8f87-de7384c64d7a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:24 user nova-compute[73091]: INFO nova.compute.manager [req-df02619b-1a73-42d6-8c58-fb249ad9a768 req-0d03db11-9050-426f-afc8-5d2a3d98acb8 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Neutron deleted interface 9c7ee120-3c19-4ba4-8f87-de7384c64d7a; detaching it from the instance and deleting it from the info cache
Aug 09 16:36:24 user nova-compute[73091]: DEBUG nova.network.neutron [req-df02619b-1a73-42d6-8c58-fb249ad9a768 req-0d03db11-9050-426f-afc8-5d2a3d98acb8 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Updating instance_info_cache with network_info: [{"id": "2d404f54-5fe2-47d8-b036-955d05de1706", "address": "fa:16:3e:93:70:5b", "network": {"id": "288571f5-6f90-44a8-b1a7-5a66a9a3ed4e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-506239100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d404f54-5f", "ovs_interfaceid": "2d404f54-5fe2-47d8-b036-955d05de1706", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85a99727-150d-48a7-ba46-bce583a5353b", "address": "fa:16:3e:15:52:2a", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a99727-15", "ovs_interfaceid": "85a99727-150d-48a7-ba46-bce583a5353b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "415c1381-e446-4743-8420-56093064c1cb", "address": "fa:16:3e:72:41:a4", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415c1381-e4", "ovs_interfaceid": "415c1381-e446-4743-8420-56093064c1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9274af2c-557c-4b06-a375-5006f4792f69", "address": "fa:16:3e:69:b1:a3", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9274af2c-55", "ovs_interfaceid": "9274af2c-557c-4b06-a375-5006f4792f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "271512c1-1707-48da-84cf-978ab9e0d202", "address": "fa:16:3e:45:f5:f7", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap271512c1-17", "ovs_interfaceid": "271512c1-1707-48da-84cf-978ab9e0d202", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "address": "fa:16:3e:83:c1:f4", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652f5030-20", "ovs_interfaceid": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:36:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-df02619b-1a73-42d6-8c58-fb249ad9a768 req-0d03db11-9050-426f-afc8-5d2a3d98acb8 service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Detach interface failed, port_id=9c7ee120-3c19-4ba4-8f87-de7384c64d7a, reason: Instance c4f1da39-1fb7-4551-8be0-10216ab423ea could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TksBofOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb', 'attached_at': '', 'detached_at': '', 'volume_id': '6c311244-3b9e-4d97-b85a-c9b72f143e90', 'serial': '6c311244-3b9e-4d97-b85a-c9b72f143e90'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCALxzED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'b0edf64d-c049-4bac-ab0f-db636e4f4568'}, 'status': 'reserved', 'instance': '50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0edf64d-c049-4bac-ab0f-db636e4f4568', 'serial'} {{(pid=73091) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TksBofOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:36:25 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:36:25 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:36:25 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae38a7e4-f206-4f21-b399-a73febcade0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:36:25 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c611dd7f-d18f-4ce8-b4ce-bb1cda6bcd55]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90] added
Aug 09 16:36:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e05c53d-ebdd-4ffe-b996-d0968e2d7409]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[665aa510-630f-4083-af83-feee5fa4d870]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TksBofOC {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TksBofOC" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f5c7b4-8846-4848-bebd-f7c8c4612b84]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TksBofOC'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f09840-9fb4-491c-99c6-cdec8a4a5b93]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[79857336-099e-4bf5-9921-25e6a30c4776]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)
Aug 09 16:36:25 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:36:25 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:36:25 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:36:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)
Aug 09 16:36:25 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:36:25 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:36:25 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:36:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[531e38e3-d9f1-4e34-b331-d988b62eb5a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90, portal: 172.16.0.220,3260]
Aug 09 16:36:25 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90, portal: 172.16.0.220,3260] successful.
Aug 09 16:36:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[03afbec2-e2da-4271-887f-d5b624b2f142]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e760ebc-aff8-43fb-a619-8a8e8d6b6f6e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)
Aug 09 16:36:25 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:36:25 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:36:25 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:36:25 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:36:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)
Aug 09 16:36:25 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:36:25 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:36:25 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:36:25 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:36:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10f49b5-d9bb-4f8e-a47a-90f18bf0ac99]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:36:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TksBofOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:36:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:36:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26231393364366465', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:36:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231393364366465', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:36:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:26 user nova-compute[73091]: DEBUG nova.objects.instance [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Lazy-loading 'flavor' on Instance uuid 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:36:26 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:36:26 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Took 3.94 seconds to deallocate network for instance.
Aug 09 16:36:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-5722e19d-1f0d-48e0-8b04-56f5658473fe req-2838f1c6-7e80-4422-9e1a-d3340751c68d service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-deleted-271512c1-1707-48da-84cf-978ab9e0d202 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:26 user nova-compute[73091]: INFO nova.compute.manager [req-5722e19d-1f0d-48e0-8b04-56f5658473fe req-2838f1c6-7e80-4422-9e1a-d3340751c68d service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Neutron deleted interface 271512c1-1707-48da-84cf-978ab9e0d202; detaching it from the instance and deleting it from the info cache
Aug 09 16:36:26 user nova-compute[73091]: DEBUG nova.network.neutron [req-5722e19d-1f0d-48e0-8b04-56f5658473fe req-2838f1c6-7e80-4422-9e1a-d3340751c68d service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Updating instance_info_cache with network_info: [{"id": "2d404f54-5fe2-47d8-b036-955d05de1706", "address": "fa:16:3e:93:70:5b", "network": {"id": "288571f5-6f90-44a8-b1a7-5a66a9a3ed4e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-506239100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d404f54-5f", "ovs_interfaceid": "2d404f54-5fe2-47d8-b036-955d05de1706", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85a99727-150d-48a7-ba46-bce583a5353b", "address": "fa:16:3e:15:52:2a", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a99727-15", "ovs_interfaceid": "85a99727-150d-48a7-ba46-bce583a5353b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "415c1381-e446-4743-8420-56093064c1cb", "address": "fa:16:3e:72:41:a4", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415c1381-e4", "ovs_interfaceid": "415c1381-e446-4743-8420-56093064c1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9274af2c-557c-4b06-a375-5006f4792f69", "address": "fa:16:3e:69:b1:a3", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9274af2c-55", "ovs_interfaceid": "9274af2c-557c-4b06-a375-5006f4792f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "address": "fa:16:3e:83:c1:f4", "network": {"id": "d3e5957a-3aa9-4009-9f99-19f55722be34", "bridge": "br-int", "label": "tempest-device-tagging-net2-1455595301", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap652f5030-20", "ovs_interfaceid": "652f5030-2075-40f8-ab87-f86f5dbb6e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:36:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-5722e19d-1f0d-48e0-8b04-56f5658473fe req-2838f1c6-7e80-4422-9e1a-d3340751c68d service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Detach interface failed, port_id=271512c1-1707-48da-84cf-978ab9e0d202, reason: Instance c4f1da39-1fb7-4551-8be0-10216ab423ea could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 16:36:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-5722e19d-1f0d-48e0-8b04-56f5658473fe req-2838f1c6-7e80-4422-9e1a-d3340751c68d service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-deleted-652f5030-2075-40f8-ab87-f86f5dbb6e75 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:26 user nova-compute[73091]: INFO nova.compute.manager [req-5722e19d-1f0d-48e0-8b04-56f5658473fe req-2838f1c6-7e80-4422-9e1a-d3340751c68d service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Neutron deleted interface 652f5030-2075-40f8-ab87-f86f5dbb6e75; detaching it from the instance and deleting it from the info cache
Aug 09 16:36:26 user nova-compute[73091]: DEBUG nova.network.neutron [req-5722e19d-1f0d-48e0-8b04-56f5658473fe req-2838f1c6-7e80-4422-9e1a-d3340751c68d service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Updating instance_info_cache with network_info: [{"id": "2d404f54-5fe2-47d8-b036-955d05de1706", "address": "fa:16:3e:93:70:5b", "network": {"id": "288571f5-6f90-44a8-b1a7-5a66a9a3ed4e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-506239100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d404f54-5f", "ovs_interfaceid": "2d404f54-5fe2-47d8-b036-955d05de1706", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85a99727-150d-48a7-ba46-bce583a5353b", "address": "fa:16:3e:15:52:2a", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a99727-15", "ovs_interfaceid": "85a99727-150d-48a7-ba46-bce583a5353b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "415c1381-e446-4743-8420-56093064c1cb", "address": "fa:16:3e:72:41:a4", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415c1381-e4", "ovs_interfaceid": "415c1381-e446-4743-8420-56093064c1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9274af2c-557c-4b06-a375-5006f4792f69", "address": "fa:16:3e:69:b1:a3", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9274af2c-55", "ovs_interfaceid": "9274af2c-557c-4b06-a375-5006f4792f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:36:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-5722e19d-1f0d-48e0-8b04-56f5658473fe req-2838f1c6-7e80-4422-9e1a-d3340751c68d service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Detach interface failed, port_id=652f5030-2075-40f8-ab87-f86f5dbb6e75, reason: Instance c4f1da39-1fb7-4551-8be0-10216ab423ea could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 16:36:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-5722e19d-1f0d-48e0-8b04-56f5658473fe req-2838f1c6-7e80-4422-9e1a-d3340751c68d service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-deleted-2d404f54-5fe2-47d8-b036-955d05de1706 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:26 user nova-compute[73091]: INFO nova.compute.manager [req-5722e19d-1f0d-48e0-8b04-56f5658473fe req-2838f1c6-7e80-4422-9e1a-d3340751c68d service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Neutron deleted interface 2d404f54-5fe2-47d8-b036-955d05de1706; detaching it from the instance and deleting it from the info cache
Aug 09 16:36:26 user nova-compute[73091]: DEBUG nova.network.neutron [req-5722e19d-1f0d-48e0-8b04-56f5658473fe req-2838f1c6-7e80-4422-9e1a-d3340751c68d service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Updating instance_info_cache with network_info: [{"id": "85a99727-150d-48a7-ba46-bce583a5353b", "address": "fa:16:3e:15:52:2a", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a99727-15", "ovs_interfaceid": "85a99727-150d-48a7-ba46-bce583a5353b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "415c1381-e446-4743-8420-56093064c1cb", "address": "fa:16:3e:72:41:a4", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415c1381-e4", "ovs_interfaceid": "415c1381-e446-4743-8420-56093064c1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9274af2c-557c-4b06-a375-5006f4792f69", "address": "fa:16:3e:69:b1:a3", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9274af2c-55", "ovs_interfaceid": "9274af2c-557c-4b06-a375-5006f4792f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:36:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-5722e19d-1f0d-48e0-8b04-56f5658473fe req-2838f1c6-7e80-4422-9e1a-d3340751c68d service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Detach interface failed, port_id=2d404f54-5fe2-47d8-b036-955d05de1706, reason: Instance c4f1da39-1fb7-4551-8be0-10216ab423ea could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 16:36:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-5722e19d-1f0d-48e0-8b04-56f5658473fe req-2838f1c6-7e80-4422-9e1a-d3340751c68d service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Received event network-vif-deleted-9274af2c-557c-4b06-a375-5006f4792f69 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:26 user nova-compute[73091]: INFO nova.compute.manager [req-5722e19d-1f0d-48e0-8b04-56f5658473fe req-2838f1c6-7e80-4422-9e1a-d3340751c68d service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Neutron deleted interface 9274af2c-557c-4b06-a375-5006f4792f69; detaching it from the instance and deleting it from the info cache
Aug 09 16:36:26 user nova-compute[73091]: DEBUG nova.network.neutron [req-5722e19d-1f0d-48e0-8b04-56f5658473fe req-2838f1c6-7e80-4422-9e1a-d3340751c68d service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Updating instance_info_cache with network_info: [{"id": "85a99727-150d-48a7-ba46-bce583a5353b", "address": "fa:16:3e:15:52:2a", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a99727-15", "ovs_interfaceid": "85a99727-150d-48a7-ba46-bce583a5353b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "415c1381-e446-4743-8420-56093064c1cb", "address": "fa:16:3e:72:41:a4", "network": {"id": "0bfea2d6-32ac-4cb2-bae6-9efbd24ab1ef", "bridge": "br-int", "label": "tempest-device-tagging-net1-878518637", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "50caffcf74fb48dc9bb136c3fecc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415c1381-e4", "ovs_interfaceid": "415c1381-e446-4743-8420-56093064c1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:36:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-5722e19d-1f0d-48e0-8b04-56f5658473fe req-2838f1c6-7e80-4422-9e1a-d3340751c68d service nova] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Detach interface failed, port_id=9274af2c-557c-4b06-a375-5006f4792f69, reason: Instance c4f1da39-1fb7-4551-8be0-10216ab423ea could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 16:36:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] COPY block job progress, current cursor: 8388608 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:36:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] COPY block job progress, current cursor: 28311552 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:36:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] COPY block job progress, current cursor: 124780544 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:36:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] COPY block job progress, current cursor: 234881024 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:36:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] COPY block job progress, current cursor: 373293056 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:36:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] COPY block job progress, current cursor: 520093696 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:36:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] COPY block job progress, current cursor: 661651456 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:36:30 user nova-compute[73091]: INFO nova.compute.manager [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Took 3.78 seconds to detach 3 volumes for instance.
Aug 09 16:36:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] COPY block job progress, current cursor: 802160640 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:36:31 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:36:31 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:36:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:31 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Deleted allocations for instance c4f1da39-1fb7-4551-8be0-10216ab423ea
Aug 09 16:36:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] COPY block job progress, current cursor: 907018240 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:36:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c3f3a8fd-01d6-44cc-9ed9-c3085a3c8676 tempest-TaggedBootDevicesTest-733706730 tempest-TaggedBootDevicesTest-733706730-project-member] Lock "c4f1da39-1fb7-4551-8be0-10216ab423ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.904s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:36:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:36:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCALxzED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'b0edf64d-c049-4bac-ab0f-db636e4f4568'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:36:31 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:36:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:36:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:36:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:36:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5a9f8f-7249-4a2f-bfe7-1bca631ef592]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d8f546-3ccd-42d2-80c6-4f431392d78d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)
Aug 09 16:36:32 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:36:32 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:36:32 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:36:32 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:36:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 (non-flash)
Aug 09 16:36:32 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:36:32 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:36:32 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:36:32 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:36:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff06038f370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568'): ({'sdf'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Removing single pathed devices sdf {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9127843b-73b2-4c67-8cc5-2a1c448bc81f]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97cd804-d747-4e30-a7c4-2325b434018d]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Flushing IO for device /dev/sdf {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf44fe1-e6c3-45e2-bcc7-0ad3267673b5]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4560d241-e6d0-4595-84a6-699493585c4c]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabe9ef6-e6b9-4c09-b7b1-b128af7686c5]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dc07c2-174b-415e-a3d8-89a091efa41f]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568, portal: 172.16.0.220,3260]
Aug 09 16:36:32 user nova-compute[73091]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568, portal: 172.16.0.220,3260] successful.
Aug 09 16:36:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0edf64d-c049-4bac-ab0f-db636e4f4568 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef74ef5-e24d-49c4-bf1e-58b7e6aab882]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] <== disconnect_volume: return (306ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TksBofOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb', 'attached_at': '', 'detached_at': '', 'volume_id': '6c311244-3b9e-4d97-b85a-c9b72f143e90', 'serial'} {{(pid=73091) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 09 16:36:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] swap_volume: removing Cinder connection for volume b0edf64d-c049-4bac-ab0f-db636e4f4568 {{(pid=73091) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 09 16:36:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] swap_volume: Updating volume b0edf64d-c049-4bac-ab0f-db636e4f4568 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "TksBofOC", "auth_password": "QFfvUgE9ek3SCj", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "6c311244-3b9e-4d97-b85a-c9b72f143e90"}, "status": "reserved", "instance": "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb", "attached_at": "", "detached_at": "", "volume_id": "6c311244-3b9e-4d97-b85a-c9b72f143e90", "serial": "6c311244-3b9e-4d97-b85a-c9b72f143e90"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '6c311244-3b9e-4d97-b85a-c9b72f143e90', 'no_device': None, 'attachment_id': 'e6d3a5d7-71dd-4820-a1f4-575898b7b8f9'} {{(pid=73091) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 09 16:36:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-11f596fe-60e0-4bc2-8f1b-c93443886d86 tempest-TestVolumeSwap-1036114532 tempest-TestVolumeSwap-1036114532-project-admin] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.125s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Acquiring lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:34 user nova-compute[73091]: INFO nova.compute.manager [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Detaching volume 6c311244-3b9e-4d97-b85a-c9b72f143e90
Aug 09 16:36:34 user nova-compute[73091]: INFO nova.virt.block_device [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Attempting to driver detach volume 6c311244-3b9e-4d97-b85a-c9b72f143e90 from mountpoint /dev/vdb
Aug 09 16:36:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Attempting to detach device vdb from instance 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:36:34 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:36:34 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 16:36:34 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:36:34 user nova-compute[73091]:   <serial>6c311244-3b9e-4d97-b85a-c9b72f143e90</serial>
Aug 09 16:36:34 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:36:34 user nova-compute[73091]: </disk>
Aug 09 16:36:34 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:36:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Successfully detached device vdb from instance 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb from the persistent domain config.
Aug 09 16:36:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:36:34 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:36:34 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 16:36:34 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:36:34 user nova-compute[73091]:   <serial>6c311244-3b9e-4d97-b85a-c9b72f143e90</serial>
Aug 09 16:36:34 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:36:34 user nova-compute[73091]: </disk>
Aug 09 16:36:34 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691598994.6638536, 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:36:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Successfully detached device vdb from instance 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb from the live domain config.
Aug 09 16:36:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TksBofOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '6c311244-3b9e-4d97-b85a-c9b72f143e90'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:36:34 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:36:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea04020f-8044-41a5-8d89-7ee1f47ad670]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1bd519-3485-4340-a0b4-8fad088899c8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:36:34 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:36:34 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:36:34 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:36:34 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 (non-flash)
Aug 09 16:36:34 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:36:34 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:36:34 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:36:34 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0603b5f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[79964e8a-6868-4d87-ab7f-bde3100b8550]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb39992-55cf-4130-b7fb-49c268a818a6]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2365a5-1bd0-46c7-935d-4e458cd0dd02]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfe4900-289a-4389-85a3-e88c0284174b]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4967d89d-e756-4095-9bfb-6eda822b1543]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d852b5-ad79-4d57-af39-08958b4e907a]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90, portal: 172.16.0.220,3260]
Aug 09 16:36:34 user nova-compute[73091]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90, portal: 172.16.0.220,3260] successful.
Aug 09 16:36:34 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c311244-3b9e-4d97-b85a-c9b72f143e90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[329a3ddf-cc4c-4b86-8b83-63d2d2b5a624]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] <== disconnect_volume: return (276ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:36:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:36:35 user nova-compute[73091]: DEBUG nova.objects.instance [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lazy-loading 'flavor' on Instance uuid 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:36:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-48e43eac-93ab-4392-92c3-8eb91d6c919f tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.594s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:36 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691598981.352006, c4f1da39-1fb7-4551-8be0-10216ab423ea => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:36:36 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] VM Stopped (Lifecycle Event)
Aug 09 16:36:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1043a104-548a-428a-b36a-fd770da91c1e None None] [instance: c4f1da39-1fb7-4551-8be0-10216ab423ea] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:36:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:36:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:36:40 user nova-compute[73091]: INFO nova.compute.claims [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Claim successful on node user
Aug 09 16:36:41 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG nova.network.neutron [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:36:41 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:36:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG nova.policy [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8956fad221ec4dedb700f034d5230c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c913ceef2c4610a26bd19df29ee896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:36:41 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Creating image(s)
Aug 09 16:36:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "/opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "/opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "/opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.152s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.151s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk 1073741824" returned: 0 in 0.063s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:36:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:36:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Successfully created port: 54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:36:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:36:42 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Cannot resize image /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:36:42 user nova-compute[73091]: DEBUG nova.objects.instance [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lazy-loading 'migration_context' on Instance uuid 18d8e887-0f91-42e1-ba79-13db5aa9b84b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:36:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:36:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Ensure instance console log exists: /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:36:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Successfully updated port: 54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:36:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "refresh_cache-18d8e887-0f91-42e1-ba79-13db5aa9b84b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:36:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquired lock "refresh_cache-18d8e887-0f91-42e1-ba79-13db5aa9b84b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:36:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:36:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-66c9d95a-143b-4674-abf8-c377ebf640e5 req-aa88b278-99a3-42b8-9716-e84ddcc9d436 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Received event network-changed-54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-66c9d95a-143b-4674-abf8-c377ebf640e5 req-aa88b278-99a3-42b8-9716-e84ddcc9d436 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Refreshing instance network info cache due to event network-changed-54c1bb8c-584f-446c-9b64-c840c486a4f1. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:36:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-66c9d95a-143b-4674-abf8-c377ebf640e5 req-aa88b278-99a3-42b8-9716-e84ddcc9d436 service nova] Acquiring lock "refresh_cache-18d8e887-0f91-42e1-ba79-13db5aa9b84b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:36:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.network.neutron [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Updating instance_info_cache with network_info: [{"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Releasing lock "refresh_cache-18d8e887-0f91-42e1-ba79-13db5aa9b84b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Instance network_info: |[{"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-66c9d95a-143b-4674-abf8-c377ebf640e5 req-aa88b278-99a3-42b8-9716-e84ddcc9d436 service nova] Acquired lock "refresh_cache-18d8e887-0f91-42e1-ba79-13db5aa9b84b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-66c9d95a-143b-4674-abf8-c377ebf640e5 req-aa88b278-99a3-42b8-9716-e84ddcc9d436 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Refreshing network info cache for port 54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Start _get_guest_xml network_info=[{"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:36:43 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:36:43 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:36:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1364187165',display_name='tempest-ServerActionsTestOtherA-server-1364187165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1364187165',id=13,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILfado63mW6+CgjHmwYiNct4RkaQ/hFrQzjzGZX9fcd5tmDChxbl9riU31kjgrW3xhMcxzy/FY8sPsumtyuqQ7ittcRZasxYBvL6XWrt/5jr8BpeJz8IvTq6jqpzExzYw==',key_name='tempest-keypair-1434010925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38c913ceef2c4610a26bd19df29ee896',ramdisk_id='',reservation_id='r-m5ng6wc3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-813213856',owner_user_name='tempest-ServerActionsTestOtherA-813213856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:36:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8956fad221ec4dedb700f034d5230c06',uuid=18d8e887-0f91-42e1-ba79-13db5aa9b84b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converting VIF {"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:c1:ba,bridge_name='br-int',has_traffic_filtering=True,id=54c1bb8c-584f-446c-9b64-c840c486a4f1,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c1bb8c-58') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.objects.instance [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lazy-loading 'pci_devices' on Instance uuid 18d8e887-0f91-42e1-ba79-13db5aa9b84b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:36:43 user nova-compute[73091]:   <uuid>18d8e887-0f91-42e1-ba79-13db5aa9b84b</uuid>
Aug 09 16:36:43 user nova-compute[73091]:   <name>instance-0000000d</name>
Aug 09 16:36:43 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:36:43 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:36:43 user nova-compute[73091]:   <metadata>
Aug 09 16:36:43 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:36:43 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:36:43 user nova-compute[73091]:       <nova:name>tempest-ServerActionsTestOtherA-server-1364187165</nova:name>
Aug 09 16:36:43 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:36:43</nova:creationTime>
Aug 09 16:36:43 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:36:43 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:36:43 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:36:43 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:36:43 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:36:43 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:36:43 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:36:43 user nova-compute[73091]:       <nova:owner>
Aug 09 16:36:43 user nova-compute[73091]:         <nova:user uuid="8956fad221ec4dedb700f034d5230c06">tempest-ServerActionsTestOtherA-813213856-project-member</nova:user>
Aug 09 16:36:43 user nova-compute[73091]:         <nova:project uuid="38c913ceef2c4610a26bd19df29ee896">tempest-ServerActionsTestOtherA-813213856</nova:project>
Aug 09 16:36:43 user nova-compute[73091]:       </nova:owner>
Aug 09 16:36:43 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:36:43 user nova-compute[73091]:       <nova:ports>
Aug 09 16:36:43 user nova-compute[73091]:         <nova:port uuid="54c1bb8c-584f-446c-9b64-c840c486a4f1">
Aug 09 16:36:43 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 16:36:43 user nova-compute[73091]:         </nova:port>
Aug 09 16:36:43 user nova-compute[73091]:       </nova:ports>
Aug 09 16:36:43 user nova-compute[73091]:     </nova:instance>
Aug 09 16:36:43 user nova-compute[73091]:   </metadata>
Aug 09 16:36:43 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:36:43 user nova-compute[73091]:     <system>
Aug 09 16:36:43 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:36:43 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:36:43 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:36:43 user nova-compute[73091]:       <entry name="serial">18d8e887-0f91-42e1-ba79-13db5aa9b84b</entry>
Aug 09 16:36:43 user nova-compute[73091]:       <entry name="uuid">18d8e887-0f91-42e1-ba79-13db5aa9b84b</entry>
Aug 09 16:36:43 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:36:43 user nova-compute[73091]:     </system>
Aug 09 16:36:43 user nova-compute[73091]:   </sysinfo>
Aug 09 16:36:43 user nova-compute[73091]:   <os>
Aug 09 16:36:43 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:36:43 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:36:43 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:36:43 user nova-compute[73091]:   </os>
Aug 09 16:36:43 user nova-compute[73091]:   <features>
Aug 09 16:36:43 user nova-compute[73091]:     <acpi/>
Aug 09 16:36:43 user nova-compute[73091]:     <apic/>
Aug 09 16:36:43 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:36:43 user nova-compute[73091]:   </features>
Aug 09 16:36:43 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:36:43 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:36:43 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:36:43 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:36:43 user nova-compute[73091]:   </clock>
Aug 09 16:36:43 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:36:43 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:36:43 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:36:43 user nova-compute[73091]:   </cpu>
Aug 09 16:36:43 user nova-compute[73091]:   <devices>
Aug 09 16:36:43 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:36:43 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:36:43 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk"/>
Aug 09 16:36:43 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:36:43 user nova-compute[73091]:     </disk>
Aug 09 16:36:43 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:36:43 user nova-compute[73091]:       <mac address="fa:16:3e:45:c1:ba"/>
Aug 09 16:36:43 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:36:43 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:36:43 user nova-compute[73091]:       <target dev="tap54c1bb8c-58"/>
Aug 09 16:36:43 user nova-compute[73091]:     </interface>
Aug 09 16:36:43 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:36:43 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/console.log" append="off"/>
Aug 09 16:36:43 user nova-compute[73091]:     </serial>
Aug 09 16:36:43 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:36:43 user nova-compute[73091]:     <video>
Aug 09 16:36:43 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:36:43 user nova-compute[73091]:     </video>
Aug 09 16:36:43 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:36:43 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:36:43 user nova-compute[73091]:     </rng>
Aug 09 16:36:43 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:36:43 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:36:43 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:36:43 user nova-compute[73091]:     </memballoon>
Aug 09 16:36:43 user nova-compute[73091]:   </devices>
Aug 09 16:36:43 user nova-compute[73091]: </domain>
Aug 09 16:36:43 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:36:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1364187165',display_name='tempest-ServerActionsTestOtherA-server-1364187165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1364187165',id=13,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILfado63mW6+CgjHmwYiNct4RkaQ/hFrQzjzGZX9fcd5tmDChxbl9riU31kjgrW3xhMcxzy/FY8sPsumtyuqQ7ittcRZasxYBvL6XWrt/5jr8BpeJz8IvTq6jqpzExzYw==',key_name='tempest-keypair-1434010925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38c913ceef2c4610a26bd19df29ee896',ramdisk_id='',reservation_id='r-m5ng6wc3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-813213856',owner_user_name='tempest-ServerActionsTestOtherA-813213856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:36:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8956fad221ec4dedb700f034d5230c06',uuid=18d8e887-0f91-42e1-ba79-13db5aa9b84b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converting VIF {"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:c1:ba,bridge_name='br-int',has_traffic_filtering=True,id=54c1bb8c-584f-446c-9b64-c840c486a4f1,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c1bb8c-58') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG os_vif [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:c1:ba,bridge_name='br-int',has_traffic_filtering=True,id=54c1bb8c-584f-446c-9b64-c840c486a4f1,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c1bb8c-58') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54c1bb8c-58, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap54c1bb8c-58, col_values=(('external_ids', {'iface-id': '54c1bb8c-584f-446c-9b64-c840c486a4f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:c1:ba', 'vm-uuid': '18d8e887-0f91-42e1-ba79-13db5aa9b84b'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:43 user nova-compute[73091]: INFO os_vif [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:c1:ba,bridge_name='br-int',has_traffic_filtering=True,id=54c1bb8c-584f-446c-9b64-c840c486a4f1,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c1bb8c-58')
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] No VIF found with MAC fa:16:3e:45:c1:ba, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-66c9d95a-143b-4674-abf8-c377ebf640e5 req-aa88b278-99a3-42b8-9716-e84ddcc9d436 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Updated VIF entry in instance network info cache for port 54c1bb8c-584f-446c-9b64-c840c486a4f1. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-66c9d95a-143b-4674-abf8-c377ebf640e5 req-aa88b278-99a3-42b8-9716-e84ddcc9d436 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Updating instance_info_cache with network_info: [{"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:36:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-66c9d95a-143b-4674-abf8-c377ebf640e5 req-aa88b278-99a3-42b8-9716-e84ddcc9d436 service nova] Releasing lock "refresh_cache-18d8e887-0f91-42e1-ba79-13db5aa9b84b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:36:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-f63676a4-96cb-413c-beab-f6b08394210e req-f89fd5ac-a863-40d2-b78c-2ceeee316ff2 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Received event network-vif-plugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f63676a4-96cb-413c-beab-f6b08394210e req-f89fd5ac-a863-40d2-b78c-2ceeee316ff2 service nova] Acquiring lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f63676a4-96cb-413c-beab-f6b08394210e req-f89fd5ac-a863-40d2-b78c-2ceeee316ff2 service nova] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f63676a4-96cb-413c-beab-f6b08394210e req-f89fd5ac-a863-40d2-b78c-2ceeee316ff2 service nova] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-f63676a4-96cb-413c-beab-f6b08394210e req-f89fd5ac-a863-40d2-b78c-2ceeee316ff2 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] No waiting events found dispatching network-vif-plugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:44 user nova-compute[73091]: WARNING nova.compute.manager [req-f63676a4-96cb-413c-beab-f6b08394210e req-f89fd5ac-a863-40d2-b78c-2ceeee316ff2 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Received unexpected event network-vif-plugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 for instance with vm_state building and task_state spawning.
Aug 09 16:36:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquiring lock "117928be-d7c7-4d40-a0ef-2a88c360cfec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "117928be-d7c7-4d40-a0ef-2a88c360cfec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquiring lock "117928be-d7c7-4d40-a0ef-2a88c360cfec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "117928be-d7c7-4d40-a0ef-2a88c360cfec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "117928be-d7c7-4d40-a0ef-2a88c360cfec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:45 user nova-compute[73091]: INFO nova.compute.manager [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Terminating instance
Aug 09 16:36:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-d0c998cf-6fcd-4f3e-a1ab-dc3fa898c160 req-49dc5bc5-fa8e-4af9-bfe3-89b20e0ab063 service nova] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Received event network-vif-unplugged-525a0b55-12b7-47ff-9223-1fcfb3205ca3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d0c998cf-6fcd-4f3e-a1ab-dc3fa898c160 req-49dc5bc5-fa8e-4af9-bfe3-89b20e0ab063 service nova] Acquiring lock "117928be-d7c7-4d40-a0ef-2a88c360cfec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d0c998cf-6fcd-4f3e-a1ab-dc3fa898c160 req-49dc5bc5-fa8e-4af9-bfe3-89b20e0ab063 service nova] Lock "117928be-d7c7-4d40-a0ef-2a88c360cfec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d0c998cf-6fcd-4f3e-a1ab-dc3fa898c160 req-49dc5bc5-fa8e-4af9-bfe3-89b20e0ab063 service nova] Lock "117928be-d7c7-4d40-a0ef-2a88c360cfec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-d0c998cf-6fcd-4f3e-a1ab-dc3fa898c160 req-49dc5bc5-fa8e-4af9-bfe3-89b20e0ab063 service nova] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] No waiting events found dispatching network-vif-unplugged-525a0b55-12b7-47ff-9223-1fcfb3205ca3 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-d0c998cf-6fcd-4f3e-a1ab-dc3fa898c160 req-49dc5bc5-fa8e-4af9-bfe3-89b20e0ab063 service nova] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Received event network-vif-unplugged-525a0b55-12b7-47ff-9223-1fcfb3205ca3 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Instance destroyed successfully.
Aug 09 16:36:45 user nova-compute[73091]: DEBUG nova.objects.instance [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lazy-loading 'resources' on Instance uuid 117928be-d7c7-4d40-a0ef-2a88c360cfec {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:34:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-94900830',display_name='tempest-ServersNegativeTestJSON-server-94900830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-94900830',id=11,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:35:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e547803499e4aa59f4ec4c4af9bd4da',ramdisk_id='',reservation_id='r-lcvlkr5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-484230207',owner_user_name='tempest-ServersNegativeTestJSON-484230207-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:35:02Z,user_data=None,user_id='2bcb694325ff4b6ab46c3b26f625ef1f',uuid=117928be-d7c7-4d40-a0ef-2a88c360cfec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "525a0b55-12b7-47ff-9223-1fcfb3205ca3", "address": "fa:16:3e:b1:d1:8e", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525a0b55-12", "ovs_interfaceid": "525a0b55-12b7-47ff-9223-1fcfb3205ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Converting VIF {"id": "525a0b55-12b7-47ff-9223-1fcfb3205ca3", "address": "fa:16:3e:b1:d1:8e", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525a0b55-12", "ovs_interfaceid": "525a0b55-12b7-47ff-9223-1fcfb3205ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d1:8e,bridge_name='br-int',has_traffic_filtering=True,id=525a0b55-12b7-47ff-9223-1fcfb3205ca3,network=Network(450122ab-0e98-4dd4-9f52-82aa1bfaa561),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525a0b55-12') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG os_vif [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d1:8e,bridge_name='br-int',has_traffic_filtering=True,id=525a0b55-12b7-47ff-9223-1fcfb3205ca3,network=Network(450122ab-0e98-4dd4-9f52-82aa1bfaa561),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525a0b55-12') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap525a0b55-12, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:36:45 user nova-compute[73091]: INFO os_vif [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d1:8e,bridge_name='br-int',has_traffic_filtering=True,id=525a0b55-12b7-47ff-9223-1fcfb3205ca3,network=Network(450122ab-0e98-4dd4-9f52-82aa1bfaa561),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525a0b55-12')
Aug 09 16:36:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Deleting instance files /opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec_del
Aug 09 16:36:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Deletion of /opt/stack/data/nova/instances/117928be-d7c7-4d40-a0ef-2a88c360cfec_del complete
Aug 09 16:36:46 user nova-compute[73091]: INFO nova.compute.manager [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 09 16:36:46 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:36:46 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:36:46 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:36:46 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:36:46 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Took 0.59 seconds to deallocate network for instance.
Aug 09 16:36:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-d446b6dc-5f63-409a-9e9a-f43c1fc16b6e req-bb7f18d4-d009-45b0-b3a7-ed39aa36b5b0 service nova] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Received event network-vif-deleted-525a0b55-12b7-47ff-9223-1fcfb3205ca3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:46 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599006.9659233, 18d8e887-0f91-42e1-ba79-13db5aa9b84b => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:36:46 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] VM Resumed (Lifecycle Event)
Aug 09 16:36:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:36:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:36:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-bb240243-1d8a-4d32-9d5e-94f4ef85bff5 req-f845d83d-ab93-45c6-a326-e4613b3d47d5 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Received event network-vif-plugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bb240243-1d8a-4d32-9d5e-94f4ef85bff5 req-f845d83d-ab93-45c6-a326-e4613b3d47d5 service nova] Acquiring lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bb240243-1d8a-4d32-9d5e-94f4ef85bff5 req-f845d83d-ab93-45c6-a326-e4613b3d47d5 service nova] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bb240243-1d8a-4d32-9d5e-94f4ef85bff5 req-f845d83d-ab93-45c6-a326-e4613b3d47d5 service nova] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-bb240243-1d8a-4d32-9d5e-94f4ef85bff5 req-f845d83d-ab93-45c6-a326-e4613b3d47d5 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] No waiting events found dispatching network-vif-plugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:46 user nova-compute[73091]: WARNING nova.compute.manager [req-bb240243-1d8a-4d32-9d5e-94f4ef85bff5 req-f845d83d-ab93-45c6-a326-e4613b3d47d5 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Received unexpected event network-vif-plugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 for instance with vm_state building and task_state spawning.
Aug 09 16:36:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:36:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Instance spawned successfully.
Aug 09 16:36:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:36:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:36:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:36:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:36:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:36:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:36:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:36:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:36:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:36:47 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599006.972021, 18d8e887-0f91-42e1-ba79-13db5aa9b84b => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:36:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] VM Started (Lifecycle Event)
Aug 09 16:36:47 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:36:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:36:47 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:36:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:36:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:36:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:47 user nova-compute[73091]: INFO nova.compute.manager [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Took 5.69 seconds to spawn the instance on the hypervisor.
Aug 09 16:36:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:36:47 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Deleted allocations for instance 117928be-d7c7-4d40-a0ef-2a88c360cfec
Aug 09 16:36:47 user nova-compute[73091]: INFO nova.compute.manager [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Took 6.46 seconds to build instance.
Aug 09 16:36:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-345383ab-a04a-4ab0-a2e9-5e43188af368 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.602s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-66ffadbe-d3a6-4a97-a7ad-6e144e94b5e0 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "117928be-d7c7-4d40-a0ef-2a88c360cfec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.896s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-411cf975-5ada-40d7-849b-bc4feeef4bc3 req-35ee6e0b-d7b3-45ef-a46c-d1a2620cae5f service nova] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Received event network-vif-plugged-525a0b55-12b7-47ff-9223-1fcfb3205ca3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-411cf975-5ada-40d7-849b-bc4feeef4bc3 req-35ee6e0b-d7b3-45ef-a46c-d1a2620cae5f service nova] Acquiring lock "117928be-d7c7-4d40-a0ef-2a88c360cfec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-411cf975-5ada-40d7-849b-bc4feeef4bc3 req-35ee6e0b-d7b3-45ef-a46c-d1a2620cae5f service nova] Lock "117928be-d7c7-4d40-a0ef-2a88c360cfec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-411cf975-5ada-40d7-849b-bc4feeef4bc3 req-35ee6e0b-d7b3-45ef-a46c-d1a2620cae5f service nova] Lock "117928be-d7c7-4d40-a0ef-2a88c360cfec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-411cf975-5ada-40d7-849b-bc4feeef4bc3 req-35ee6e0b-d7b3-45ef-a46c-d1a2620cae5f service nova] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] No waiting events found dispatching network-vif-plugged-525a0b55-12b7-47ff-9223-1fcfb3205ca3 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:47 user nova-compute[73091]: WARNING nova.compute.manager [req-411cf975-5ada-40d7-849b-bc4feeef4bc3 req-35ee6e0b-d7b3-45ef-a46c-d1a2620cae5f service nova] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Received unexpected event network-vif-plugged-525a0b55-12b7-47ff-9223-1fcfb3205ca3 for instance with vm_state deleted and task_state None.
Aug 09 16:36:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Acquiring lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Acquiring lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:49 user nova-compute[73091]: INFO nova.compute.manager [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Terminating instance
Aug 09 16:36:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:36:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-a0c88a16-2db2-4db0-9244-f9fd5e544c75 req-d8dda35b-66e7-4ce8-8b4d-9986992f882e service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Received event network-vif-unplugged-0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a0c88a16-2db2-4db0-9244-f9fd5e544c75 req-d8dda35b-66e7-4ce8-8b4d-9986992f882e service nova] Acquiring lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a0c88a16-2db2-4db0-9244-f9fd5e544c75 req-d8dda35b-66e7-4ce8-8b4d-9986992f882e service nova] Lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a0c88a16-2db2-4db0-9244-f9fd5e544c75 req-d8dda35b-66e7-4ce8-8b4d-9986992f882e service nova] Lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-a0c88a16-2db2-4db0-9244-f9fd5e544c75 req-d8dda35b-66e7-4ce8-8b4d-9986992f882e service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] No waiting events found dispatching network-vif-unplugged-0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-a0c88a16-2db2-4db0-9244-f9fd5e544c75 req-d8dda35b-66e7-4ce8-8b4d-9986992f882e service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Received event network-vif-unplugged-0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:36:50 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Instance destroyed successfully.
Aug 09 16:36:50 user nova-compute[73091]: DEBUG nova.objects.instance [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Lazy-loading 'resources' on Instance uuid 7bcc1e42-532f-4fb6-984e-cdf659cfef7c {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:36:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:33:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1861677714',display_name='tempest-VolumesAssistedSnapshotsTest-server-1861677714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1861677714',id=4,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAD6vhA8PO2oSAh8Sc4+JzGfPF/3zRcrYx4SD5pASLfp4jCpmm2+LJmv6VLZ/pZ6yoGGXgaMequpz4smViMr3Wn4oDksLo1C+sDYGxXE5OeUt8W8UyErllgE3kGe7X00iQ==',key_name='tempest-keypair-460922789',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:33:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d63eb933f4d40cdb34d3a27c76c9720',ramdisk_id='',reservation_id='r-rttbas3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1035695306',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1035695306-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:33:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0eed7686d5eb46b99f8872f4eabc1f72',uuid=7bcc1e42-532f-4fb6-984e-cdf659cfef7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "address": "fa:16:3e:11:4b:40", "network": {"id": "4ec80c56-7d1a-4fbe-81a2-7d12e69c94e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5225565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d63eb933f4d40cdb34d3a27c76c9720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d2e6e-6d", "ovs_interfaceid": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:36:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Converting VIF {"id": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "address": "fa:16:3e:11:4b:40", "network": {"id": "4ec80c56-7d1a-4fbe-81a2-7d12e69c94e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-5225565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d63eb933f4d40cdb34d3a27c76c9720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d2e6e-6d", "ovs_interfaceid": "0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:36:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:4b:40,bridge_name='br-int',has_traffic_filtering=True,id=0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f,network=Network(4ec80c56-7d1a-4fbe-81a2-7d12e69c94e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9d2e6e-6d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:36:50 user nova-compute[73091]: DEBUG os_vif [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:4b:40,bridge_name='br-int',has_traffic_filtering=True,id=0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f,network=Network(4ec80c56-7d1a-4fbe-81a2-7d12e69c94e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9d2e6e-6d') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:36:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c9d2e6e-6d, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:36:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:36:50 user nova-compute[73091]: INFO os_vif [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:4b:40,bridge_name='br-int',has_traffic_filtering=True,id=0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f,network=Network(4ec80c56-7d1a-4fbe-81a2-7d12e69c94e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9d2e6e-6d')
Aug 09 16:36:50 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Deleting instance files /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c_del
Aug 09 16:36:50 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Deletion of /opt/stack/data/nova/instances/7bcc1e42-532f-4fb6-984e-cdf659cfef7c_del complete
Aug 09 16:36:50 user nova-compute[73091]: INFO nova.compute.manager [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 16:36:50 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:36:50 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:36:50 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:36:51 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:36:51 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Took 1.13 seconds to deallocate network for instance.
Aug 09 16:36:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquiring lock "ec2187af-1b88-4c23-abba-2f09db3057d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquiring lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:52 user nova-compute[73091]: INFO nova.compute.manager [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Terminating instance
Aug 09 16:36:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-16189b79-811c-4782-8b8e-61169a7b07c2 req-2bc9b327-1bf1-4a5a-949c-112bed5db3d7 service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Received event network-vif-plugged-0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16189b79-811c-4782-8b8e-61169a7b07c2 req-2bc9b327-1bf1-4a5a-949c-112bed5db3d7 service nova] Acquiring lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16189b79-811c-4782-8b8e-61169a7b07c2 req-2bc9b327-1bf1-4a5a-949c-112bed5db3d7 service nova] Lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16189b79-811c-4782-8b8e-61169a7b07c2 req-2bc9b327-1bf1-4a5a-949c-112bed5db3d7 service nova] Lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-16189b79-811c-4782-8b8e-61169a7b07c2 req-2bc9b327-1bf1-4a5a-949c-112bed5db3d7 service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] No waiting events found dispatching network-vif-plugged-0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:52 user nova-compute[73091]: WARNING nova.compute.manager [req-16189b79-811c-4782-8b8e-61169a7b07c2 req-2bc9b327-1bf1-4a5a-949c-112bed5db3d7 service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Received unexpected event network-vif-plugged-0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f for instance with vm_state deleted and task_state None.
Aug 09 16:36:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-16189b79-811c-4782-8b8e-61169a7b07c2 req-2bc9b327-1bf1-4a5a-949c-112bed5db3d7 service nova] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Received event network-vif-deleted-0c9d2e6e-6d2d-4aa8-9f22-21acfb13d21f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:52 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Deleted allocations for instance 7bcc1e42-532f-4fb6-984e-cdf659cfef7c
Aug 09 16:36:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85ce8fc5-99b2-4073-b2e6-b32bf462515a tempest-VolumesAssistedSnapshotsTest-1035695306 tempest-VolumesAssistedSnapshotsTest-1035695306-project-member] Lock "7bcc1e42-532f-4fb6-984e-cdf659cfef7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.622s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-4f48e5f6-900f-4c83-ad20-27ae23c55344 req-376d8314-d1e2-47f9-a515-c1c3c43becc0 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received event network-vif-unplugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4f48e5f6-900f-4c83-ad20-27ae23c55344 req-376d8314-d1e2-47f9-a515-c1c3c43becc0 service nova] Acquiring lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4f48e5f6-900f-4c83-ad20-27ae23c55344 req-376d8314-d1e2-47f9-a515-c1c3c43becc0 service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4f48e5f6-900f-4c83-ad20-27ae23c55344 req-376d8314-d1e2-47f9-a515-c1c3c43becc0 service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-4f48e5f6-900f-4c83-ad20-27ae23c55344 req-376d8314-d1e2-47f9-a515-c1c3c43becc0 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] No waiting events found dispatching network-vif-unplugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-4f48e5f6-900f-4c83-ad20-27ae23c55344 req-376d8314-d1e2-47f9-a515-c1c3c43becc0 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received event network-vif-unplugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Instance destroyed successfully.
Aug 09 16:36:53 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lazy-loading 'resources' on Instance uuid ec2187af-1b88-4c23-abba-2f09db3057d6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:36:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:33:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-232794309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-232794309',id=6,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKvUekvW9eV5PNFmOyGiNtiOlJk5szt6jF7Nn2Cjo8H7lw7fn57Jt1UoYyP8a1MRbAqNPdKj8VAN21vacR3qFtYUOYtrJGDNRvt4Yzt0u8rIA+SenASC0Z9S6AJgV5gFw==',key_name='tempest-keypair-1792812162',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:33:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3ef9b2241b143deb605e774ce34998e',ramdisk_id='',reservation_id='r-yr1ytpcl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-357169138',owner_user_name='tempest-TaggedAttachmentsTest-357169138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc4caea945424320a1b8ed52721c0ccf',uuid=ec2187af-1b88-4c23-abba-2f09db3057d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "address": "fa:16:3e:f3:65:dc", "network": {"id": "4d26b33a-b351-4595-a0c5-788f2ecb7732", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-549846585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe3a2-a0", "ovs_interfaceid": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:36:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Converting VIF {"id": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "address": "fa:16:3e:f3:65:dc", "network": {"id": "4d26b33a-b351-4595-a0c5-788f2ecb7732", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-549846585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ef9b2241b143deb605e774ce34998e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe3a2-a0", "ovs_interfaceid": "416fe3a2-a0ea-4c8e-81c6-7374e6205456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:36:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:65:dc,bridge_name='br-int',has_traffic_filtering=True,id=416fe3a2-a0ea-4c8e-81c6-7374e6205456,network=Network(4d26b33a-b351-4595-a0c5-788f2ecb7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416fe3a2-a0') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:36:53 user nova-compute[73091]: DEBUG os_vif [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:65:dc,bridge_name='br-int',has_traffic_filtering=True,id=416fe3a2-a0ea-4c8e-81c6-7374e6205456,network=Network(4d26b33a-b351-4595-a0c5-788f2ecb7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416fe3a2-a0') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:36:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap416fe3a2-a0, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:36:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:53 user nova-compute[73091]: INFO os_vif [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:65:dc,bridge_name='br-int',has_traffic_filtering=True,id=416fe3a2-a0ea-4c8e-81c6-7374e6205456,network=Network(4d26b33a-b351-4595-a0c5-788f2ecb7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416fe3a2-a0')
Aug 09 16:36:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Deleting instance files /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6_del
Aug 09 16:36:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Deletion of /opt/stack/data/nova/instances/ec2187af-1b88-4c23-abba-2f09db3057d6_del complete
Aug 09 16:36:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:53 user nova-compute[73091]: INFO nova.compute.manager [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 09 16:36:53 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:36:53 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:36:53 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:36:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:36:54 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Took 1.08 seconds to deallocate network for instance.
Aug 09 16:36:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-e0cf1d6e-7d08-41d3-8733-919bd3887e75 req-0692d314-f104-429a-8876-bfd7830d4b56 service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received event network-vif-deleted-416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:54 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Deleted allocations for instance ec2187af-1b88-4c23-abba-2f09db3057d6
Aug 09 16:36:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7d27fe6b-652e-4ae1-9e05-b1e5d74edb89 tempest-TaggedAttachmentsTest-357169138 tempest-TaggedAttachmentsTest-357169138-project-member] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.466s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received event network-vif-plugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] Acquiring lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] No waiting events found dispatching network-vif-plugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:54 user nova-compute[73091]: WARNING nova.compute.manager [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received unexpected event network-vif-plugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 for instance with vm_state deleted and task_state None.
Aug 09 16:36:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received event network-vif-plugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] Acquiring lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] No waiting events found dispatching network-vif-plugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:54 user nova-compute[73091]: WARNING nova.compute.manager [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received unexpected event network-vif-plugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 for instance with vm_state deleted and task_state None.
Aug 09 16:36:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received event network-vif-plugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] Acquiring lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] No waiting events found dispatching network-vif-plugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:54 user nova-compute[73091]: WARNING nova.compute.manager [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received unexpected event network-vif-plugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 for instance with vm_state deleted and task_state None.
Aug 09 16:36:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received event network-vif-unplugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] Acquiring lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] No waiting events found dispatching network-vif-unplugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:54 user nova-compute[73091]: WARNING nova.compute.manager [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received unexpected event network-vif-unplugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 for instance with vm_state deleted and task_state None.
Aug 09 16:36:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received event network-vif-plugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] Acquiring lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] Lock "ec2187af-1b88-4c23-abba-2f09db3057d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:36:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] No waiting events found dispatching network-vif-plugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:36:54 user nova-compute[73091]: WARNING nova.compute.manager [req-c23ec250-0d89-49ff-a9b2-390687167f6b req-701f664c-a50f-4cca-8ca5-74e8e50de08b service nova] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Received unexpected event network-vif-plugged-416fe3a2-a0ea-4c8e-81c6-7374e6205456 for instance with vm_state deleted and task_state None.
Aug 09 16:36:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:36:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:36:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:36:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:36:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:36:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:36:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 16:37:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:00 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:37:00 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:37:00 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599005.922152, 117928be-d7c7-4d40-a0ef-2a88c360cfec => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:37:00 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] VM Stopped (Lifecycle Event)
Aug 09 16:37:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3a042eb1-9938-4d88-8693-517f070ce8ec None None] [instance: 117928be-d7c7-4d40-a0ef-2a88c360cfec] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:37:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:02 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:37:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:03 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:37:03 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:37:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:04 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:37:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:04 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:37:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:37:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:37:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:37:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84a64e32-752d-4deb-8364-8889209a97a2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84a64e32-752d-4deb-8364-8889209a97a2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84a64e32-752d-4deb-8364-8889209a97a2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84a64e32-752d-4deb-8364-8889209a97a2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:05 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599010.7090318, 7bcc1e42-532f-4fb6-984e-cdf659cfef7c => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:37:05 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] VM Stopped (Lifecycle Event)
Aug 09 16:37:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e9df1344-fc7e-4060-a2d9-bbeaf92ac960 None None] [instance: 7bcc1e42-532f-4fb6-984e-cdf659cfef7c] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:37:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:06 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:37:06 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:37:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7910MB free_disk=25.657798767089844GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:37:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:37:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:37:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 9c8b5adc-d13f-4d9f-a878-e59dd52550c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:37:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 84a64e32-752d-4deb-8364-8889209a97a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:37:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:37:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:37:06 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:37:07 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:37:07 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:37:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:37:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.343s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:07 user nova-compute[73091]: INFO nova.compute.manager [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Unshelving
Aug 09 16:37:07 user nova-compute[73091]: INFO nova.virt.block_device [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Booting with volume 08a95280-01c7-4844-b6a9-ae5a8748583f at /dev/vdc
Aug 09 16:37:07 user nova-compute[73091]: DEBUG os_brick.utils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:37:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc406ee-7500-4fe2-be21-9376e12d9e31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e267f125-9700-4b7c-b0f9-42fca869632a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bde1e0b-8cd3-466e-921a-23d1f421bf87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[57089d9a-b839-48fe-b1b7-1535df6b8d99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:37:08 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599013.0168865, ec2187af-1b88-4c23-abba-2f09db3057d6 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:37:08 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] VM Stopped (Lifecycle Event)
Aug 09 16:37:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:37:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9a0146ca-8dcb-4483-b436-963c61fe295c None None] [instance: ec2187af-1b88-4c23-abba-2f09db3057d6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:37:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:37:08 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:37:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a98f436-4f80-427a-84fb-19f11659c788]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:37:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:37:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:37:08 user nova-compute[73091]: DEBUG os_brick.utils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:37:08 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Updating existing volume attachment record: 3bf52f54-88b8-4889-8e58-252792bb0c76 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:37:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:08 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:37:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-aa924f4a-ab14-466e-af13-e712acb0fd06 req-93d99750-b622-4a40-9180-4866b5bfc39e service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-changed-7f9e1fe5-ad99-4c58-9181-0caeb7675dab {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-aa924f4a-ab14-466e-af13-e712acb0fd06 req-93d99750-b622-4a40-9180-4866b5bfc39e service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Refreshing instance network info cache due to event network-changed-7f9e1fe5-ad99-4c58-9181-0caeb7675dab. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:37:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-aa924f4a-ab14-466e-af13-e712acb0fd06 req-93d99750-b622-4a40-9180-4866b5bfc39e service nova] Acquiring lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:37:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-aa924f4a-ab14-466e-af13-e712acb0fd06 req-93d99750-b622-4a40-9180-4866b5bfc39e service nova] Acquired lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:37:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-aa924f4a-ab14-466e-af13-e712acb0fd06 req-93d99750-b622-4a40-9180-4866b5bfc39e service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Refreshing network info cache for port 7f9e1fe5-ad99-4c58-9181-0caeb7675dab {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:37:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-aa924f4a-ab14-466e-af13-e712acb0fd06 req-93d99750-b622-4a40-9180-4866b5bfc39e service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Updated VIF entry in instance network info cache for port 7f9e1fe5-ad99-4c58-9181-0caeb7675dab. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:37:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-aa924f4a-ab14-466e-af13-e712acb0fd06 req-93d99750-b622-4a40-9180-4866b5bfc39e service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Updating instance_info_cache with network_info: [{"id": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "address": "fa:16:3e:30:e8:27", "network": {"id": "41f77be1-0754-463b-a14d-b199368ae881", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-32585978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9e1fe5-ad", "ovs_interfaceid": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "address": "fa:16:3e:a0:6f:69", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eac408-ec", "ovs_interfaceid": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "address": "fa:16:3e:db:ca:02", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847e88af-f8", "ovs_interfaceid": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f37bd5d-1587-4aad-9da4-892334eadaad", "address": "fa:16:3e:79:2d:22", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f37bd5d-15", "ovs_interfaceid": "9f37bd5d-1587-4aad-9da4-892334eadaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "address": "fa:16:3e:05:45:18", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f12e06-60", "ovs_interfaceid": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc6e7056-4650-4973-be22-b1d98c14149f", "address": "fa:16:3e:af:95:d3", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc6e7056-46", "ovs_interfaceid": "dc6e7056-4650-4973-be22-b1d98c14149f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1128f26c-215d-4940-8772-886149c34785", "address": "fa:16:3e:18:47:aa", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1128f26c-21", "ovs_interfaceid": "1128f26c-215d-4940-8772-886149c34785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:37:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-aa924f4a-ab14-466e-af13-e712acb0fd06 req-93d99750-b622-4a40-9180-4866b5bfc39e service nova] Releasing lock "refresh_cache-9c8b5adc-d13f-4d9f-a878-e59dd52550c3" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:37:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:17 user nova-compute[73091]: DEBUG nova.objects.instance [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'pci_requests' on Instance uuid f3e2ea27-5fa4-4437-83d0-2eeda59506a9 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:37:17 user nova-compute[73091]: DEBUG nova.objects.instance [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'numa_topology' on Instance uuid f3e2ea27-5fa4-4437-83d0-2eeda59506a9 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:37:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:37:17 user nova-compute[73091]: INFO nova.compute.claims [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Claim successful on node user
Aug 09 16:37:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:18 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:37:18 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:37:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:18 user nova-compute[73091]: INFO nova.network.neutron [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Updating port 93308f09-a0e7-49b6-8b29-dc0999acbfc1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquired lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-5c065c9c-0105-4bd0-a4bc-c04c56afd60c req-8f3f3344-70da-4dea-b0f1-0ac61ba65095 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received event network-changed-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-5c065c9c-0105-4bd0-a4bc-c04c56afd60c req-8f3f3344-70da-4dea-b0f1-0ac61ba65095 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Refreshing instance network info cache due to event network-changed-93308f09-a0e7-49b6-8b29-dc0999acbfc1. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5c065c9c-0105-4bd0-a4bc-c04c56afd60c req-8f3f3344-70da-4dea-b0f1-0ac61ba65095 service nova] Acquiring lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:19 user nova-compute[73091]: INFO nova.compute.manager [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Terminating instance
Aug 09 16:37:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-4ad32932-009c-40ef-8008-f4ffc102abd9 req-295e9430-8e73-469b-97d7-c51c0836742a service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-unplugged-7f9e1fe5-ad99-4c58-9181-0caeb7675dab {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ad32932-009c-40ef-8008-f4ffc102abd9 req-295e9430-8e73-469b-97d7-c51c0836742a service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ad32932-009c-40ef-8008-f4ffc102abd9 req-295e9430-8e73-469b-97d7-c51c0836742a service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ad32932-009c-40ef-8008-f4ffc102abd9 req-295e9430-8e73-469b-97d7-c51c0836742a service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-4ad32932-009c-40ef-8008-f4ffc102abd9 req-295e9430-8e73-469b-97d7-c51c0836742a service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-unplugged-7f9e1fe5-ad99-4c58-9181-0caeb7675dab {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-4ad32932-009c-40ef-8008-f4ffc102abd9 req-295e9430-8e73-469b-97d7-c51c0836742a service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-unplugged-7f9e1fe5-ad99-4c58-9181-0caeb7675dab for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Updating instance_info_cache with network_info: [{"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Releasing lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:37:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Creating image(s)
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "/opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "/opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG nova.objects.instance [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'trusted_certs' on Instance uuid f3e2ea27-5fa4-4437-83d0-2eeda59506a9 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5c065c9c-0105-4bd0-a4bc-c04c56afd60c req-8f3f3344-70da-4dea-b0f1-0ac61ba65095 service nova] Acquired lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-5c065c9c-0105-4bd0-a4bc-c04c56afd60c req-8f3f3344-70da-4dea-b0f1-0ac61ba65095 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Refreshing network info cache for port 93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-009a9182-8518-4bae-8a6f-aec54bb8626a req-799d7e0b-8d96-4e78-a06d-4689dac9d659 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-unplugged-f3eac408-ecc9-4f3f-a64d-4364c91bf697 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-009a9182-8518-4bae-8a6f-aec54bb8626a req-799d7e0b-8d96-4e78-a06d-4689dac9d659 service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-009a9182-8518-4bae-8a6f-aec54bb8626a req-799d7e0b-8d96-4e78-a06d-4689dac9d659 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-009a9182-8518-4bae-8a6f-aec54bb8626a req-799d7e0b-8d96-4e78-a06d-4689dac9d659 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-009a9182-8518-4bae-8a6f-aec54bb8626a req-799d7e0b-8d96-4e78-a06d-4689dac9d659 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-unplugged-f3eac408-ecc9-4f3f-a64d-4364c91bf697 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-009a9182-8518-4bae-8a6f-aec54bb8626a req-799d7e0b-8d96-4e78-a06d-4689dac9d659 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-unplugged-f3eac408-ecc9-4f3f-a64d-4364c91bf697 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:37:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3.part --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3.part --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.virt.images [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] 93cf5d37-48ec-4c45-afba-90bda5253287 was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3.part /opt/stack/data/nova/instances/_base/4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3.converted {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-0290e02b-ad57-4bf6-ba55-e5616ebe3be8 req-7499e445-60be-417c-b6c0-89242546453d service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-unplugged-dc6e7056-4650-4973-be22-b1d98c14149f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0290e02b-ad57-4bf6-ba55-e5616ebe3be8 req-7499e445-60be-417c-b6c0-89242546453d service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0290e02b-ad57-4bf6-ba55-e5616ebe3be8 req-7499e445-60be-417c-b6c0-89242546453d service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0290e02b-ad57-4bf6-ba55-e5616ebe3be8 req-7499e445-60be-417c-b6c0-89242546453d service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-0290e02b-ad57-4bf6-ba55-e5616ebe3be8 req-7499e445-60be-417c-b6c0-89242546453d service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-unplugged-dc6e7056-4650-4973-be22-b1d98c14149f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-0290e02b-ad57-4bf6-ba55-e5616ebe3be8 req-7499e445-60be-417c-b6c0-89242546453d service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-unplugged-dc6e7056-4650-4973-be22-b1d98c14149f for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-0290e02b-ad57-4bf6-ba55-e5616ebe3be8 req-7499e445-60be-417c-b6c0-89242546453d service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-dc6e7056-4650-4973-be22-b1d98c14149f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0290e02b-ad57-4bf6-ba55-e5616ebe3be8 req-7499e445-60be-417c-b6c0-89242546453d service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0290e02b-ad57-4bf6-ba55-e5616ebe3be8 req-7499e445-60be-417c-b6c0-89242546453d service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0290e02b-ad57-4bf6-ba55-e5616ebe3be8 req-7499e445-60be-417c-b6c0-89242546453d service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-0290e02b-ad57-4bf6-ba55-e5616ebe3be8 req-7499e445-60be-417c-b6c0-89242546453d service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-dc6e7056-4650-4973-be22-b1d98c14149f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:37:21 user nova-compute[73091]: WARNING nova.compute.manager [req-0290e02b-ad57-4bf6-ba55-e5616ebe3be8 req-7499e445-60be-417c-b6c0-89242546453d service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-dc6e7056-4650-4973-be22-b1d98c14149f for instance with vm_state active and task_state deleting.
Aug 09 16:37:21 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Instance destroyed successfully.
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lazy-loading 'resources' on Instance uuid 9c8b5adc-d13f-4d9f-a878-e59dd52550c3 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:35:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "address": "fa:16:3e:30:e8:27", "network": {"id": "41f77be1-0754-463b-a14d-b199368ae881", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-32585978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9e1fe5-ad", "ovs_interfaceid": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "address": "fa:16:3e:30:e8:27", "network": {"id": "41f77be1-0754-463b-a14d-b199368ae881", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-32585978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9e1fe5-ad", "ovs_interfaceid": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:e8:27,bridge_name='br-int',has_traffic_filtering=True,id=7f9e1fe5-ad99-4c58-9181-0caeb7675dab,network=Network(41f77be1-0754-463b-a14d-b199368ae881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9e1fe5-ad') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG os_vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:e8:27,bridge_name='br-int',has_traffic_filtering=True,id=7f9e1fe5-ad99-4c58-9181-0caeb7675dab,network=Network(41f77be1-0754-463b-a14d-b199368ae881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9e1fe5-ad') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f9e1fe5-ad, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.network.neutron [req-5c065c9c-0105-4bd0-a4bc-c04c56afd60c req-8f3f3344-70da-4dea-b0f1-0ac61ba65095 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Updated VIF entry in instance network info cache for port 93308f09-a0e7-49b6-8b29-dc0999acbfc1. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.network.neutron [req-5c065c9c-0105-4bd0-a4bc-c04c56afd60c req-8f3f3344-70da-4dea-b0f1-0ac61ba65095 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Updating instance_info_cache with network_info: [{"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5c065c9c-0105-4bd0-a4bc-c04c56afd60c req-8f3f3344-70da-4dea-b0f1-0ac61ba65095 service nova] Releasing lock "refresh_cache-f3e2ea27-5fa4-4437-83d0-2eeda59506a9" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:21 user nova-compute[73091]: INFO os_vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:e8:27,bridge_name='br-int',has_traffic_filtering=True,id=7f9e1fe5-ad99-4c58-9181-0caeb7675dab,network=Network(41f77be1-0754-463b-a14d-b199368ae881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9e1fe5-ad')
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:35:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "address": "fa:16:3e:a0:6f:69", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eac408-ec", "ovs_interfaceid": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "address": "fa:16:3e:a0:6f:69", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eac408-ec", "ovs_interfaceid": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6f:69,bridge_name='br-int',has_traffic_filtering=True,id=f3eac408-ecc9-4f3f-a64d-4364c91bf697,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3eac408-ec') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG os_vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6f:69,bridge_name='br-int',has_traffic_filtering=True,id=f3eac408-ecc9-4f3f-a64d-4364c91bf697,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3eac408-ec') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3eac408-ec, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:21 user nova-compute[73091]: INFO os_vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6f:69,bridge_name='br-int',has_traffic_filtering=True,id=f3eac408-ecc9-4f3f-a64d-4364c91bf697,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3eac408-ec')
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:35:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "address": "fa:16:3e:db:ca:02", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847e88af-f8", "ovs_interfaceid": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "address": "fa:16:3e:db:ca:02", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847e88af-f8", "ovs_interfaceid": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:ca:02,bridge_name='br-int',has_traffic_filtering=True,id=847e88af-f82a-4a2d-aa96-7e3dd512e055,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap847e88af-f8') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG os_vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:ca:02,bridge_name='br-int',has_traffic_filtering=True,id=847e88af-f82a-4a2d-aa96-7e3dd512e055,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap847e88af-f8') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap847e88af-f8, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-7f9e1fe5-ad99-4c58-9181-0caeb7675dab {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-7f9e1fe5-ad99-4c58-9181-0caeb7675dab {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:37:21 user nova-compute[73091]: WARNING nova.compute.manager [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-7f9e1fe5-ad99-4c58-9181-0caeb7675dab for instance with vm_state active and task_state deleting.
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-unplugged-9f37bd5d-1587-4aad-9da4-892334eadaad {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-unplugged-9f37bd5d-1587-4aad-9da4-892334eadaad {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-unplugged-9f37bd5d-1587-4aad-9da4-892334eadaad for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-9f37bd5d-1587-4aad-9da4-892334eadaad {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-9f37bd5d-1587-4aad-9da4-892334eadaad {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:37:21 user nova-compute[73091]: WARNING nova.compute.manager [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-9f37bd5d-1587-4aad-9da4-892334eadaad for instance with vm_state active and task_state deleting.
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-unplugged-1128f26c-215d-4940-8772-886149c34785 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-unplugged-1128f26c-215d-4940-8772-886149c34785 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-unplugged-1128f26c-215d-4940-8772-886149c34785 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-1128f26c-215d-4940-8772-886149c34785 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-1128f26c-215d-4940-8772-886149c34785 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:37:21 user nova-compute[73091]: WARNING nova.compute.manager [req-eecd4241-0896-4833-ba8c-28eb6fb17acc req-563d25d0-0bf2-4517-9235-e65936ac7bf5 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-1128f26c-215d-4940-8772-886149c34785 for instance with vm_state active and task_state deleting.
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:21 user nova-compute[73091]: INFO os_vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:ca:02,bridge_name='br-int',has_traffic_filtering=True,id=847e88af-f82a-4a2d-aa96-7e3dd512e055,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap847e88af-f8')
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:35:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f37bd5d-1587-4aad-9da4-892334eadaad", "address": "fa:16:3e:79:2d:22", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f37bd5d-15", "ovs_interfaceid": "9f37bd5d-1587-4aad-9da4-892334eadaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "9f37bd5d-1587-4aad-9da4-892334eadaad", "address": "fa:16:3e:79:2d:22", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f37bd5d-15", "ovs_interfaceid": "9f37bd5d-1587-4aad-9da4-892334eadaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:2d:22,bridge_name='br-int',has_traffic_filtering=True,id=9f37bd5d-1587-4aad-9da4-892334eadaad,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f37bd5d-15') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG os_vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:2d:22,bridge_name='br-int',has_traffic_filtering=True,id=9f37bd5d-1587-4aad-9da4-892334eadaad,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f37bd5d-15') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f37bd5d-15, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:22 user nova-compute[73091]: INFO os_vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:2d:22,bridge_name='br-int',has_traffic_filtering=True,id=9f37bd5d-1587-4aad-9da4-892334eadaad,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f37bd5d-15')
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:35:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "address": "fa:16:3e:05:45:18", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f12e06-60", "ovs_interfaceid": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "address": "fa:16:3e:05:45:18", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f12e06-60", "ovs_interfaceid": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:45:18,bridge_name='br-int',has_traffic_filtering=True,id=09f12e06-60f3-4e4d-b8c0-929fb56b0afd,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f12e06-60') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:45:18,bridge_name='br-int',has_traffic_filtering=True,id=09f12e06-60f3-4e4d-b8c0-929fb56b0afd,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f12e06-60') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09f12e06-60, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-f3eac408-ecc9-4f3f-a64d-4364c91bf697 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-f3eac408-ecc9-4f3f-a64d-4364c91bf697 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:37:22 user nova-compute[73091]: WARNING nova.compute.manager [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-f3eac408-ecc9-4f3f-a64d-4364c91bf697 for instance with vm_state active and task_state deleting.
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-unplugged-847e88af-f82a-4a2d-aa96-7e3dd512e055 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-unplugged-847e88af-f82a-4a2d-aa96-7e3dd512e055 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-unplugged-847e88af-f82a-4a2d-aa96-7e3dd512e055 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-847e88af-f82a-4a2d-aa96-7e3dd512e055 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-847e88af-f82a-4a2d-aa96-7e3dd512e055 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:37:22 user nova-compute[73091]: WARNING nova.compute.manager [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-847e88af-f82a-4a2d-aa96-7e3dd512e055 for instance with vm_state active and task_state deleting.
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-unplugged-09f12e06-60f3-4e4d-b8c0-929fb56b0afd {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-unplugged-09f12e06-60f3-4e4d-b8c0-929fb56b0afd {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-2092af96-daf6-4988-ae64-6fa666afe1bd req-1cca7d26-b1eb-4dca-b39f-bb8476c02045 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-unplugged-09f12e06-60f3-4e4d-b8c0-929fb56b0afd for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3.part /opt/stack/data/nova/instances/_base/4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3.converted" returned: 0 in 0.783s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3.converted --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: INFO os_vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:45:18,bridge_name='br-int',has_traffic_filtering=True,id=09f12e06-60f3-4e4d-b8c0-929fb56b0afd,network=Network(8ab67f6f-09ff-4177-8c8a-edb0767cbc4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f12e06-60')
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:35:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc6e7056-4650-4973-be22-b1d98c14149f", "address": "fa:16:3e:af:95:d3", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc6e7056-46", "ovs_interfaceid": "dc6e7056-4650-4973-be22-b1d98c14149f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "dc6e7056-4650-4973-be22-b1d98c14149f", "address": "fa:16:3e:af:95:d3", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc6e7056-46", "ovs_interfaceid": "dc6e7056-4650-4973-be22-b1d98c14149f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=dc6e7056-4650-4973-be22-b1d98c14149f,network=Network(6acf27ea-51af-4bf4-824d-86b1ae394d4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc6e7056-46') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=dc6e7056-4650-4973-be22-b1d98c14149f,network=Network(6acf27ea-51af-4bf4-824d-86b1ae394d4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc6e7056-46') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc6e7056-46, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:22 user nova-compute[73091]: INFO os_vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=dc6e7056-4650-4973-be22-b1d98c14149f,network=Network(6acf27ea-51af-4bf4-824d-86b1ae394d4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc6e7056-46')
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1985190096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1985190096',id=10,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZspQEwFHf39yeNeEZYqM7CT5gjTj9AYnuMeg9OjJpi4G06+1wAfw84meJmE7Q4aS/bUgHrk0B3kbdHySICIpyl9ubl9EBLYHH5rQfjCGQhzuYo74MzaWjnwjfAMHYx+g==',key_name='tempest-keypair-1794601903',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:35:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19a0681774fe4557921515e98144b9d1',ramdisk_id='',reservation_id='r-9gp9fbdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-297450497',owner_user_name='tempest-TaggedBootDevicesTest_v242-297450497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed205e5075de4f48b629121cc0cce798',uuid=9c8b5adc-d13f-4d9f-a878-e59dd52550c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1128f26c-215d-4940-8772-886149c34785", "address": "fa:16:3e:18:47:aa", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1128f26c-21", "ovs_interfaceid": "1128f26c-215d-4940-8772-886149c34785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converting VIF {"id": "1128f26c-215d-4940-8772-886149c34785", "address": "fa:16:3e:18:47:aa", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1128f26c-21", "ovs_interfaceid": "1128f26c-215d-4940-8772-886149c34785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:47:aa,bridge_name='br-int',has_traffic_filtering=True,id=1128f26c-215d-4940-8772-886149c34785,network=Network(6acf27ea-51af-4bf4-824d-86b1ae394d4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1128f26c-21') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:47:aa,bridge_name='br-int',has_traffic_filtering=True,id=1128f26c-215d-4940-8772-886149c34785,network=Network(6acf27ea-51af-4bf4-824d-86b1ae394d4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1128f26c-21') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1128f26c-21, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:37:22 user nova-compute[73091]: INFO os_vif [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:47:aa,bridge_name='br-int',has_traffic_filtering=True,id=1128f26c-215d-4940-8772-886149c34785,network=Network(6acf27ea-51af-4bf4-824d-86b1ae394d4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1128f26c-21')
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StgOlzQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:37:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cc25c4-8bd9-4085-b87f-56472ff1f412]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.360s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3 --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[023bdb17-9e40-4659-9256-ca4a1f3d5cdd]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:37:22 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:37:22 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:37:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 (non-flash)
Aug 09 16:37:22 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:37:22 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:37:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0603b6dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Removing single pathed devices sde {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[81300d23-49b0-4df2-9a17-0de9d6d706fe]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fddb278-d50c-4112-b828-08d7b53d4374]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fabd0d-7bb8-44ef-9ad3-2fc22f28d705]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3 --force-share --output=json" returned: 0 in 0.148s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3 --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[be08d9c4-59e6-4228-9ec5-ddc23aca6c16]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf8fbc0-bba6-4cd9-972e-7a7006730dcb]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[496131ba-7edb-4b34-98fc-a688228f399c]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172, portal: 172.16.0.220,3260]
Aug 09 16:37:22 user nova-compute[73091]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172, portal: 172.16.0.220,3260] successful.
Aug 09 16:37:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3 --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3,backing_fmt=raw /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bcd953f-ccea-4ad0-8470-2afa38d7e172 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[abac9928-9db8-453a-a1c7-a078c10471ec]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] <== disconnect_volume: return (395ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GajpxueF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:37:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3,backing_fmt=raw /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk 1073741824" returned: 0 in 0.054s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3 --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d95810-a428-4b46-b7af-e541326493b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3740be4e-e91c-4903-b483-1c9348ebf53b]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:37:22 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:37:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 (non-flash)
Aug 09 16:37:22 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:37:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff06038c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5'): ({'sdg'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Removing single pathed devices sdg {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6092588-8e4b-4819-bd51-8bf663a9432f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[629398a1-6fe7-4e2c-bbf7-ad8af873b17e]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Flushing IO for device /dev/sdg {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3 --force-share --output=json" returned: 0 in 0.132s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.objects.instance [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'migration_context' on Instance uuid f3e2ea27-5fa4-4437-83d0-2eeda59506a9 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00bcc8b-33a7-4414-8ba4-fc1811c17ab3]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Rebasing disk image.
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48a0126-e916-4a1c-8452-6432cb92b4ac]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] SCSI volumes sdg have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3844889-b4c9-4bb7-a979-4b5efdc778ee]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff -F raw /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb33d348-e4c9-4151-9fc1-8a75a742a366]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5, portal: 172.16.0.220,3260]
Aug 09 16:37:22 user nova-compute[73091]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5, portal: 172.16.0.220,3260] successful.
Aug 09 16:37:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261a4d27-c0c4-4c3f-95d5-bd82c38f07b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbf0f16-e00a-423a-86b5-cb2873715b8e]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] <== disconnect_volume: return (366ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmqYCQVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:37:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:37:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9a8760-21de-411b-aa70-2f4d45daf0dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce72dd1-193f-4ee7-ae94-633383e1352e]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:37:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 (non-flash)
Aug 09 16:37:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff06038c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3'): ({'sdh'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Removing single pathed devices sdh {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7985e420-ee57-4d3a-b382-6f033135b631]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d7a7d1-e34f-4a71-a2b0-19a7d26de271]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Flushing IO for device /dev/sdh {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0f943a-52f0-4c4a-b29d-cd0ed60304e8]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[44865b5a-7029-4979-8547-a7b4cbb9b4ed]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] SCSI volumes sdh have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[92038f14-ad7d-4aac-8d93-c8efbc6cb234]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe471347-b6c1-41b0-bc3e-42571b8129ca]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3, portal: 172.16.0.220,3260]
Aug 09 16:37:23 user nova-compute[73091]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3, portal: 172.16.0.220,3260] successful.
Aug 09 16:37:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7972dac2-c9ab-407d-95d9-977d6529d2c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d139ae0d-413d-49c8-8a89-e72a5ad55633]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] <== disconnect_volume: return (275ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:37:23 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Deleting instance files /opt/stack/data/nova/instances/9c8b5adc-d13f-4d9f-a878-e59dd52550c3_del
Aug 09 16:37:23 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Deletion of /opt/stack/data/nova/instances/9c8b5adc-d13f-4d9f-a878-e59dd52550c3_del complete
Aug 09 16:37:23 user nova-compute[73091]: INFO nova.compute.manager [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Took 3.94 seconds to destroy the instance on the hypervisor.
Aug 09 16:37:23 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:37:23 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:37:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-3a6e6a2d-bca0-4e30-a30b-165cae098a2f req-e6b28d69-f7d8-4035-b316-c4ea7ae7de12 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-plugged-09f12e06-60f3-4e4d-b8c0-929fb56b0afd {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3a6e6a2d-bca0-4e30-a30b-165cae098a2f req-e6b28d69-f7d8-4035-b316-c4ea7ae7de12 service nova] Acquiring lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3a6e6a2d-bca0-4e30-a30b-165cae098a2f req-e6b28d69-f7d8-4035-b316-c4ea7ae7de12 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3a6e6a2d-bca0-4e30-a30b-165cae098a2f req-e6b28d69-f7d8-4035-b316-c4ea7ae7de12 service nova] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-3a6e6a2d-bca0-4e30-a30b-165cae098a2f req-e6b28d69-f7d8-4035-b316-c4ea7ae7de12 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] No waiting events found dispatching network-vif-plugged-09f12e06-60f3-4e4d-b8c0-929fb56b0afd {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:37:24 user nova-compute[73091]: WARNING nova.compute.manager [req-3a6e6a2d-bca0-4e30-a30b-165cae098a2f req-e6b28d69-f7d8-4035-b316-c4ea7ae7de12 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received unexpected event network-vif-plugged-09f12e06-60f3-4e4d-b8c0-929fb56b0afd for instance with vm_state active and task_state deleting.
Aug 09 16:37:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Acquiring lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Acquiring lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:24 user nova-compute[73091]: INFO nova.compute.manager [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Terminating instance
Aug 09 16:37:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:37:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-98bf21b3-5f32-463b-b451-faa02ad5dff2 req-bf4dfc4b-d72f-4e06-afc8-3cd4e8994af0 service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Received event network-vif-unplugged-218c7585-7957-41e4-88d8-6f04e4d4a9bc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-98bf21b3-5f32-463b-b451-faa02ad5dff2 req-bf4dfc4b-d72f-4e06-afc8-3cd4e8994af0 service nova] Acquiring lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-98bf21b3-5f32-463b-b451-faa02ad5dff2 req-bf4dfc4b-d72f-4e06-afc8-3cd4e8994af0 service nova] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-98bf21b3-5f32-463b-b451-faa02ad5dff2 req-bf4dfc4b-d72f-4e06-afc8-3cd4e8994af0 service nova] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-98bf21b3-5f32-463b-b451-faa02ad5dff2 req-bf4dfc4b-d72f-4e06-afc8-3cd4e8994af0 service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] No waiting events found dispatching network-vif-unplugged-218c7585-7957-41e4-88d8-6f04e4d4a9bc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-98bf21b3-5f32-463b-b451-faa02ad5dff2 req-bf4dfc4b-d72f-4e06-afc8-3cd4e8994af0 service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Received event network-vif-unplugged-218c7585-7957-41e4-88d8-6f04e4d4a9bc for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff -F raw /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk" returned: 0 in 2.353s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Ensure instance console log exists: /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Start _get_guest_xml network_info=[{"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='8a273a4f24b25c8b7a818de36d9c8e29',container_format='bare',created_at=2023-08-09T16:35:15Z,direct_url=<?>,disk_format='qcow2',id=93cf5d37-48ec-4c45-afba-90bda5253287,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1616872134-shelved',owner='b8000a47d82748ce8d43d306682d62c6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T16:35:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '3bf52f54-88b8-4889-8e58-252792bb0c76', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbXBOVwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'f3e2ea27-5fa4-4437-83d0-2eeda59506a9', 'attached_at': '', 'detached_at': '', 'volume_id': '08a95280-01c7-4844-b6a9-ae5a8748583f', 'serial': '08a95280-01c7-4844-b6a9-ae5a8748583f'}, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:25 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:37:25 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8a273a4f24b25c8b7a818de36d9c8e29',container_format='bare',created_at=2023-08-09T16:35:15Z,direct_url=<?>,disk_format='qcow2',id=93cf5d37-48ec-4c45-afba-90bda5253287,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1616872134-shelved',owner='b8000a47d82748ce8d43d306682d62c6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T16:35:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.objects.instance [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'vcpu_model' on Instance uuid f3e2ea27-5fa4-4437-83d0-2eeda59506a9 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbXBOVwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:37:25 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:37:25 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:37:25 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:37:25 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Instance destroyed successfully.
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.objects.instance [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lazy-loading 'resources' on Instance uuid 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:33:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1119243345',display_name='tempest-TestVolumeSwap-server-1119243345',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1119243345',id=7,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyOF+6YPIUctROxJ8417kT3zjDt4XMssIHYRDfo+ZMlQzPjEx+gAxLHcSacNEX32mWYkzxel7DdimHJGaZ5mtD2x7rOxhc5OHH9EzFPQnKmpQ0jZ0TpT7V5Sm2xVQH2xg==',key_name='tempest-keypair-1473931332',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:33:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7167f5fdba4476783c578e63f388618',ramdisk_id='',reservation_id='r-zce9mhw3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1621108182',owner_user_name='tempest-TestVolumeSwap-1621108182-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:33:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='867774990bd24469b81a99659005ccae',uuid=50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "address": "fa:16:3e:fa:39:24", "network": {"id": "a2babb7a-2af8-4453-abd7-e1a3f193d026", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1066415352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7167f5fdba4476783c578e63f388618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218c7585-79", "ovs_interfaceid": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Converting VIF {"id": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "address": "fa:16:3e:fa:39:24", "network": {"id": "a2babb7a-2af8-4453-abd7-e1a3f193d026", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1066415352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7167f5fdba4476783c578e63f388618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap218c7585-79", "ovs_interfaceid": "218c7585-7957-41e4-88d8-6f04e4d4a9bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:39:24,bridge_name='br-int',has_traffic_filtering=True,id=218c7585-7957-41e4-88d8-6f04e4d4a9bc,network=Network(a2babb7a-2af8-4453-abd7-e1a3f193d026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap218c7585-79') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_vif [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:39:24,bridge_name='br-int',has_traffic_filtering=True,id=218c7585-7957-41e4-88d8-6f04e4d4a9bc,network=Network(a2babb7a-2af8-4453-abd7-e1a3f193d026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap218c7585-79') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[10192412-cc88-4d5e-8c38-609678e21a63]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:37:25 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap218c7585-79, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:37:25 user nova-compute[73091]: INFO os_vif [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:39:24,bridge_name='br-int',has_traffic_filtering=True,id=218c7585-7957-41e4-88d8-6f04e4d4a9bc,network=Network(a2babb7a-2af8-4453-abd7-e1a3f193d026),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap218c7585-79')
Aug 09 16:37:25 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Deleting instance files /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb_del
Aug 09 16:37:25 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Deletion of /opt/stack/data/nova/instances/50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb_del complete
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b60323a-513c-4681-8ffa-0a091cea8fab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f] added
Aug 09 16:37:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e6525b-f913-4ba5-90a9-49956ff67229]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4add34c-ddc3-4e19-afb1-e1c8d274fedc]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WbXBOVwl {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:25 user nova-compute[73091]: INFO nova.compute.manager [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WbXBOVwl" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a124fd-62bf-43c5-9ce2-76372cab4164]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WbXBOVwl'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c4c85e-e220-4c3f-b7b4-dd62feaef4c2]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d21e85-4665-43d9-b963-5872b41fc76d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 16:37:25 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 16:37:25 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:37:25 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 16:37:25 user nova-compute[73091]: 
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d5059d-ecb7-4dc6-8d93-4d884c944ff4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f, portal: 172.16.0.220,3260]
Aug 09 16:37:25 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f, portal: 172.16.0.220,3260] successful.
Aug 09 16:37:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe2632d-dc81-4590-8754-3d817e181684]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a782cfe-c5df-41bb-9571-10c1d6200f98]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f (non-flash)
Aug 09 16:37:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f (non-flash)
Aug 09 16:37:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d0b690-bf35-43da-9184-89d2b0a48d7c]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbXBOVwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-084eb3fe-4c0a-48ad-bed1-ff01176baac2 req-bb4d2984-41ef-4e73-a433-842df48aae2a service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-deleted-1128f26c-215d-4940-8772-886149c34785 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:25 user nova-compute[73091]: INFO nova.compute.manager [req-084eb3fe-4c0a-48ad-bed1-ff01176baac2 req-bb4d2984-41ef-4e73-a433-842df48aae2a service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Neutron deleted interface 1128f26c-215d-4940-8772-886149c34785; detaching it from the instance and deleting it from the info cache
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.network.neutron [req-084eb3fe-4c0a-48ad-bed1-ff01176baac2 req-bb4d2984-41ef-4e73-a433-842df48aae2a service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Updating instance_info_cache with network_info: [{"id": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "address": "fa:16:3e:30:e8:27", "network": {"id": "41f77be1-0754-463b-a14d-b199368ae881", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-32585978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9e1fe5-ad", "ovs_interfaceid": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "address": "fa:16:3e:a0:6f:69", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eac408-ec", "ovs_interfaceid": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "address": "fa:16:3e:db:ca:02", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847e88af-f8", "ovs_interfaceid": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f37bd5d-1587-4aad-9da4-892334eadaad", "address": "fa:16:3e:79:2d:22", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f37bd5d-15", "ovs_interfaceid": "9f37bd5d-1587-4aad-9da4-892334eadaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "address": "fa:16:3e:05:45:18", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f12e06-60", "ovs_interfaceid": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc6e7056-4650-4973-be22-b1d98c14149f", "address": "fa:16:3e:af:95:d3", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc6e7056-46", "ovs_interfaceid": "dc6e7056-4650-4973-be22-b1d98c14149f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:37:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-084eb3fe-4c0a-48ad-bed1-ff01176baac2 req-bb4d2984-41ef-4e73-a433-842df48aae2a service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Detach interface failed, port_id=1128f26c-215d-4940-8772-886149c34785, reason: Instance 9c8b5adc-d13f-4d9f-a878-e59dd52550c3 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Acquiring lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:37:26 user nova-compute[73091]: INFO nova.compute.claims [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Claim successful on node user
Aug 09 16:37:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26161353332393066', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161353332393066', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T16:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1616872134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1616872134',id=3,image_ref='93cf5d37-48ec-4c45-afba-90bda5253287',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2075151971',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:33:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b8000a47d82748ce8d43d306682d62c6',ramdisk_id='',reservation_id='r-3yoej5re',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1451982310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1451982310-project-member',shelved_at='2023-08-09T16:35:20.021030',shelved_host='user',shelved_image_id='93cf5d37-48ec-4c45-afba-90bda5253287'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:37:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343ec5734ef547f292ee631dbb272359',uuid=f3e2ea27-5fa4-4437-83d0-2eeda59506a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converting VIF {"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:62:67,bridge_name='br-int',has_traffic_filtering=True,id=93308f09-a0e7-49b6-8b29-dc0999acbfc1,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93308f09-a0') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG nova.objects.instance [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'pci_devices' on Instance uuid f3e2ea27-5fa4-4437-83d0-2eeda59506a9 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:37:26 user nova-compute[73091]:   <uuid>f3e2ea27-5fa4-4437-83d0-2eeda59506a9</uuid>
Aug 09 16:37:26 user nova-compute[73091]:   <name>instance-00000003</name>
Aug 09 16:37:26 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:37:26 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:37:26 user nova-compute[73091]:   <metadata>
Aug 09 16:37:26 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:37:26 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:37:26 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1616872134</nova:name>
Aug 09 16:37:26 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:37:25</nova:creationTime>
Aug 09 16:37:26 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:37:26 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:37:26 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:37:26 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:37:26 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:37:26 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:37:26 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:37:26 user nova-compute[73091]:       <nova:owner>
Aug 09 16:37:26 user nova-compute[73091]:         <nova:user uuid="343ec5734ef547f292ee631dbb272359">tempest-AttachVolumeShelveTestJSON-1451982310-project-member</nova:user>
Aug 09 16:37:26 user nova-compute[73091]:         <nova:project uuid="b8000a47d82748ce8d43d306682d62c6">tempest-AttachVolumeShelveTestJSON-1451982310</nova:project>
Aug 09 16:37:26 user nova-compute[73091]:       </nova:owner>
Aug 09 16:37:26 user nova-compute[73091]:       <nova:root type="image" uuid="93cf5d37-48ec-4c45-afba-90bda5253287"/>
Aug 09 16:37:26 user nova-compute[73091]:       <nova:ports>
Aug 09 16:37:26 user nova-compute[73091]:         <nova:port uuid="93308f09-a0e7-49b6-8b29-dc0999acbfc1">
Aug 09 16:37:26 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 16:37:26 user nova-compute[73091]:         </nova:port>
Aug 09 16:37:26 user nova-compute[73091]:       </nova:ports>
Aug 09 16:37:26 user nova-compute[73091]:     </nova:instance>
Aug 09 16:37:26 user nova-compute[73091]:   </metadata>
Aug 09 16:37:26 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:37:26 user nova-compute[73091]:     <system>
Aug 09 16:37:26 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:37:26 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:37:26 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:37:26 user nova-compute[73091]:       <entry name="serial">f3e2ea27-5fa4-4437-83d0-2eeda59506a9</entry>
Aug 09 16:37:26 user nova-compute[73091]:       <entry name="uuid">f3e2ea27-5fa4-4437-83d0-2eeda59506a9</entry>
Aug 09 16:37:26 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:37:26 user nova-compute[73091]:     </system>
Aug 09 16:37:26 user nova-compute[73091]:   </sysinfo>
Aug 09 16:37:26 user nova-compute[73091]:   <os>
Aug 09 16:37:26 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:37:26 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:37:26 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:37:26 user nova-compute[73091]:   </os>
Aug 09 16:37:26 user nova-compute[73091]:   <features>
Aug 09 16:37:26 user nova-compute[73091]:     <acpi/>
Aug 09 16:37:26 user nova-compute[73091]:     <apic/>
Aug 09 16:37:26 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:37:26 user nova-compute[73091]:   </features>
Aug 09 16:37:26 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:37:26 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:37:26 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:37:26 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:37:26 user nova-compute[73091]:   </clock>
Aug 09 16:37:26 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:37:26 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:37:26 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:37:26 user nova-compute[73091]:   </cpu>
Aug 09 16:37:26 user nova-compute[73091]:   <devices>
Aug 09 16:37:26 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:37:26 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:37:26 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk"/>
Aug 09 16:37:26 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:37:26 user nova-compute[73091]:     </disk>
Aug 09 16:37:26 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:37:26 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:37:26 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 09 16:37:26 user nova-compute[73091]:       <target dev="vdc" bus="virtio"/>
Aug 09 16:37:26 user nova-compute[73091]:       <serial>08a95280-01c7-4844-b6a9-ae5a8748583f</serial>
Aug 09 16:37:26 user nova-compute[73091]:     </disk>
Aug 09 16:37:26 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:37:26 user nova-compute[73091]:       <mac address="fa:16:3e:dd:62:67"/>
Aug 09 16:37:26 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:37:26 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:37:26 user nova-compute[73091]:       <target dev="tap93308f09-a0"/>
Aug 09 16:37:26 user nova-compute[73091]:     </interface>
Aug 09 16:37:26 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:37:26 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/console.log" append="off"/>
Aug 09 16:37:26 user nova-compute[73091]:     </serial>
Aug 09 16:37:26 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:37:26 user nova-compute[73091]:     <video>
Aug 09 16:37:26 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:37:26 user nova-compute[73091]:     </video>
Aug 09 16:37:26 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:37:26 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:37:26 user nova-compute[73091]:     </rng>
Aug 09 16:37:26 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:37:26 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:37:26 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:37:26 user nova-compute[73091]:     </memballoon>
Aug 09 16:37:26 user nova-compute[73091]:   </devices>
Aug 09 16:37:26 user nova-compute[73091]: </domain>
Aug 09 16:37:26 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T16:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1616872134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1616872134',id=3,image_ref='93cf5d37-48ec-4c45-afba-90bda5253287',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2075151971',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:33:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b8000a47d82748ce8d43d306682d62c6',ramdisk_id='',reservation_id='r-3yoej5re',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1451982310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1451982310-project-member',shelved_at='2023-08-09T16:35:20.021030',shelved_host='user',shelved_image_id='93cf5d37-48ec-4c45-afba-90bda5253287'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:37:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343ec5734ef547f292ee631dbb272359',uuid=f3e2ea27-5fa4-4437-83d0-2eeda59506a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converting VIF {"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:62:67,bridge_name='br-int',has_traffic_filtering=True,id=93308f09-a0e7-49b6-8b29-dc0999acbfc1,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93308f09-a0') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG os_vif [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:62:67,bridge_name='br-int',has_traffic_filtering=True,id=93308f09-a0e7-49b6-8b29-dc0999acbfc1,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93308f09-a0') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93308f09-a0, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap93308f09-a0, col_values=(('external_ids', {'iface-id': '93308f09-a0e7-49b6-8b29-dc0999acbfc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:62:67', 'vm-uuid': 'f3e2ea27-5fa4-4437-83d0-2eeda59506a9'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:26 user nova-compute[73091]: INFO os_vif [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:62:67,bridge_name='br-int',has_traffic_filtering=True,id=93308f09-a0e7-49b6-8b29-dc0999acbfc1,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93308f09-a0')
Aug 09 16:37:26 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] No VIF found with MAC fa:16:3e:dd:62:67, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:37:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:37:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:37:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-453ecf2f-27c9-454d-8ad2-f311fdb5c7ba req-2fa5bb9e-6667-4c6d-bed4-930cd7b42820 service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Received event network-vif-plugged-218c7585-7957-41e4-88d8-6f04e4d4a9bc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-453ecf2f-27c9-454d-8ad2-f311fdb5c7ba req-2fa5bb9e-6667-4c6d-bed4-930cd7b42820 service nova] Acquiring lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-453ecf2f-27c9-454d-8ad2-f311fdb5c7ba req-2fa5bb9e-6667-4c6d-bed4-930cd7b42820 service nova] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-453ecf2f-27c9-454d-8ad2-f311fdb5c7ba req-2fa5bb9e-6667-4c6d-bed4-930cd7b42820 service nova] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-453ecf2f-27c9-454d-8ad2-f311fdb5c7ba req-2fa5bb9e-6667-4c6d-bed4-930cd7b42820 service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] No waiting events found dispatching network-vif-plugged-218c7585-7957-41e4-88d8-6f04e4d4a9bc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:37:27 user nova-compute[73091]: WARNING nova.compute.manager [req-453ecf2f-27c9-454d-8ad2-f311fdb5c7ba req-2fa5bb9e-6667-4c6d-bed4-930cd7b42820 service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Received unexpected event network-vif-plugged-218c7585-7957-41e4-88d8-6f04e4d4a9bc for instance with vm_state active and task_state deleting.
Aug 09 16:37:27 user nova-compute[73091]: INFO nova.virt.block_device [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Booting with volume af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd at /dev/vda
Aug 09 16:37:27 user nova-compute[73091]: DEBUG os_brick.utils [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG nova.policy [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8363e87670bc4cbe85d05285f4a29fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb392d70735f4df8860e29e2ed4f114c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2381658f-857c-4eb7-91ea-236131698b1e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.053s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a259d77f-87df-499c-a2e3-274cf826b61b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6322282-6bd5-45cf-a12d-331db332e7f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d2706c-d1fe-4f64-8caa-1dfb1b5add4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:37:27 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecdec3d-b2b1-49c5-876c-f846fb8d729d]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG os_brick.utils [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Updating existing volume attachment record: 2fae81b7-af2d-4b66-b49a-be96b82b0419 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:37:27 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Took 2.03 seconds to deallocate network for instance.
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-72cf8f1f-348a-42c2-aa9a-31cfed8d894c req-2f158738-0d57-4e2e-a5b1-a37b6f56adae service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-deleted-9f37bd5d-1587-4aad-9da4-892334eadaad {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:27 user nova-compute[73091]: INFO nova.compute.manager [req-72cf8f1f-348a-42c2-aa9a-31cfed8d894c req-2f158738-0d57-4e2e-a5b1-a37b6f56adae service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Neutron deleted interface 9f37bd5d-1587-4aad-9da4-892334eadaad; detaching it from the instance and deleting it from the info cache
Aug 09 16:37:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-72cf8f1f-348a-42c2-aa9a-31cfed8d894c req-2f158738-0d57-4e2e-a5b1-a37b6f56adae service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Updating instance_info_cache with network_info: [{"id": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "address": "fa:16:3e:30:e8:27", "network": {"id": "41f77be1-0754-463b-a14d-b199368ae881", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-32585978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9e1fe5-ad", "ovs_interfaceid": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "address": "fa:16:3e:a0:6f:69", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eac408-ec", "ovs_interfaceid": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "address": "fa:16:3e:db:ca:02", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847e88af-f8", "ovs_interfaceid": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "address": "fa:16:3e:05:45:18", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f12e06-60", "ovs_interfaceid": "09f12e06-60f3-4e4d-b8c0-929fb56b0afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc6e7056-4650-4973-be22-b1d98c14149f", "address": "fa:16:3e:af:95:d3", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc6e7056-46", "ovs_interfaceid": "dc6e7056-4650-4973-be22-b1d98c14149f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:37:27 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Deleted allocations for instance 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb
Aug 09 16:37:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-72cf8f1f-348a-42c2-aa9a-31cfed8d894c req-2f158738-0d57-4e2e-a5b1-a37b6f56adae service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Detach interface failed, port_id=9f37bd5d-1587-4aad-9da4-892334eadaad, reason: Instance 9c8b5adc-d13f-4d9f-a878-e59dd52550c3 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 16:37:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-72cf8f1f-348a-42c2-aa9a-31cfed8d894c req-2f158738-0d57-4e2e-a5b1-a37b6f56adae service nova] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Received event network-vif-deleted-218c7585-7957-41e4-88d8-6f04e4d4a9bc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-72cf8f1f-348a-42c2-aa9a-31cfed8d894c req-2f158738-0d57-4e2e-a5b1-a37b6f56adae service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-deleted-09f12e06-60f3-4e4d-b8c0-929fb56b0afd {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:28 user nova-compute[73091]: INFO nova.compute.manager [req-72cf8f1f-348a-42c2-aa9a-31cfed8d894c req-2f158738-0d57-4e2e-a5b1-a37b6f56adae service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Neutron deleted interface 09f12e06-60f3-4e4d-b8c0-929fb56b0afd; detaching it from the instance and deleting it from the info cache
Aug 09 16:37:28 user nova-compute[73091]: DEBUG nova.network.neutron [req-72cf8f1f-348a-42c2-aa9a-31cfed8d894c req-2f158738-0d57-4e2e-a5b1-a37b6f56adae service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Updating instance_info_cache with network_info: [{"id": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "address": "fa:16:3e:30:e8:27", "network": {"id": "41f77be1-0754-463b-a14d-b199368ae881", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-32585978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9e1fe5-ad", "ovs_interfaceid": "7f9e1fe5-ad99-4c58-9181-0caeb7675dab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "address": "fa:16:3e:a0:6f:69", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3eac408-ec", "ovs_interfaceid": "f3eac408-ecc9-4f3f-a64d-4364c91bf697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "address": "fa:16:3e:db:ca:02", "network": {"id": "8ab67f6f-09ff-4177-8c8a-edb0767cbc4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-61185504", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847e88af-f8", "ovs_interfaceid": "847e88af-f82a-4a2d-aa96-7e3dd512e055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dc6e7056-4650-4973-be22-b1d98c14149f", "address": "fa:16:3e:af:95:d3", "network": {"id": "6acf27ea-51af-4bf4-824d-86b1ae394d4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1264952977", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "19a0681774fe4557921515e98144b9d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc6e7056-46", "ovs_interfaceid": "dc6e7056-4650-4973-be22-b1d98c14149f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:37:28 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Successfully created port: a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:37:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-72cf8f1f-348a-42c2-aa9a-31cfed8d894c req-2f158738-0d57-4e2e-a5b1-a37b6f56adae service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Detach interface failed, port_id=09f12e06-60f3-4e4d-b8c0-929fb56b0afd, reason: Instance 9c8b5adc-d13f-4d9f-a878-e59dd52550c3 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 16:37:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41efface-9d14-4007-b6a2-95a67b736807 tempest-TestVolumeSwap-1621108182 tempest-TestVolumeSwap-1621108182-project-member] Lock "50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.543s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-2b1a4db1-27e9-461b-9a7c-e9190b3c89e3 req-41f448ae-03bf-4de1-a2bb-deb46e5a3de8 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received event network-vif-plugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b1a4db1-27e9-461b-9a7c-e9190b3c89e3 req-41f448ae-03bf-4de1-a2bb-deb46e5a3de8 service nova] Acquiring lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b1a4db1-27e9-461b-9a7c-e9190b3c89e3 req-41f448ae-03bf-4de1-a2bb-deb46e5a3de8 service nova] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b1a4db1-27e9-461b-9a7c-e9190b3c89e3 req-41f448ae-03bf-4de1-a2bb-deb46e5a3de8 service nova] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-2b1a4db1-27e9-461b-9a7c-e9190b3c89e3 req-41f448ae-03bf-4de1-a2bb-deb46e5a3de8 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] No waiting events found dispatching network-vif-plugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:37:28 user nova-compute[73091]: WARNING nova.compute.manager [req-2b1a4db1-27e9-461b-9a7c-e9190b3c89e3 req-41f448ae-03bf-4de1-a2bb-deb46e5a3de8 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received unexpected event network-vif-plugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 16:37:28 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:37:29 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Took 5.68 seconds to deallocate network for instance.
Aug 09 16:37:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:29 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Successfully updated port: a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:37:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Acquiring lock "refresh_cache-b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:37:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Acquired lock "refresh_cache-b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:37:29 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:37:29 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:37:29 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Updating instance_info_cache with network_info: [{"id": "a701119d-6f96-488f-ad0f-ea05c96e5268", "address": "fa:16:3e:32:fc:e5", "network": {"id": "e72f54ab-788d-4574-bf12-9fa76ea48145", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-414514792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb392d70735f4df8860e29e2ed4f114c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa701119d-6f", "ovs_interfaceid": "a701119d-6f96-488f-ad0f-ea05c96e5268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:37:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Releasing lock "refresh_cache-b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:37:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Instance network_info: |[{"id": "a701119d-6f96-488f-ad0f-ea05c96e5268", "address": "fa:16:3e:32:fc:e5", "network": {"id": "e72f54ab-788d-4574-bf12-9fa76ea48145", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-414514792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb392d70735f4df8860e29e2ed4f114c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa701119d-6f", "ovs_interfaceid": "a701119d-6f96-488f-ad0f-ea05c96e5268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:37:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-eb5285dd-ff10-4812-b8d0-9b2e4fe5676d req-f2c05347-f220-4876-a27a-5c1bef8f6077 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-deleted-7f9e1fe5-ad99-4c58-9181-0caeb7675dab {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-eb5285dd-ff10-4812-b8d0-9b2e4fe5676d req-f2c05347-f220-4876-a27a-5c1bef8f6077 service nova] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Received event network-vif-deleted-dc6e7056-4650-4973-be22-b1d98c14149f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:30 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599050.752794, f3e2ea27-5fa4-4437-83d0-2eeda59506a9 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:37:30 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] VM Resumed (Lifecycle Event)
Aug 09 16:37:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:37:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:37:30 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Instance spawned successfully.
Aug 09 16:37:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:37:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:37:30 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:37:30 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599050.7542346, f3e2ea27-5fa4-4437-83d0-2eeda59506a9 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:37:30 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] VM Started (Lifecycle Event)
Aug 09 16:37:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:37:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:37:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-80752ca0-bf97-4300-b63d-c73e280a60ff req-6a6c846a-be72-44c1-adf5-33bba689da0a service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received event network-vif-plugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-80752ca0-bf97-4300-b63d-c73e280a60ff req-6a6c846a-be72-44c1-adf5-33bba689da0a service nova] Acquiring lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-80752ca0-bf97-4300-b63d-c73e280a60ff req-6a6c846a-be72-44c1-adf5-33bba689da0a service nova] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-80752ca0-bf97-4300-b63d-c73e280a60ff req-6a6c846a-be72-44c1-adf5-33bba689da0a service nova] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-80752ca0-bf97-4300-b63d-c73e280a60ff req-6a6c846a-be72-44c1-adf5-33bba689da0a service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] No waiting events found dispatching network-vif-plugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:37:30 user nova-compute[73091]: WARNING nova.compute.manager [req-80752ca0-bf97-4300-b63d-c73e280a60ff req-6a6c846a-be72-44c1-adf5-33bba689da0a service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received unexpected event network-vif-plugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 16:37:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-80752ca0-bf97-4300-b63d-c73e280a60ff req-6a6c846a-be72-44c1-adf5-33bba689da0a service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Received event network-changed-a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-80752ca0-bf97-4300-b63d-c73e280a60ff req-6a6c846a-be72-44c1-adf5-33bba689da0a service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Refreshing instance network info cache due to event network-changed-a701119d-6f96-488f-ad0f-ea05c96e5268. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:37:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-80752ca0-bf97-4300-b63d-c73e280a60ff req-6a6c846a-be72-44c1-adf5-33bba689da0a service nova] Acquiring lock "refresh_cache-b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:37:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-80752ca0-bf97-4300-b63d-c73e280a60ff req-6a6c846a-be72-44c1-adf5-33bba689da0a service nova] Acquired lock "refresh_cache-b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:37:30 user nova-compute[73091]: DEBUG nova.network.neutron [req-80752ca0-bf97-4300-b63d-c73e280a60ff req-6a6c846a-be72-44c1-adf5-33bba689da0a service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Refreshing network info cache for port a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:37:30 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:37:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:37:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-99c3e263-5e30-4f8a-b925-62c1d0543f2d tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.551s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:31 user nova-compute[73091]: INFO nova.compute.manager [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Took 2.42 seconds to detach 3 volumes for instance.
Aug 09 16:37:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-80752ca0-bf97-4300-b63d-c73e280a60ff req-6a6c846a-be72-44c1-adf5-33bba689da0a service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Updated VIF entry in instance network info cache for port a701119d-6f96-488f-ad0f-ea05c96e5268. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:37:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-80752ca0-bf97-4300-b63d-c73e280a60ff req-6a6c846a-be72-44c1-adf5-33bba689da0a service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Updating instance_info_cache with network_info: [{"id": "a701119d-6f96-488f-ad0f-ea05c96e5268", "address": "fa:16:3e:32:fc:e5", "network": {"id": "e72f54ab-788d-4574-bf12-9fa76ea48145", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-414514792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb392d70735f4df8860e29e2ed4f114c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa701119d-6f", "ovs_interfaceid": "a701119d-6f96-488f-ad0f-ea05c96e5268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:37:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-80752ca0-bf97-4300-b63d-c73e280a60ff req-6a6c846a-be72-44c1-adf5-33bba689da0a service nova] Releasing lock "refresh_cache-b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:37:31 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:37:31 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:37:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:31 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Deleted allocations for instance 9c8b5adc-d13f-4d9f-a878-e59dd52550c3
Aug 09 16:37:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-737c3ffd-e884-47ab-8e00-af256a4dbe97 tempest-TaggedBootDevicesTest_v242-297450497 tempest-TaggedBootDevicesTest_v242-297450497-project-member] Lock "9c8b5adc-d13f-4d9f-a878-e59dd52550c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.510s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:37:36 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Creating image(s)
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Ensure instance console log exists: /opt/stack/data/nova/instances/b43afe67-19e9-42b5-ba1b-f00b4aa56fc7/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Start _get_guest_xml network_info=[{"id": "a701119d-6f96-488f-ad0f-ea05c96e5268", "address": "fa:16:3e:32:fc:e5", "network": {"id": "e72f54ab-788d-4574-bf12-9fa76ea48145", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-414514792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb392d70735f4df8860e29e2ed4f114c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa701119d-6f", "ovs_interfaceid": "a701119d-6f96-488f-ad0f-ea05c96e5268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '2fae81b7-af2d-4b66-b49a-be96b82b0419', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crBXfeax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b43afe67-19e9-42b5-ba1b-f00b4aa56fc7', 'attached_at': '', 'detached_at': '', 'volume_id': 'af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd', 'serial': 'af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:37:36 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:37:36 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crBXfeax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:37:36 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:37:36 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:37:36 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbdd8c6-b8d4-423d-8566-e4434906e962]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:37:36 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599041.5922794, 9c8b5adc-d13f-4d9f-a878-e59dd52550c3 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:37:36 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] VM Stopped (Lifecycle Event)
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5d45b5-365f-4216-bbef-bfa364255a3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd] added
Aug 09 16:37:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-575baa08-972c-4413-b909-c36113a83246 None None] [instance: 9c8b5adc-d13f-4d9f-a878-e59dd52550c3] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d971bc-b41b-4ef6-9b66-5e50771c85f5]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e3a9ba-9345-4c29-a461-9c81b8854392]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v crBXfeax {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v crBXfeax" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6648a344-f32e-489d-8031-024ccc58109e]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'crBXfeax'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e415d9b-0b67-4ced-871a-4b078219eb41]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[91645aca-1f4e-4583-b7c6-8c701d63b918]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f (non-flash)
Aug 09 16:37:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f (non-flash)
Aug 09 16:37:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3cc25d-1364-4a86-a716-a4f247bad04c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd, portal: 172.16.0.220,3260]
Aug 09 16:37:36 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd, portal: 172.16.0.220,3260] successful.
Aug 09 16:37:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3d5448-a5c0-4a46-916f-ef7c0965abf8]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cf67be-ed06-485e-a343-b61e8360d38d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f (non-flash)
Aug 09 16:37:36 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:37:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f (non-flash)
Aug 09 16:37:36 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:37:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[643f1e88-22f5-4b69-ae18-c847150c4e5f]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:37:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crBXfeax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26165626232663665', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165626232663665', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:37:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-795799594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-795799594',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkZLgMs6m+7dg3Hs5GmhpEj7horlTD7kkT8Ur0MpazXAI51/Bo/IRROyxIbVDzm2mgAMl3z17iPI2mWhvCp8vxCgW/ifPXfNJE8PGmzhO69XbpdWA00iHhl3K8a22Tf2A==',key_name='tempest-keypair-1207467283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb392d70735f4df8860e29e2ed4f114c',ramdisk_id='',reservation_id='r-ixolz5ob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-24876138',owner_user_name='tempest-ServerActionsV293TestJSON-24876138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:37:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8363e87670bc4cbe85d05285f4a29fc5',uuid=b43afe67-19e9-42b5-ba1b-f00b4aa56fc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a701119d-6f96-488f-ad0f-ea05c96e5268", "address": "fa:16:3e:32:fc:e5", "network": {"id": "e72f54ab-788d-4574-bf12-9fa76ea48145", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-414514792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb392d70735f4df8860e29e2ed4f114c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa701119d-6f", "ovs_interfaceid": "a701119d-6f96-488f-ad0f-ea05c96e5268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Converting VIF {"id": "a701119d-6f96-488f-ad0f-ea05c96e5268", "address": "fa:16:3e:32:fc:e5", "network": {"id": "e72f54ab-788d-4574-bf12-9fa76ea48145", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-414514792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb392d70735f4df8860e29e2ed4f114c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa701119d-6f", "ovs_interfaceid": "a701119d-6f96-488f-ad0f-ea05c96e5268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=a701119d-6f96-488f-ad0f-ea05c96e5268,network=Network(e72f54ab-788d-4574-bf12-9fa76ea48145),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa701119d-6f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lazy-loading 'pci_devices' on Instance uuid b43afe67-19e9-42b5-ba1b-f00b4aa56fc7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:37:37 user nova-compute[73091]:   <uuid>b43afe67-19e9-42b5-ba1b-f00b4aa56fc7</uuid>
Aug 09 16:37:37 user nova-compute[73091]:   <name>instance-0000000e</name>
Aug 09 16:37:37 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:37:37 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:37:37 user nova-compute[73091]:   <metadata>
Aug 09 16:37:37 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:37:37 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:37:37 user nova-compute[73091]:       <nova:name>tempest-ServerActionsV293TestJSON-server-795799594</nova:name>
Aug 09 16:37:37 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:37:36</nova:creationTime>
Aug 09 16:37:37 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:37:37 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:37:37 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:37:37 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:37:37 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:37:37 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:37:37 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:37:37 user nova-compute[73091]:       <nova:owner>
Aug 09 16:37:37 user nova-compute[73091]:         <nova:user uuid="8363e87670bc4cbe85d05285f4a29fc5">tempest-ServerActionsV293TestJSON-24876138-project-member</nova:user>
Aug 09 16:37:37 user nova-compute[73091]:         <nova:project uuid="cb392d70735f4df8860e29e2ed4f114c">tempest-ServerActionsV293TestJSON-24876138</nova:project>
Aug 09 16:37:37 user nova-compute[73091]:       </nova:owner>
Aug 09 16:37:37 user nova-compute[73091]:       <nova:ports>
Aug 09 16:37:37 user nova-compute[73091]:         <nova:port uuid="a701119d-6f96-488f-ad0f-ea05c96e5268">
Aug 09 16:37:37 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 16:37:37 user nova-compute[73091]:         </nova:port>
Aug 09 16:37:37 user nova-compute[73091]:       </nova:ports>
Aug 09 16:37:37 user nova-compute[73091]:     </nova:instance>
Aug 09 16:37:37 user nova-compute[73091]:   </metadata>
Aug 09 16:37:37 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:37:37 user nova-compute[73091]:     <system>
Aug 09 16:37:37 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:37:37 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:37:37 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:37:37 user nova-compute[73091]:       <entry name="serial">b43afe67-19e9-42b5-ba1b-f00b4aa56fc7</entry>
Aug 09 16:37:37 user nova-compute[73091]:       <entry name="uuid">b43afe67-19e9-42b5-ba1b-f00b4aa56fc7</entry>
Aug 09 16:37:37 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:37:37 user nova-compute[73091]:     </system>
Aug 09 16:37:37 user nova-compute[73091]:   </sysinfo>
Aug 09 16:37:37 user nova-compute[73091]:   <os>
Aug 09 16:37:37 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:37:37 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:37:37 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:37:37 user nova-compute[73091]:   </os>
Aug 09 16:37:37 user nova-compute[73091]:   <features>
Aug 09 16:37:37 user nova-compute[73091]:     <acpi/>
Aug 09 16:37:37 user nova-compute[73091]:     <apic/>
Aug 09 16:37:37 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:37:37 user nova-compute[73091]:   </features>
Aug 09 16:37:37 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:37:37 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:37:37 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:37:37 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:37:37 user nova-compute[73091]:   </clock>
Aug 09 16:37:37 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:37:37 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:37:37 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:37:37 user nova-compute[73091]:   </cpu>
Aug 09 16:37:37 user nova-compute[73091]:   <devices>
Aug 09 16:37:37 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:37:37 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:37:37 user nova-compute[73091]:       <source dev="/dev/sdc"/>
Aug 09 16:37:37 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:37:37 user nova-compute[73091]:       <serial>af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd</serial>
Aug 09 16:37:37 user nova-compute[73091]:     </disk>
Aug 09 16:37:37 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:37:37 user nova-compute[73091]:       <mac address="fa:16:3e:32:fc:e5"/>
Aug 09 16:37:37 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:37:37 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:37:37 user nova-compute[73091]:       <target dev="tapa701119d-6f"/>
Aug 09 16:37:37 user nova-compute[73091]:     </interface>
Aug 09 16:37:37 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:37:37 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/b43afe67-19e9-42b5-ba1b-f00b4aa56fc7/console.log" append="off"/>
Aug 09 16:37:37 user nova-compute[73091]:     </serial>
Aug 09 16:37:37 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:37:37 user nova-compute[73091]:     <video>
Aug 09 16:37:37 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:37:37 user nova-compute[73091]:     </video>
Aug 09 16:37:37 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:37:37 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:37:37 user nova-compute[73091]:     </rng>
Aug 09 16:37:37 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:37:37 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:37:37 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:37:37 user nova-compute[73091]:     </memballoon>
Aug 09 16:37:37 user nova-compute[73091]:   </devices>
Aug 09 16:37:37 user nova-compute[73091]: </domain>
Aug 09 16:37:37 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:37:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-795799594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-795799594',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkZLgMs6m+7dg3Hs5GmhpEj7horlTD7kkT8Ur0MpazXAI51/Bo/IRROyxIbVDzm2mgAMl3z17iPI2mWhvCp8vxCgW/ifPXfNJE8PGmzhO69XbpdWA00iHhl3K8a22Tf2A==',key_name='tempest-keypair-1207467283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb392d70735f4df8860e29e2ed4f114c',ramdisk_id='',reservation_id='r-ixolz5ob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-24876138',owner_user_name='tempest-ServerActionsV293TestJSON-24876138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:37:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8363e87670bc4cbe85d05285f4a29fc5',uuid=b43afe67-19e9-42b5-ba1b-f00b4aa56fc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a701119d-6f96-488f-ad0f-ea05c96e5268", "address": "fa:16:3e:32:fc:e5", "network": {"id": "e72f54ab-788d-4574-bf12-9fa76ea48145", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-414514792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb392d70735f4df8860e29e2ed4f114c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa701119d-6f", "ovs_interfaceid": "a701119d-6f96-488f-ad0f-ea05c96e5268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Converting VIF {"id": "a701119d-6f96-488f-ad0f-ea05c96e5268", "address": "fa:16:3e:32:fc:e5", "network": {"id": "e72f54ab-788d-4574-bf12-9fa76ea48145", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-414514792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb392d70735f4df8860e29e2ed4f114c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa701119d-6f", "ovs_interfaceid": "a701119d-6f96-488f-ad0f-ea05c96e5268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=a701119d-6f96-488f-ad0f-ea05c96e5268,network=Network(e72f54ab-788d-4574-bf12-9fa76ea48145),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa701119d-6f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG os_vif [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=a701119d-6f96-488f-ad0f-ea05c96e5268,network=Network(e72f54ab-788d-4574-bf12-9fa76ea48145),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa701119d-6f') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa701119d-6f, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa701119d-6f, col_values=(('external_ids', {'iface-id': 'a701119d-6f96-488f-ad0f-ea05c96e5268', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:fc:e5', 'vm-uuid': 'b43afe67-19e9-42b5-ba1b-f00b4aa56fc7'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:37:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:37 user nova-compute[73091]: INFO os_vif [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=a701119d-6f96-488f-ad0f-ea05c96e5268,network=Network(e72f54ab-788d-4574-bf12-9fa76ea48145),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa701119d-6f')
Aug 09 16:37:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:37:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] No VIF found with MAC fa:16:3e:32:fc:e5, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:37:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-c7859d3a-535c-49c7-a8b2-1a1b01ba17bf req-96895597-9541-4c54-a3a9-d038662f2255 service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Received event network-vif-plugged-a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c7859d3a-535c-49c7-a8b2-1a1b01ba17bf req-96895597-9541-4c54-a3a9-d038662f2255 service nova] Acquiring lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c7859d3a-535c-49c7-a8b2-1a1b01ba17bf req-96895597-9541-4c54-a3a9-d038662f2255 service nova] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c7859d3a-535c-49c7-a8b2-1a1b01ba17bf req-96895597-9541-4c54-a3a9-d038662f2255 service nova] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-c7859d3a-535c-49c7-a8b2-1a1b01ba17bf req-96895597-9541-4c54-a3a9-d038662f2255 service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] No waiting events found dispatching network-vif-plugged-a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:37:39 user nova-compute[73091]: WARNING nova.compute.manager [req-c7859d3a-535c-49c7-a8b2-1a1b01ba17bf req-96895597-9541-4c54-a3a9-d038662f2255 service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Received unexpected event network-vif-plugged-a701119d-6f96-488f-ad0f-ea05c96e5268 for instance with vm_state building and task_state spawning.
Aug 09 16:37:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:40 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599045.3284788, 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:37:40 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] VM Stopped (Lifecycle Event)
Aug 09 16:37:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-87dbcf62-15eb-4e70-90ee-0f53fa93e704 None None] [instance: 50b8a2ca-b8bf-4f19-8866-6a7aeb21a1cb] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:37:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-4030c381-9a86-4b70-a64c-2371b98ac787 req-e459221c-1aaa-4ec0-8754-4d617a860ecb service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Received event network-vif-plugged-a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:37:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4030c381-9a86-4b70-a64c-2371b98ac787 req-e459221c-1aaa-4ec0-8754-4d617a860ecb service nova] Acquiring lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4030c381-9a86-4b70-a64c-2371b98ac787 req-e459221c-1aaa-4ec0-8754-4d617a860ecb service nova] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4030c381-9a86-4b70-a64c-2371b98ac787 req-e459221c-1aaa-4ec0-8754-4d617a860ecb service nova] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-4030c381-9a86-4b70-a64c-2371b98ac787 req-e459221c-1aaa-4ec0-8754-4d617a860ecb service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] No waiting events found dispatching network-vif-plugged-a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:37:41 user nova-compute[73091]: WARNING nova.compute.manager [req-4030c381-9a86-4b70-a64c-2371b98ac787 req-e459221c-1aaa-4ec0-8754-4d617a860ecb service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Received unexpected event network-vif-plugged-a701119d-6f96-488f-ad0f-ea05c96e5268 for instance with vm_state building and task_state spawning.
Aug 09 16:37:42 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599062.1590023, b43afe67-19e9-42b5-ba1b-f00b4aa56fc7 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:37:42 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] VM Resumed (Lifecycle Event)
Aug 09 16:37:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:37:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:37:42 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Instance spawned successfully.
Aug 09 16:37:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:37:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:37:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:37:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:37:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:37:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:37:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:37:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:37:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:37:42 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:37:42 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599062.1599433, b43afe67-19e9-42b5-ba1b-f00b4aa56fc7 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:37:42 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] VM Started (Lifecycle Event)
Aug 09 16:37:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:37:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:37:42 user nova-compute[73091]: INFO nova.compute.manager [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Took 5.83 seconds to spawn the instance on the hypervisor.
Aug 09 16:37:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:37:42 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:37:42 user nova-compute[73091]: INFO nova.compute.manager [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Took 15.93 seconds to build instance.
Aug 09 16:37:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8df4cebe-4a75-4e54-a1fb-e068fd4af202 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.055s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:37:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:58 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:37:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:37:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Acquiring lock "84a64e32-752d-4deb-8364-8889209a97a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "84a64e32-752d-4deb-8364-8889209a97a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Acquiring lock "84a64e32-752d-4deb-8364-8889209a97a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:37:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "84a64e32-752d-4deb-8364-8889209a97a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:37:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "84a64e32-752d-4deb-8364-8889209a97a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:37:59 user nova-compute[73091]: INFO nova.compute.manager [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Terminating instance
Aug 09 16:37:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:37:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:37:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-f98d8119-ecc2-4ced-8148-f5f19a243541 req-d0b8ca9d-e10d-4591-aad4-cc6207eb053b service nova] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Received event network-vif-unplugged-cf196e19-6250-442f-86ab-ed00224a3b72 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:38:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f98d8119-ecc2-4ced-8148-f5f19a243541 req-d0b8ca9d-e10d-4591-aad4-cc6207eb053b service nova] Acquiring lock "84a64e32-752d-4deb-8364-8889209a97a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f98d8119-ecc2-4ced-8148-f5f19a243541 req-d0b8ca9d-e10d-4591-aad4-cc6207eb053b service nova] Lock "84a64e32-752d-4deb-8364-8889209a97a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f98d8119-ecc2-4ced-8148-f5f19a243541 req-d0b8ca9d-e10d-4591-aad4-cc6207eb053b service nova] Lock "84a64e32-752d-4deb-8364-8889209a97a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-f98d8119-ecc2-4ced-8148-f5f19a243541 req-d0b8ca9d-e10d-4591-aad4-cc6207eb053b service nova] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] No waiting events found dispatching network-vif-unplugged-cf196e19-6250-442f-86ab-ed00224a3b72 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:38:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-f98d8119-ecc2-4ced-8148-f5f19a243541 req-d0b8ca9d-e10d-4591-aad4-cc6207eb053b service nova] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Received event network-vif-unplugged-cf196e19-6250-442f-86ab-ed00224a3b72 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:38:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Instance destroyed successfully.
Aug 09 16:38:00 user nova-compute[73091]: DEBUG nova.objects.instance [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lazy-loading 'resources' on Instance uuid 84a64e32-752d-4deb-8364-8889209a97a2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:38:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-642570949',display_name='tempest-VolumesActionsTest-instance-642570949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-642570949',id=12,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:36:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4c24350e3214cfe89b2a4e2f1298121',ramdisk_id='',reservation_id='r-uypj0yyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1284523061',owner_user_name='tempest-VolumesActionsTest-1284523061-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:36:17Z,user_data=None,user_id='54214e99474245ff8c66816e1a103260',uuid=84a64e32-752d-4deb-8364-8889209a97a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf196e19-6250-442f-86ab-ed00224a3b72", "address": "fa:16:3e:f2:e9:24", "network": {"id": "5bae1654-cc49-420b-ab90-299d2f87c8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-433837263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c24350e3214cfe89b2a4e2f1298121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf196e19-62", "ovs_interfaceid": "cf196e19-6250-442f-86ab-ed00224a3b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:38:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Converting VIF {"id": "cf196e19-6250-442f-86ab-ed00224a3b72", "address": "fa:16:3e:f2:e9:24", "network": {"id": "5bae1654-cc49-420b-ab90-299d2f87c8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-433837263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c24350e3214cfe89b2a4e2f1298121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf196e19-62", "ovs_interfaceid": "cf196e19-6250-442f-86ab-ed00224a3b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:38:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:e9:24,bridge_name='br-int',has_traffic_filtering=True,id=cf196e19-6250-442f-86ab-ed00224a3b72,network=Network(5bae1654-cc49-420b-ab90-299d2f87c8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf196e19-62') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:38:00 user nova-compute[73091]: DEBUG os_vif [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:e9:24,bridge_name='br-int',has_traffic_filtering=True,id=cf196e19-6250-442f-86ab-ed00224a3b72,network=Network(5bae1654-cc49-420b-ab90-299d2f87c8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf196e19-62') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:38:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf196e19-62, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:38:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:00 user nova-compute[73091]: INFO os_vif [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:e9:24,bridge_name='br-int',has_traffic_filtering=True,id=cf196e19-6250-442f-86ab-ed00224a3b72,network=Network(5bae1654-cc49-420b-ab90-299d2f87c8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf196e19-62')
Aug 09 16:38:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Deleting instance files /opt/stack/data/nova/instances/84a64e32-752d-4deb-8364-8889209a97a2_del
Aug 09 16:38:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Deletion of /opt/stack/data/nova/instances/84a64e32-752d-4deb-8364-8889209a97a2_del complete
Aug 09 16:38:00 user nova-compute[73091]: INFO nova.compute.manager [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 09 16:38:00 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:38:00 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:38:00 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:38:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:38:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:38:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 16:38:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Skipping network cache update for instance because it is being deleted. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 09 16:38:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:38:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:38:02 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:38:02 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:38:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-e828901c-8157-4ea0-aae6-67db06072cfd req-dd5b3d7f-363c-4754-ad03-63f06448086c service nova] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Received event network-vif-plugged-cf196e19-6250-442f-86ab-ed00224a3b72 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:38:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e828901c-8157-4ea0-aae6-67db06072cfd req-dd5b3d7f-363c-4754-ad03-63f06448086c service nova] Acquiring lock "84a64e32-752d-4deb-8364-8889209a97a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e828901c-8157-4ea0-aae6-67db06072cfd req-dd5b3d7f-363c-4754-ad03-63f06448086c service nova] Lock "84a64e32-752d-4deb-8364-8889209a97a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e828901c-8157-4ea0-aae6-67db06072cfd req-dd5b3d7f-363c-4754-ad03-63f06448086c service nova] Lock "84a64e32-752d-4deb-8364-8889209a97a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-e828901c-8157-4ea0-aae6-67db06072cfd req-dd5b3d7f-363c-4754-ad03-63f06448086c service nova] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] No waiting events found dispatching network-vif-plugged-cf196e19-6250-442f-86ab-ed00224a3b72 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:38:02 user nova-compute[73091]: WARNING nova.compute.manager [req-e828901c-8157-4ea0-aae6-67db06072cfd req-dd5b3d7f-363c-4754-ad03-63f06448086c service nova] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Received unexpected event network-vif-plugged-cf196e19-6250-442f-86ab-ed00224a3b72 for instance with vm_state active and task_state deleting.
Aug 09 16:38:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:02 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:38:02 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Took 2.30 seconds to deallocate network for instance.
Aug 09 16:38:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-c0392ad9-8efa-43b2-8ca0-ae744a56b476 req-ce448580-8c42-4b9f-8e64-927c382c2b4a service nova] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Received event network-vif-deleted-cf196e19-6250-442f-86ab-ed00224a3b72 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:38:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:03 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:38:03 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:38:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:03 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Deleted allocations for instance 84a64e32-752d-4deb-8364-8889209a97a2
Aug 09 16:38:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-516495b2-9ff5-4a1f-ac37-d47efb906a8c tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "84a64e32-752d-4deb-8364-8889209a97a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.643s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:03 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Updating instance_info_cache with network_info: [{"id": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "address": "fa:16:3e:c2:25:04", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795c9edc-7b", "ovs_interfaceid": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:38:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:38:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:38:03 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:38:03 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:38:03 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:38:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:38:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:38:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:05 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:38:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:38:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:38:07 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:38:07 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:38:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7961MB free_disk=25.67047882080078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:38:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:38:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:38:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f3e2ea27-5fa4-4437-83d0-2eeda59506a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:38:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance b43afe67-19e9-42b5-ba1b-f00b4aa56fc7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:38:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:38:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:38:07 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:38:07 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:38:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:38:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:08 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:38:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "68d63bc2-d726-49d8-91de-bc5cc66bb119" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:38:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:38:10 user nova-compute[73091]: INFO nova.compute.claims [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Claim successful on node user
Aug 09 16:38:11 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:38:11 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:38:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:38:11 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Creating image(s)
Aug 09 16:38:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "/opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "/opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "/opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG nova.policy [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77a90a17815b46b8a64be7510ac5ba49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329738ae9226414383acb6dcbd09dea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.153s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk 1073741824" returned: 0 in 0.053s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.164s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:38:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:12 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Cannot resize image /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:38:12 user nova-compute[73091]: DEBUG nova.objects.instance [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lazy-loading 'migration_context' on Instance uuid 68d63bc2-d726-49d8-91de-bc5cc66bb119 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:38:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:38:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Ensure instance console log exists: /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:38:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Successfully created port: 93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:38:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:14 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Successfully updated port: 93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:38:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:38:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquired lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:38:14 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:38:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-2155e8f5-244b-42d0-8473-ccec7f0823d6 req-0e821347-2347-4e91-b83f-65cbd6a23e8b service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received event network-changed-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:38:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-2155e8f5-244b-42d0-8473-ccec7f0823d6 req-0e821347-2347-4e91-b83f-65cbd6a23e8b service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Refreshing instance network info cache due to event network-changed-93d41bee-7cab-45a7-b409-dd19fc3b88b6. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:38:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2155e8f5-244b-42d0-8473-ccec7f0823d6 req-0e821347-2347-4e91-b83f-65cbd6a23e8b service nova] Acquiring lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:38:14 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Updating instance_info_cache with network_info: [{"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Releasing lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Instance network_info: |[{"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2155e8f5-244b-42d0-8473-ccec7f0823d6 req-0e821347-2347-4e91-b83f-65cbd6a23e8b service nova] Acquired lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.network.neutron [req-2155e8f5-244b-42d0-8473-ccec7f0823d6 req-0e821347-2347-4e91-b83f-65cbd6a23e8b service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Refreshing network info cache for port 93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Start _get_guest_xml network_info=[{"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:38:15 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:38:15 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1756856509',display_name='tempest-ServerActionsTestOtherB-server-1756856509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1756856509',id=15,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX4A4WBbci8tvlyfsVn8RtvZ67v0qxFwI098O4ybt1xkpAJgwLMitJ+vOXZXn9ziILn0Dux9cadl75sAIWbob/GvRq9Jin537WzoAVu2MvbyterRxvGm1tqvtVxJqTjrw==',key_name='tempest-keypair-561558216',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='329738ae9226414383acb6dcbd09dea0',ramdisk_id='',reservation_id='r-r2gg9o0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1665559429',owner_user_name='tempest-ServerActionsTestOtherB-1665559429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:38:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a90a17815b46b8a64be7510ac5ba49',uuid=68d63bc2-d726-49d8-91de-bc5cc66bb119,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Converting VIF {"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.objects.instance [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lazy-loading 'pci_devices' on Instance uuid 68d63bc2-d726-49d8-91de-bc5cc66bb119 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:38:15 user nova-compute[73091]:   <uuid>68d63bc2-d726-49d8-91de-bc5cc66bb119</uuid>
Aug 09 16:38:15 user nova-compute[73091]:   <name>instance-0000000f</name>
Aug 09 16:38:15 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:38:15 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:38:15 user nova-compute[73091]:   <metadata>
Aug 09 16:38:15 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:38:15 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:38:15 user nova-compute[73091]:       <nova:name>tempest-ServerActionsTestOtherB-server-1756856509</nova:name>
Aug 09 16:38:15 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:38:15</nova:creationTime>
Aug 09 16:38:15 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:38:15 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:38:15 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:38:15 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:38:15 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:38:15 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:38:15 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:38:15 user nova-compute[73091]:       <nova:owner>
Aug 09 16:38:15 user nova-compute[73091]:         <nova:user uuid="77a90a17815b46b8a64be7510ac5ba49">tempest-ServerActionsTestOtherB-1665559429-project-member</nova:user>
Aug 09 16:38:15 user nova-compute[73091]:         <nova:project uuid="329738ae9226414383acb6dcbd09dea0">tempest-ServerActionsTestOtherB-1665559429</nova:project>
Aug 09 16:38:15 user nova-compute[73091]:       </nova:owner>
Aug 09 16:38:15 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:38:15 user nova-compute[73091]:       <nova:ports>
Aug 09 16:38:15 user nova-compute[73091]:         <nova:port uuid="93d41bee-7cab-45a7-b409-dd19fc3b88b6">
Aug 09 16:38:15 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 16:38:15 user nova-compute[73091]:         </nova:port>
Aug 09 16:38:15 user nova-compute[73091]:       </nova:ports>
Aug 09 16:38:15 user nova-compute[73091]:     </nova:instance>
Aug 09 16:38:15 user nova-compute[73091]:   </metadata>
Aug 09 16:38:15 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:38:15 user nova-compute[73091]:     <system>
Aug 09 16:38:15 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:38:15 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:38:15 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:38:15 user nova-compute[73091]:       <entry name="serial">68d63bc2-d726-49d8-91de-bc5cc66bb119</entry>
Aug 09 16:38:15 user nova-compute[73091]:       <entry name="uuid">68d63bc2-d726-49d8-91de-bc5cc66bb119</entry>
Aug 09 16:38:15 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:38:15 user nova-compute[73091]:     </system>
Aug 09 16:38:15 user nova-compute[73091]:   </sysinfo>
Aug 09 16:38:15 user nova-compute[73091]:   <os>
Aug 09 16:38:15 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:38:15 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:38:15 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:38:15 user nova-compute[73091]:   </os>
Aug 09 16:38:15 user nova-compute[73091]:   <features>
Aug 09 16:38:15 user nova-compute[73091]:     <acpi/>
Aug 09 16:38:15 user nova-compute[73091]:     <apic/>
Aug 09 16:38:15 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:38:15 user nova-compute[73091]:   </features>
Aug 09 16:38:15 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:38:15 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:38:15 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:38:15 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:38:15 user nova-compute[73091]:   </clock>
Aug 09 16:38:15 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:38:15 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:38:15 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:38:15 user nova-compute[73091]:   </cpu>
Aug 09 16:38:15 user nova-compute[73091]:   <devices>
Aug 09 16:38:15 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:38:15 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:38:15 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk"/>
Aug 09 16:38:15 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:38:15 user nova-compute[73091]:     </disk>
Aug 09 16:38:15 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:38:15 user nova-compute[73091]:       <mac address="fa:16:3e:3c:81:07"/>
Aug 09 16:38:15 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:38:15 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:38:15 user nova-compute[73091]:       <target dev="tap93d41bee-7c"/>
Aug 09 16:38:15 user nova-compute[73091]:     </interface>
Aug 09 16:38:15 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:38:15 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/console.log" append="off"/>
Aug 09 16:38:15 user nova-compute[73091]:     </serial>
Aug 09 16:38:15 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:38:15 user nova-compute[73091]:     <video>
Aug 09 16:38:15 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:38:15 user nova-compute[73091]:     </video>
Aug 09 16:38:15 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:38:15 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:38:15 user nova-compute[73091]:     </rng>
Aug 09 16:38:15 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:38:15 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:38:15 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:38:15 user nova-compute[73091]:     </memballoon>
Aug 09 16:38:15 user nova-compute[73091]:   </devices>
Aug 09 16:38:15 user nova-compute[73091]: </domain>
Aug 09 16:38:15 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1756856509',display_name='tempest-ServerActionsTestOtherB-server-1756856509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1756856509',id=15,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX4A4WBbci8tvlyfsVn8RtvZ67v0qxFwI098O4ybt1xkpAJgwLMitJ+vOXZXn9ziILn0Dux9cadl75sAIWbob/GvRq9Jin537WzoAVu2MvbyterRxvGm1tqvtVxJqTjrw==',key_name='tempest-keypair-561558216',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='329738ae9226414383acb6dcbd09dea0',ramdisk_id='',reservation_id='r-r2gg9o0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1665559429',owner_user_name='tempest-ServerActionsTestOtherB-1665559429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:38:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a90a17815b46b8a64be7510ac5ba49',uuid=68d63bc2-d726-49d8-91de-bc5cc66bb119,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Converting VIF {"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG os_vif [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93d41bee-7c, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap93d41bee-7c, col_values=(('external_ids', {'iface-id': '93d41bee-7cab-45a7-b409-dd19fc3b88b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:81:07', 'vm-uuid': '68d63bc2-d726-49d8-91de-bc5cc66bb119'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:15 user nova-compute[73091]: INFO os_vif [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c')
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599080.538242, 84a64e32-752d-4deb-8364-8889209a97a2 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:38:15 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] VM Stopped (Lifecycle Event)
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] No VIF found with MAC fa:16:3e:3c:81:07, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f545ea6b-6f2f-4365-bb86-8515182c1a31 None None] [instance: 84a64e32-752d-4deb-8364-8889209a97a2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.network.neutron [req-2155e8f5-244b-42d0-8473-ccec7f0823d6 req-0e821347-2347-4e91-b83f-65cbd6a23e8b service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Updated VIF entry in instance network info cache for port 93d41bee-7cab-45a7-b409-dd19fc3b88b6. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG nova.network.neutron [req-2155e8f5-244b-42d0-8473-ccec7f0823d6 req-0e821347-2347-4e91-b83f-65cbd6a23e8b service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Updating instance_info_cache with network_info: [{"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:38:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2155e8f5-244b-42d0-8473-ccec7f0823d6 req-0e821347-2347-4e91-b83f-65cbd6a23e8b service nova] Releasing lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:38:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:38:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:38:16 user nova-compute[73091]: INFO nova.compute.claims [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Claim successful on node user
Aug 09 16:38:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:17 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:38:17 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:38:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:38:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:38:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:38:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:38:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-f6932400-13f4-4952-ad33-3590cb7cbc37 req-01c2040f-1997-4e60-a43e-400f0e3c2f33 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received event network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:38:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f6932400-13f4-4952-ad33-3590cb7cbc37 req-01c2040f-1997-4e60-a43e-400f0e3c2f33 service nova] Acquiring lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f6932400-13f4-4952-ad33-3590cb7cbc37 req-01c2040f-1997-4e60-a43e-400f0e3c2f33 service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f6932400-13f4-4952-ad33-3590cb7cbc37 req-01c2040f-1997-4e60-a43e-400f0e3c2f33 service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-f6932400-13f4-4952-ad33-3590cb7cbc37 req-01c2040f-1997-4e60-a43e-400f0e3c2f33 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] No waiting events found dispatching network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:38:17 user nova-compute[73091]: WARNING nova.compute.manager [req-f6932400-13f4-4952-ad33-3590cb7cbc37 req-01c2040f-1997-4e60-a43e-400f0e3c2f33 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received unexpected event network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 for instance with vm_state building and task_state spawning.
Aug 09 16:38:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:38:17 user nova-compute[73091]: DEBUG nova.policy [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '992b965912454b79b9d70db85c232bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c72c5d15254ac2bf4348b99858f839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:38:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:38:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:38:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Creating image(s)
Aug 09 16:38:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "/opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "/opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "/opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.255s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.152s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk 1073741824" returned: 0 in 0.073s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.218s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:18 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Successfully created port: c79746b9-c9d0-4f25-8934-f7f10a46f558 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:18 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Cannot resize image /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:38:18 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lazy-loading 'migration_context' on Instance uuid 93e10fd4-8841-4043-b4e2-7489c4dea3e6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:38:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:38:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Ensure instance console log exists: /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599099.3080559, 68d63bc2-d726-49d8-91de-bc5cc66bb119 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:38:19 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] VM Resumed (Lifecycle Event)
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:38:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Instance spawned successfully.
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:38:19 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599099.3087034, 68d63bc2-d726-49d8-91de-bc5cc66bb119 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:38:19 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] VM Started (Lifecycle Event)
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-3d900b60-b798-4fac-a76a-8e6fe1515d6f req-d7fe36ad-3a1f-41e4-88ef-be76c458775b service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received event network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3d900b60-b798-4fac-a76a-8e6fe1515d6f req-d7fe36ad-3a1f-41e4-88ef-be76c458775b service nova] Acquiring lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3d900b60-b798-4fac-a76a-8e6fe1515d6f req-d7fe36ad-3a1f-41e4-88ef-be76c458775b service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3d900b60-b798-4fac-a76a-8e6fe1515d6f req-d7fe36ad-3a1f-41e4-88ef-be76c458775b service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-3d900b60-b798-4fac-a76a-8e6fe1515d6f req-d7fe36ad-3a1f-41e4-88ef-be76c458775b service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] No waiting events found dispatching network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:38:19 user nova-compute[73091]: WARNING nova.compute.manager [req-3d900b60-b798-4fac-a76a-8e6fe1515d6f req-d7fe36ad-3a1f-41e4-88ef-be76c458775b service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received unexpected event network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 for instance with vm_state building and task_state spawning.
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:38:19 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:38:19 user nova-compute[73091]: INFO nova.compute.manager [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Took 8.08 seconds to spawn the instance on the hypervisor.
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:38:19 user nova-compute[73091]: INFO nova.compute.manager [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Took 8.75 seconds to build instance.
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Successfully updated port: c79746b9-c9d0-4f25-8934-f7f10a46f558 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cfba4981-ca0c-428b-8e31-be83b7fd177d tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.849s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "refresh_cache-93e10fd4-8841-4043-b4e2-7489c4dea3e6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquired lock "refresh_cache-93e10fd4-8841-4043-b4e2-7489c4dea3e6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-3127ee04-c8f6-41db-8a38-40baf97cb5af req-de6f108c-c9db-4164-a76a-073cdf3f9525 service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Received event network-changed-c79746b9-c9d0-4f25-8934-f7f10a46f558 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-3127ee04-c8f6-41db-8a38-40baf97cb5af req-de6f108c-c9db-4164-a76a-073cdf3f9525 service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Refreshing instance network info cache due to event network-changed-c79746b9-c9d0-4f25-8934-f7f10a46f558. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3127ee04-c8f6-41db-8a38-40baf97cb5af req-de6f108c-c9db-4164-a76a-073cdf3f9525 service nova] Acquiring lock "refresh_cache-93e10fd4-8841-4043-b4e2-7489c4dea3e6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Updating instance_info_cache with network_info: [{"id": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "address": "fa:16:3e:0b:7a:ff", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79746b9-c9", "ovs_interfaceid": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Releasing lock "refresh_cache-93e10fd4-8841-4043-b4e2-7489c4dea3e6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Instance network_info: |[{"id": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "address": "fa:16:3e:0b:7a:ff", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79746b9-c9", "ovs_interfaceid": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3127ee04-c8f6-41db-8a38-40baf97cb5af req-de6f108c-c9db-4164-a76a-073cdf3f9525 service nova] Acquired lock "refresh_cache-93e10fd4-8841-4043-b4e2-7489c4dea3e6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-3127ee04-c8f6-41db-8a38-40baf97cb5af req-de6f108c-c9db-4164-a76a-073cdf3f9525 service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Refreshing network info cache for port c79746b9-c9d0-4f25-8934-f7f10a46f558 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:38:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Start _get_guest_xml network_info=[{"id": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "address": "fa:16:3e:0b:7a:ff", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79746b9-c9", "ovs_interfaceid": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:38:19 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:38:19 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-29133387',display_name='tempest-VolumesAdminNegativeTest-server-29133387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-29133387',id=16,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKp7KCeVFBZ6U0TsbVZzBp5sTrmJyGHDpI4aaRqPmXJhjLq3SF5k/pVG4rh5vnDs786ns7g7hLBIlwMPe2IJ3RqSWbZFoYY+MwBuSt5T+DBiPugCnn6df1DKp3oWRKoWpQ==',key_name='tempest-keypair-1517575998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22c72c5d15254ac2bf4348b99858f839',ramdisk_id='',reservation_id='r-ybfowc7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1174699978',owner_user_name='tempest-VolumesAdminNegativeTest-1174699978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:38:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='992b965912454b79b9d70db85c232bc0',uuid=93e10fd4-8841-4043-b4e2-7489c4dea3e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "address": "fa:16:3e:0b:7a:ff", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79746b9-c9", "ovs_interfaceid": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Converting VIF {"id": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "address": "fa:16:3e:0b:7a:ff", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79746b9-c9", "ovs_interfaceid": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7a:ff,bridge_name='br-int',has_traffic_filtering=True,id=c79746b9-c9d0-4f25-8934-f7f10a46f558,network=Network(4279c047-a328-4c4c-aff6-667871ec03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79746b9-c9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lazy-loading 'pci_devices' on Instance uuid 93e10fd4-8841-4043-b4e2-7489c4dea3e6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:38:20 user nova-compute[73091]:   <uuid>93e10fd4-8841-4043-b4e2-7489c4dea3e6</uuid>
Aug 09 16:38:20 user nova-compute[73091]:   <name>instance-00000010</name>
Aug 09 16:38:20 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:38:20 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:38:20 user nova-compute[73091]:   <metadata>
Aug 09 16:38:20 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:38:20 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:38:20 user nova-compute[73091]:       <nova:name>tempest-VolumesAdminNegativeTest-server-29133387</nova:name>
Aug 09 16:38:20 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:38:19</nova:creationTime>
Aug 09 16:38:20 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:38:20 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:38:20 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:38:20 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:38:20 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:38:20 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:38:20 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:38:20 user nova-compute[73091]:       <nova:owner>
Aug 09 16:38:20 user nova-compute[73091]:         <nova:user uuid="992b965912454b79b9d70db85c232bc0">tempest-VolumesAdminNegativeTest-1174699978-project-member</nova:user>
Aug 09 16:38:20 user nova-compute[73091]:         <nova:project uuid="22c72c5d15254ac2bf4348b99858f839">tempest-VolumesAdminNegativeTest-1174699978</nova:project>
Aug 09 16:38:20 user nova-compute[73091]:       </nova:owner>
Aug 09 16:38:20 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:38:20 user nova-compute[73091]:       <nova:ports>
Aug 09 16:38:20 user nova-compute[73091]:         <nova:port uuid="c79746b9-c9d0-4f25-8934-f7f10a46f558">
Aug 09 16:38:20 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 16:38:20 user nova-compute[73091]:         </nova:port>
Aug 09 16:38:20 user nova-compute[73091]:       </nova:ports>
Aug 09 16:38:20 user nova-compute[73091]:     </nova:instance>
Aug 09 16:38:20 user nova-compute[73091]:   </metadata>
Aug 09 16:38:20 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:38:20 user nova-compute[73091]:     <system>
Aug 09 16:38:20 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:38:20 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:38:20 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:38:20 user nova-compute[73091]:       <entry name="serial">93e10fd4-8841-4043-b4e2-7489c4dea3e6</entry>
Aug 09 16:38:20 user nova-compute[73091]:       <entry name="uuid">93e10fd4-8841-4043-b4e2-7489c4dea3e6</entry>
Aug 09 16:38:20 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:38:20 user nova-compute[73091]:     </system>
Aug 09 16:38:20 user nova-compute[73091]:   </sysinfo>
Aug 09 16:38:20 user nova-compute[73091]:   <os>
Aug 09 16:38:20 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:38:20 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:38:20 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:38:20 user nova-compute[73091]:   </os>
Aug 09 16:38:20 user nova-compute[73091]:   <features>
Aug 09 16:38:20 user nova-compute[73091]:     <acpi/>
Aug 09 16:38:20 user nova-compute[73091]:     <apic/>
Aug 09 16:38:20 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:38:20 user nova-compute[73091]:   </features>
Aug 09 16:38:20 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:38:20 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:38:20 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:38:20 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:38:20 user nova-compute[73091]:   </clock>
Aug 09 16:38:20 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:38:20 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:38:20 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:38:20 user nova-compute[73091]:   </cpu>
Aug 09 16:38:20 user nova-compute[73091]:   <devices>
Aug 09 16:38:20 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:38:20 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:38:20 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk"/>
Aug 09 16:38:20 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:38:20 user nova-compute[73091]:     </disk>
Aug 09 16:38:20 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:38:20 user nova-compute[73091]:       <mac address="fa:16:3e:0b:7a:ff"/>
Aug 09 16:38:20 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:38:20 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:38:20 user nova-compute[73091]:       <target dev="tapc79746b9-c9"/>
Aug 09 16:38:20 user nova-compute[73091]:     </interface>
Aug 09 16:38:20 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:38:20 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/console.log" append="off"/>
Aug 09 16:38:20 user nova-compute[73091]:     </serial>
Aug 09 16:38:20 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:38:20 user nova-compute[73091]:     <video>
Aug 09 16:38:20 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:38:20 user nova-compute[73091]:     </video>
Aug 09 16:38:20 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:38:20 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:38:20 user nova-compute[73091]:     </rng>
Aug 09 16:38:20 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:38:20 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:38:20 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:38:20 user nova-compute[73091]:     </memballoon>
Aug 09 16:38:20 user nova-compute[73091]:   </devices>
Aug 09 16:38:20 user nova-compute[73091]: </domain>
Aug 09 16:38:20 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-29133387',display_name='tempest-VolumesAdminNegativeTest-server-29133387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-29133387',id=16,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKp7KCeVFBZ6U0TsbVZzBp5sTrmJyGHDpI4aaRqPmXJhjLq3SF5k/pVG4rh5vnDs786ns7g7hLBIlwMPe2IJ3RqSWbZFoYY+MwBuSt5T+DBiPugCnn6df1DKp3oWRKoWpQ==',key_name='tempest-keypair-1517575998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22c72c5d15254ac2bf4348b99858f839',ramdisk_id='',reservation_id='r-ybfowc7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1174699978',owner_user_name='tempest-VolumesAdminNegativeTest-1174699978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:38:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='992b965912454b79b9d70db85c232bc0',uuid=93e10fd4-8841-4043-b4e2-7489c4dea3e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "address": "fa:16:3e:0b:7a:ff", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79746b9-c9", "ovs_interfaceid": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Converting VIF {"id": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "address": "fa:16:3e:0b:7a:ff", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79746b9-c9", "ovs_interfaceid": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7a:ff,bridge_name='br-int',has_traffic_filtering=True,id=c79746b9-c9d0-4f25-8934-f7f10a46f558,network=Network(4279c047-a328-4c4c-aff6-667871ec03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79746b9-c9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG os_vif [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7a:ff,bridge_name='br-int',has_traffic_filtering=True,id=c79746b9-c9d0-4f25-8934-f7f10a46f558,network=Network(4279c047-a328-4c4c-aff6-667871ec03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79746b9-c9') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc79746b9-c9, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc79746b9-c9, col_values=(('external_ids', {'iface-id': 'c79746b9-c9d0-4f25-8934-f7f10a46f558', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:7a:ff', 'vm-uuid': '93e10fd4-8841-4043-b4e2-7489c4dea3e6'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:20 user nova-compute[73091]: INFO os_vif [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7a:ff,bridge_name='br-int',has_traffic_filtering=True,id=c79746b9-c9d0-4f25-8934-f7f10a46f558,network=Network(4279c047-a328-4c4c-aff6-667871ec03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79746b9-c9')
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] No VIF found with MAC fa:16:3e:0b:7a:ff, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.network.neutron [req-3127ee04-c8f6-41db-8a38-40baf97cb5af req-de6f108c-c9db-4164-a76a-073cdf3f9525 service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Updated VIF entry in instance network info cache for port c79746b9-c9d0-4f25-8934-f7f10a46f558. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG nova.network.neutron [req-3127ee04-c8f6-41db-8a38-40baf97cb5af req-de6f108c-c9db-4164-a76a-073cdf3f9525 service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Updating instance_info_cache with network_info: [{"id": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "address": "fa:16:3e:0b:7a:ff", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79746b9-c9", "ovs_interfaceid": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3127ee04-c8f6-41db-8a38-40baf97cb5af req-de6f108c-c9db-4164-a76a-073cdf3f9525 service nova] Releasing lock "refresh_cache-93e10fd4-8841-4043-b4e2-7489c4dea3e6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "38051bca-7190-4dff-91d1-3d99b4e4182b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:38:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:21 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:38:21 user nova-compute[73091]: INFO nova.compute.claims [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Claim successful on node user
Aug 09 16:38:21 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:38:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:21 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:38:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:38:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:38:21 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:38:21 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:38:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:38:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Creating image(s)
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "/opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "/opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "/opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG nova.policy [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fee448a86074a69ac5a45ac5b010069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65ef533e7c145faae7d9af3815007ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-4ea57d0a-0d75-4894-a02f-14ea7aa78dad req-693388e6-4ae0-409e-b090-c173b7bc9575 service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Received event network-vif-plugged-c79746b9-c9d0-4f25-8934-f7f10a46f558 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ea57d0a-0d75-4894-a02f-14ea7aa78dad req-693388e6-4ae0-409e-b090-c173b7bc9575 service nova] Acquiring lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ea57d0a-0d75-4894-a02f-14ea7aa78dad req-693388e6-4ae0-409e-b090-c173b7bc9575 service nova] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4ea57d0a-0d75-4894-a02f-14ea7aa78dad req-693388e6-4ae0-409e-b090-c173b7bc9575 service nova] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-4ea57d0a-0d75-4894-a02f-14ea7aa78dad req-693388e6-4ae0-409e-b090-c173b7bc9575 service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] No waiting events found dispatching network-vif-plugged-c79746b9-c9d0-4f25-8934-f7f10a46f558 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:38:22 user nova-compute[73091]: WARNING nova.compute.manager [req-4ea57d0a-0d75-4894-a02f-14ea7aa78dad req-693388e6-4ae0-409e-b090-c173b7bc9575 service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Received unexpected event network-vif-plugged-c79746b9-c9d0-4f25-8934-f7f10a46f558 for instance with vm_state building and task_state spawning.
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk 1073741824" returned: 0 in 0.069s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.154s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Cannot resize image /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG nova.objects.instance [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lazy-loading 'migration_context' on Instance uuid 38051bca-7190-4dff-91d1-3d99b4e4182b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Ensure instance console log exists: /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Successfully created port: 50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Successfully updated port: 50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquired lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-ee01b0a2-e430-4d4e-a886-021ddbf9b4d6 req-f29e4c6a-36d9-4ecc-97ca-7ae2e51f6741 service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Received event network-vif-plugged-c79746b9-c9d0-4f25-8934-f7f10a46f558 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ee01b0a2-e430-4d4e-a886-021ddbf9b4d6 req-f29e4c6a-36d9-4ecc-97ca-7ae2e51f6741 service nova] Acquiring lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ee01b0a2-e430-4d4e-a886-021ddbf9b4d6 req-f29e4c6a-36d9-4ecc-97ca-7ae2e51f6741 service nova] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ee01b0a2-e430-4d4e-a886-021ddbf9b4d6 req-f29e4c6a-36d9-4ecc-97ca-7ae2e51f6741 service nova] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-ee01b0a2-e430-4d4e-a886-021ddbf9b4d6 req-f29e4c6a-36d9-4ecc-97ca-7ae2e51f6741 service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] No waiting events found dispatching network-vif-plugged-c79746b9-c9d0-4f25-8934-f7f10a46f558 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:38:24 user nova-compute[73091]: WARNING nova.compute.manager [req-ee01b0a2-e430-4d4e-a886-021ddbf9b4d6 req-f29e4c6a-36d9-4ecc-97ca-7ae2e51f6741 service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Received unexpected event network-vif-plugged-c79746b9-c9d0-4f25-8934-f7f10a46f558 for instance with vm_state building and task_state spawning.
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-ee01b0a2-e430-4d4e-a886-021ddbf9b4d6 req-f29e4c6a-36d9-4ecc-97ca-7ae2e51f6741 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received event network-changed-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-ee01b0a2-e430-4d4e-a886-021ddbf9b4d6 req-f29e4c6a-36d9-4ecc-97ca-7ae2e51f6741 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Refreshing instance network info cache due to event network-changed-50f0d7f2-7e34-475a-9d69-145a0e321400. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ee01b0a2-e430-4d4e-a886-021ddbf9b4d6 req-f29e4c6a-36d9-4ecc-97ca-7ae2e51f6741 service nova] Acquiring lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599104.1324263, 93e10fd4-8841-4043-b4e2-7489c4dea3e6 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:38:24 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] VM Resumed (Lifecycle Event)
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:38:24 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Instance spawned successfully.
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:38:24 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599104.137817, 93e10fd4-8841-4043-b4e2-7489c4dea3e6 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:38:24 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] VM Started (Lifecycle Event)
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:38:24 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:38:24 user nova-compute[73091]: INFO nova.compute.manager [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Took 6.71 seconds to spawn the instance on the hypervisor.
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:38:24 user nova-compute[73091]: INFO nova.compute.manager [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Took 7.84 seconds to build instance.
Aug 09 16:38:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ca3c1c0-39dd-4b1f-a4fb-bf6d6d8bd89d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.968s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Updating instance_info_cache with network_info: [{"id": "50f0d7f2-7e34-475a-9d69-145a0e321400", "address": "fa:16:3e:25:e0:ab", "network": {"id": "5868d9d5-2152-496d-93e2-8e1308b2ad18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d65ef533e7c145faae7d9af3815007ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0d7f2-7e", "ovs_interfaceid": "50f0d7f2-7e34-475a-9d69-145a0e321400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Releasing lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Instance network_info: |[{"id": "50f0d7f2-7e34-475a-9d69-145a0e321400", "address": "fa:16:3e:25:e0:ab", "network": {"id": "5868d9d5-2152-496d-93e2-8e1308b2ad18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d65ef533e7c145faae7d9af3815007ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0d7f2-7e", "ovs_interfaceid": "50f0d7f2-7e34-475a-9d69-145a0e321400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ee01b0a2-e430-4d4e-a886-021ddbf9b4d6 req-f29e4c6a-36d9-4ecc-97ca-7ae2e51f6741 service nova] Acquired lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.network.neutron [req-ee01b0a2-e430-4d4e-a886-021ddbf9b4d6 req-f29e4c6a-36d9-4ecc-97ca-7ae2e51f6741 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Refreshing network info cache for port 50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Start _get_guest_xml network_info=[{"id": "50f0d7f2-7e34-475a-9d69-145a0e321400", "address": "fa:16:3e:25:e0:ab", "network": {"id": "5868d9d5-2152-496d-93e2-8e1308b2ad18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d65ef533e7c145faae7d9af3815007ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0d7f2-7e", "ovs_interfaceid": "50f0d7f2-7e34-475a-9d69-145a0e321400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:38:24 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:38:24 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-261726215',display_name='tempest-ServerStableDeviceRescueTest-server-261726215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-261726215',id=17,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDt6bgWOl3OaJeJplczLpq3pEO+nQ0SnhcLURWVFOG9Ust3RYcVv/4I32bnc6u3NQSYIpFhMkkFOddkSUUubBFd//CxBbSxsh9Y6SvTjHrUjqSbV15wPCQRXhXN07VEozQ==',key_name='tempest-keypair-1192423936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d65ef533e7c145faae7d9af3815007ac',ramdisk_id='',reservation_id='r-p601w4u8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-345363851',owner_user_name='tempest-ServerStableDeviceRescueTest-345363851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:38:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fee448a86074a69ac5a45ac5b010069',uuid=38051bca-7190-4dff-91d1-3d99b4e4182b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50f0d7f2-7e34-475a-9d69-145a0e321400", "address": "fa:16:3e:25:e0:ab", "network": {"id": "5868d9d5-2152-496d-93e2-8e1308b2ad18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d65ef533e7c145faae7d9af3815007ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0d7f2-7e", "ovs_interfaceid": "50f0d7f2-7e34-475a-9d69-145a0e321400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Converting VIF {"id": "50f0d7f2-7e34-475a-9d69-145a0e321400", "address": "fa:16:3e:25:e0:ab", "network": {"id": "5868d9d5-2152-496d-93e2-8e1308b2ad18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d65ef533e7c145faae7d9af3815007ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0d7f2-7e", "ovs_interfaceid": "50f0d7f2-7e34-475a-9d69-145a0e321400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:e0:ab,bridge_name='br-int',has_traffic_filtering=True,id=50f0d7f2-7e34-475a-9d69-145a0e321400,network=Network(5868d9d5-2152-496d-93e2-8e1308b2ad18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f0d7f2-7e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.objects.instance [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lazy-loading 'pci_devices' on Instance uuid 38051bca-7190-4dff-91d1-3d99b4e4182b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:38:24 user nova-compute[73091]:   <uuid>38051bca-7190-4dff-91d1-3d99b4e4182b</uuid>
Aug 09 16:38:24 user nova-compute[73091]:   <name>instance-00000011</name>
Aug 09 16:38:24 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:38:24 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:38:24 user nova-compute[73091]:   <metadata>
Aug 09 16:38:24 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:38:24 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:38:24 user nova-compute[73091]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-261726215</nova:name>
Aug 09 16:38:24 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:38:24</nova:creationTime>
Aug 09 16:38:24 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:38:24 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:38:24 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:38:24 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:38:24 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:38:24 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:38:24 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:38:24 user nova-compute[73091]:       <nova:owner>
Aug 09 16:38:24 user nova-compute[73091]:         <nova:user uuid="1fee448a86074a69ac5a45ac5b010069">tempest-ServerStableDeviceRescueTest-345363851-project-member</nova:user>
Aug 09 16:38:24 user nova-compute[73091]:         <nova:project uuid="d65ef533e7c145faae7d9af3815007ac">tempest-ServerStableDeviceRescueTest-345363851</nova:project>
Aug 09 16:38:24 user nova-compute[73091]:       </nova:owner>
Aug 09 16:38:24 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:38:24 user nova-compute[73091]:       <nova:ports>
Aug 09 16:38:24 user nova-compute[73091]:         <nova:port uuid="50f0d7f2-7e34-475a-9d69-145a0e321400">
Aug 09 16:38:24 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 16:38:24 user nova-compute[73091]:         </nova:port>
Aug 09 16:38:24 user nova-compute[73091]:       </nova:ports>
Aug 09 16:38:24 user nova-compute[73091]:     </nova:instance>
Aug 09 16:38:24 user nova-compute[73091]:   </metadata>
Aug 09 16:38:24 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:38:24 user nova-compute[73091]:     <system>
Aug 09 16:38:24 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:38:24 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:38:24 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:38:24 user nova-compute[73091]:       <entry name="serial">38051bca-7190-4dff-91d1-3d99b4e4182b</entry>
Aug 09 16:38:24 user nova-compute[73091]:       <entry name="uuid">38051bca-7190-4dff-91d1-3d99b4e4182b</entry>
Aug 09 16:38:24 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:38:24 user nova-compute[73091]:     </system>
Aug 09 16:38:24 user nova-compute[73091]:   </sysinfo>
Aug 09 16:38:24 user nova-compute[73091]:   <os>
Aug 09 16:38:24 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:38:24 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:38:24 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:38:24 user nova-compute[73091]:   </os>
Aug 09 16:38:24 user nova-compute[73091]:   <features>
Aug 09 16:38:24 user nova-compute[73091]:     <acpi/>
Aug 09 16:38:24 user nova-compute[73091]:     <apic/>
Aug 09 16:38:24 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:38:24 user nova-compute[73091]:   </features>
Aug 09 16:38:24 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:38:24 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:38:24 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:38:24 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:38:24 user nova-compute[73091]:   </clock>
Aug 09 16:38:24 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:38:24 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:38:24 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:38:24 user nova-compute[73091]:   </cpu>
Aug 09 16:38:24 user nova-compute[73091]:   <devices>
Aug 09 16:38:24 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:38:24 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:38:24 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk"/>
Aug 09 16:38:24 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:38:24 user nova-compute[73091]:     </disk>
Aug 09 16:38:24 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:38:24 user nova-compute[73091]:       <mac address="fa:16:3e:25:e0:ab"/>
Aug 09 16:38:24 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:38:24 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:38:24 user nova-compute[73091]:       <target dev="tap50f0d7f2-7e"/>
Aug 09 16:38:24 user nova-compute[73091]:     </interface>
Aug 09 16:38:24 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:38:24 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/console.log" append="off"/>
Aug 09 16:38:24 user nova-compute[73091]:     </serial>
Aug 09 16:38:24 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:38:24 user nova-compute[73091]:     <video>
Aug 09 16:38:24 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:38:24 user nova-compute[73091]:     </video>
Aug 09 16:38:24 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:38:24 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:38:24 user nova-compute[73091]:     </rng>
Aug 09 16:38:24 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:38:24 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:38:24 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:38:24 user nova-compute[73091]:     </memballoon>
Aug 09 16:38:24 user nova-compute[73091]:   </devices>
Aug 09 16:38:24 user nova-compute[73091]: </domain>
Aug 09 16:38:24 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-261726215',display_name='tempest-ServerStableDeviceRescueTest-server-261726215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-261726215',id=17,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDt6bgWOl3OaJeJplczLpq3pEO+nQ0SnhcLURWVFOG9Ust3RYcVv/4I32bnc6u3NQSYIpFhMkkFOddkSUUubBFd//CxBbSxsh9Y6SvTjHrUjqSbV15wPCQRXhXN07VEozQ==',key_name='tempest-keypair-1192423936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d65ef533e7c145faae7d9af3815007ac',ramdisk_id='',reservation_id='r-p601w4u8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-345363851',owner_user_name='tempest-ServerStableDeviceRescueTest-345363851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:38:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fee448a86074a69ac5a45ac5b010069',uuid=38051bca-7190-4dff-91d1-3d99b4e4182b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50f0d7f2-7e34-475a-9d69-145a0e321400", "address": "fa:16:3e:25:e0:ab", "network": {"id": "5868d9d5-2152-496d-93e2-8e1308b2ad18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d65ef533e7c145faae7d9af3815007ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0d7f2-7e", "ovs_interfaceid": "50f0d7f2-7e34-475a-9d69-145a0e321400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Converting VIF {"id": "50f0d7f2-7e34-475a-9d69-145a0e321400", "address": "fa:16:3e:25:e0:ab", "network": {"id": "5868d9d5-2152-496d-93e2-8e1308b2ad18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d65ef533e7c145faae7d9af3815007ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0d7f2-7e", "ovs_interfaceid": "50f0d7f2-7e34-475a-9d69-145a0e321400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:e0:ab,bridge_name='br-int',has_traffic_filtering=True,id=50f0d7f2-7e34-475a-9d69-145a0e321400,network=Network(5868d9d5-2152-496d-93e2-8e1308b2ad18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f0d7f2-7e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG os_vif [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:e0:ab,bridge_name='br-int',has_traffic_filtering=True,id=50f0d7f2-7e34-475a-9d69-145a0e321400,network=Network(5868d9d5-2152-496d-93e2-8e1308b2ad18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f0d7f2-7e') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50f0d7f2-7e, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap50f0d7f2-7e, col_values=(('external_ids', {'iface-id': '50f0d7f2-7e34-475a-9d69-145a0e321400', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:e0:ab', 'vm-uuid': '38051bca-7190-4dff-91d1-3d99b4e4182b'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:24 user nova-compute[73091]: INFO os_vif [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:e0:ab,bridge_name='br-int',has_traffic_filtering=True,id=50f0d7f2-7e34-475a-9d69-145a0e321400,network=Network(5868d9d5-2152-496d-93e2-8e1308b2ad18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f0d7f2-7e')
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:38:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] No VIF found with MAC fa:16:3e:25:e0:ab, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:38:25 user nova-compute[73091]: DEBUG nova.network.neutron [req-ee01b0a2-e430-4d4e-a886-021ddbf9b4d6 req-f29e4c6a-36d9-4ecc-97ca-7ae2e51f6741 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Updated VIF entry in instance network info cache for port 50f0d7f2-7e34-475a-9d69-145a0e321400. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:38:25 user nova-compute[73091]: DEBUG nova.network.neutron [req-ee01b0a2-e430-4d4e-a886-021ddbf9b4d6 req-f29e4c6a-36d9-4ecc-97ca-7ae2e51f6741 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Updating instance_info_cache with network_info: [{"id": "50f0d7f2-7e34-475a-9d69-145a0e321400", "address": "fa:16:3e:25:e0:ab", "network": {"id": "5868d9d5-2152-496d-93e2-8e1308b2ad18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d65ef533e7c145faae7d9af3815007ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0d7f2-7e", "ovs_interfaceid": "50f0d7f2-7e34-475a-9d69-145a0e321400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:38:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ee01b0a2-e430-4d4e-a886-021ddbf9b4d6 req-f29e4c6a-36d9-4ecc-97ca-7ae2e51f6741 service nova] Releasing lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:38:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-15afb302-b719-44ca-9ce8-a5efecdde43f req-6fd3a1af-89ec-42b2-8672-6231f07626e2 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received event network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:38:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15afb302-b719-44ca-9ce8-a5efecdde43f req-6fd3a1af-89ec-42b2-8672-6231f07626e2 service nova] Acquiring lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15afb302-b719-44ca-9ce8-a5efecdde43f req-6fd3a1af-89ec-42b2-8672-6231f07626e2 service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15afb302-b719-44ca-9ce8-a5efecdde43f req-6fd3a1af-89ec-42b2-8672-6231f07626e2 service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-15afb302-b719-44ca-9ce8-a5efecdde43f req-6fd3a1af-89ec-42b2-8672-6231f07626e2 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] No waiting events found dispatching network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:38:26 user nova-compute[73091]: WARNING nova.compute.manager [req-15afb302-b719-44ca-9ce8-a5efecdde43f req-6fd3a1af-89ec-42b2-8672-6231f07626e2 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received unexpected event network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 for instance with vm_state building and task_state spawning.
Aug 09 16:38:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-e0ae3ad0-2f7d-48d0-96ae-56b4ef2dfac0 req-c715eddc-6ada-4487-8ffe-cfc11f0c3455 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received event network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:38:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e0ae3ad0-2f7d-48d0-96ae-56b4ef2dfac0 req-c715eddc-6ada-4487-8ffe-cfc11f0c3455 service nova] Acquiring lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e0ae3ad0-2f7d-48d0-96ae-56b4ef2dfac0 req-c715eddc-6ada-4487-8ffe-cfc11f0c3455 service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e0ae3ad0-2f7d-48d0-96ae-56b4ef2dfac0 req-c715eddc-6ada-4487-8ffe-cfc11f0c3455 service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-e0ae3ad0-2f7d-48d0-96ae-56b4ef2dfac0 req-c715eddc-6ada-4487-8ffe-cfc11f0c3455 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] No waiting events found dispatching network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:38:28 user nova-compute[73091]: WARNING nova.compute.manager [req-e0ae3ad0-2f7d-48d0-96ae-56b4ef2dfac0 req-c715eddc-6ada-4487-8ffe-cfc11f0c3455 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received unexpected event network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 for instance with vm_state building and task_state spawning.
Aug 09 16:38:28 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599108.9233303, 38051bca-7190-4dff-91d1-3d99b4e4182b => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:38:28 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] VM Resumed (Lifecycle Event)
Aug 09 16:38:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:38:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:38:28 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Instance spawned successfully.
Aug 09 16:38:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:38:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:38:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:38:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:38:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:38:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:38:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:38:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:38:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:38:28 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:38:28 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599108.9266949, 38051bca-7190-4dff-91d1-3d99b4e4182b => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:38:28 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] VM Started (Lifecycle Event)
Aug 09 16:38:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:38:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:38:29 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:38:29 user nova-compute[73091]: INFO nova.compute.manager [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Took 7.11 seconds to spawn the instance on the hypervisor.
Aug 09 16:38:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:38:29 user nova-compute[73091]: INFO nova.compute.manager [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Took 8.18 seconds to build instance.
Aug 09 16:38:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d058d60-43eb-4ccf-8842-b233b1df2298 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.289s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-6da5a79b-65f8-495f-895f-ce7bfe730958 req-4ee6eeeb-2415-414b-9ee4-e1118a8937b5 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Received event network-changed-54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:38:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-6da5a79b-65f8-495f-895f-ce7bfe730958 req-4ee6eeeb-2415-414b-9ee4-e1118a8937b5 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Refreshing instance network info cache due to event network-changed-54c1bb8c-584f-446c-9b64-c840c486a4f1. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:38:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6da5a79b-65f8-495f-895f-ce7bfe730958 req-4ee6eeeb-2415-414b-9ee4-e1118a8937b5 service nova] Acquiring lock "refresh_cache-18d8e887-0f91-42e1-ba79-13db5aa9b84b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:38:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6da5a79b-65f8-495f-895f-ce7bfe730958 req-4ee6eeeb-2415-414b-9ee4-e1118a8937b5 service nova] Acquired lock "refresh_cache-18d8e887-0f91-42e1-ba79-13db5aa9b84b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:38:32 user nova-compute[73091]: DEBUG nova.network.neutron [req-6da5a79b-65f8-495f-895f-ce7bfe730958 req-4ee6eeeb-2415-414b-9ee4-e1118a8937b5 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Refreshing network info cache for port 54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:38:33 user nova-compute[73091]: DEBUG nova.network.neutron [req-6da5a79b-65f8-495f-895f-ce7bfe730958 req-4ee6eeeb-2415-414b-9ee4-e1118a8937b5 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Updated VIF entry in instance network info cache for port 54c1bb8c-584f-446c-9b64-c840c486a4f1. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:38:33 user nova-compute[73091]: DEBUG nova.network.neutron [req-6da5a79b-65f8-495f-895f-ce7bfe730958 req-4ee6eeeb-2415-414b-9ee4-e1118a8937b5 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Updating instance_info_cache with network_info: [{"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:38:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6da5a79b-65f8-495f-895f-ce7bfe730958 req-4ee6eeeb-2415-414b-9ee4-e1118a8937b5 service nova] Releasing lock "refresh_cache-18d8e887-0f91-42e1-ba79-13db5aa9b84b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:38:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Acquiring lock "37428447-3a47-4598-aa09-ee4019e0f193" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "37428447-3a47-4598-aa09-ee4019e0f193" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:38:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:38:52 user nova-compute[73091]: INFO nova.compute.claims [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Claim successful on node user
Aug 09 16:38:53 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:38:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:38:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG nova.policy [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54214e99474245ff8c66816e1a103260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c24350e3214cfe89b2a4e2f1298121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:38:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Creating image(s)
Aug 09 16:38:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Acquiring lock "/opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "/opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "/opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.194s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.147s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193/disk 1073741824" returned: 0 in 0.057s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:54 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:38:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:54 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Cannot resize image /opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:38:54 user nova-compute[73091]: DEBUG nova.objects.instance [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lazy-loading 'migration_context' on Instance uuid 37428447-3a47-4598-aa09-ee4019e0f193 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:38:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:38:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Ensure instance console log exists: /opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:38:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Successfully created port: 9d24e3ae-7181-4507-a0ba-43657ee1ff71 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:38:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:38:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 16:38:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "f939fe27-017a-481e-babc-147bf98e0132" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "f939fe27-017a-481e-babc-147bf98e0132" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:38:55 user nova-compute[73091]: INFO nova.compute.claims [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Claim successful on node user
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Successfully updated port: 9d24e3ae-7181-4507-a0ba-43657ee1ff71 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Acquiring lock "refresh_cache-37428447-3a47-4598-aa09-ee4019e0f193" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Acquired lock "refresh_cache-37428447-3a47-4598-aa09-ee4019e0f193" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-a9a998dc-56c4-444c-9ec7-3c6b586d4e70 req-0278c6b7-fb78-44a7-9cf5-f128ce3b4bef service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Received event network-changed-9d24e3ae-7181-4507-a0ba-43657ee1ff71 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-a9a998dc-56c4-444c-9ec7-3c6b586d4e70 req-0278c6b7-fb78-44a7-9cf5-f128ce3b4bef service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Refreshing instance network info cache due to event network-changed-9d24e3ae-7181-4507-a0ba-43657ee1ff71. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9a998dc-56c4-444c-9ec7-3c6b586d4e70 req-0278c6b7-fb78-44a7-9cf5-f128ce3b4bef service nova] Acquiring lock "refresh_cache-37428447-3a47-4598-aa09-ee4019e0f193" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:38:55 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.policy [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef7727ab5d1b46d383bfc02750d29ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a03dd6b23c840c7b4a07f0235c1051b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Updating instance_info_cache with network_info: [{"id": "9d24e3ae-7181-4507-a0ba-43657ee1ff71", "address": "fa:16:3e:aa:26:57", "network": {"id": "5bae1654-cc49-420b-ab90-299d2f87c8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-433837263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c24350e3214cfe89b2a4e2f1298121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e3ae-71", "ovs_interfaceid": "9d24e3ae-7181-4507-a0ba-43657ee1ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Releasing lock "refresh_cache-37428447-3a47-4598-aa09-ee4019e0f193" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Instance network_info: |[{"id": "9d24e3ae-7181-4507-a0ba-43657ee1ff71", "address": "fa:16:3e:aa:26:57", "network": {"id": "5bae1654-cc49-420b-ab90-299d2f87c8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-433837263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c24350e3214cfe89b2a4e2f1298121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e3ae-71", "ovs_interfaceid": "9d24e3ae-7181-4507-a0ba-43657ee1ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9a998dc-56c4-444c-9ec7-3c6b586d4e70 req-0278c6b7-fb78-44a7-9cf5-f128ce3b4bef service nova] Acquired lock "refresh_cache-37428447-3a47-4598-aa09-ee4019e0f193" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-a9a998dc-56c4-444c-9ec7-3c6b586d4e70 req-0278c6b7-fb78-44a7-9cf5-f128ce3b4bef service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Refreshing network info cache for port 9d24e3ae-7181-4507-a0ba-43657ee1ff71 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Start _get_guest_xml network_info=[{"id": "9d24e3ae-7181-4507-a0ba-43657ee1ff71", "address": "fa:16:3e:aa:26:57", "network": {"id": "5bae1654-cc49-420b-ab90-299d2f87c8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-433837263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c24350e3214cfe89b2a4e2f1298121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e3ae-71", "ovs_interfaceid": "9d24e3ae-7181-4507-a0ba-43657ee1ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:38:55 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:38:55 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1547715163',display_name='tempest-VolumesActionsTest-instance-1547715163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1547715163',id=18,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4c24350e3214cfe89b2a4e2f1298121',ramdisk_id='',reservation_id='r-dgluis1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1284523061',owner_user_name='tempest-VolumesActionsTest-1284523061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:38:53Z,user_data=None,user_id='54214e99474245ff8c66816e1a103260',uuid=37428447-3a47-4598-aa09-ee4019e0f193,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d24e3ae-7181-4507-a0ba-43657ee1ff71", "address": "fa:16:3e:aa:26:57", "network": {"id": "5bae1654-cc49-420b-ab90-299d2f87c8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-433837263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c24350e3214cfe89b2a4e2f1298121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e3ae-71", "ovs_interfaceid": "9d24e3ae-7181-4507-a0ba-43657ee1ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Converting VIF {"id": "9d24e3ae-7181-4507-a0ba-43657ee1ff71", "address": "fa:16:3e:aa:26:57", "network": {"id": "5bae1654-cc49-420b-ab90-299d2f87c8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-433837263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c24350e3214cfe89b2a4e2f1298121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e3ae-71", "ovs_interfaceid": "9d24e3ae-7181-4507-a0ba-43657ee1ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:26:57,bridge_name='br-int',has_traffic_filtering=True,id=9d24e3ae-7181-4507-a0ba-43657ee1ff71,network=Network(5bae1654-cc49-420b-ab90-299d2f87c8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d24e3ae-71') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.objects.instance [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lazy-loading 'pci_devices' on Instance uuid 37428447-3a47-4598-aa09-ee4019e0f193 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:38:55 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Creating image(s)
Aug 09 16:38:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "/opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "/opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "/opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:38:55 user nova-compute[73091]:   <uuid>37428447-3a47-4598-aa09-ee4019e0f193</uuid>
Aug 09 16:38:55 user nova-compute[73091]:   <name>instance-00000012</name>
Aug 09 16:38:55 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:38:55 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:38:55 user nova-compute[73091]:   <metadata>
Aug 09 16:38:55 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:38:55 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:38:55 user nova-compute[73091]:       <nova:name>tempest-VolumesActionsTest-instance-1547715163</nova:name>
Aug 09 16:38:55 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:38:55</nova:creationTime>
Aug 09 16:38:55 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:38:55 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:38:55 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:38:55 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:38:55 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:38:55 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:38:55 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:38:55 user nova-compute[73091]:       <nova:owner>
Aug 09 16:38:55 user nova-compute[73091]:         <nova:user uuid="54214e99474245ff8c66816e1a103260">tempest-VolumesActionsTest-1284523061-project-member</nova:user>
Aug 09 16:38:55 user nova-compute[73091]:         <nova:project uuid="b4c24350e3214cfe89b2a4e2f1298121">tempest-VolumesActionsTest-1284523061</nova:project>
Aug 09 16:38:55 user nova-compute[73091]:       </nova:owner>
Aug 09 16:38:55 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:38:55 user nova-compute[73091]:       <nova:ports>
Aug 09 16:38:55 user nova-compute[73091]:         <nova:port uuid="9d24e3ae-7181-4507-a0ba-43657ee1ff71">
Aug 09 16:38:55 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 16:38:55 user nova-compute[73091]:         </nova:port>
Aug 09 16:38:55 user nova-compute[73091]:       </nova:ports>
Aug 09 16:38:55 user nova-compute[73091]:     </nova:instance>
Aug 09 16:38:55 user nova-compute[73091]:   </metadata>
Aug 09 16:38:55 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:38:55 user nova-compute[73091]:     <system>
Aug 09 16:38:55 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:38:55 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:38:55 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:38:55 user nova-compute[73091]:       <entry name="serial">37428447-3a47-4598-aa09-ee4019e0f193</entry>
Aug 09 16:38:55 user nova-compute[73091]:       <entry name="uuid">37428447-3a47-4598-aa09-ee4019e0f193</entry>
Aug 09 16:38:55 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:38:55 user nova-compute[73091]:     </system>
Aug 09 16:38:55 user nova-compute[73091]:   </sysinfo>
Aug 09 16:38:55 user nova-compute[73091]:   <os>
Aug 09 16:38:55 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:38:55 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:38:55 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:38:55 user nova-compute[73091]:   </os>
Aug 09 16:38:55 user nova-compute[73091]:   <features>
Aug 09 16:38:55 user nova-compute[73091]:     <acpi/>
Aug 09 16:38:55 user nova-compute[73091]:     <apic/>
Aug 09 16:38:55 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:38:55 user nova-compute[73091]:   </features>
Aug 09 16:38:55 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:38:55 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:38:55 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:38:55 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:38:55 user nova-compute[73091]:   </clock>
Aug 09 16:38:55 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:38:55 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:38:55 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:38:55 user nova-compute[73091]:   </cpu>
Aug 09 16:38:55 user nova-compute[73091]:   <devices>
Aug 09 16:38:55 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:38:55 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:38:55 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193/disk"/>
Aug 09 16:38:55 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:38:55 user nova-compute[73091]:     </disk>
Aug 09 16:38:55 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:38:55 user nova-compute[73091]:       <mac address="fa:16:3e:aa:26:57"/>
Aug 09 16:38:55 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:38:55 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:38:55 user nova-compute[73091]:       <target dev="tap9d24e3ae-71"/>
Aug 09 16:38:55 user nova-compute[73091]:     </interface>
Aug 09 16:38:55 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:38:55 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193/console.log" append="off"/>
Aug 09 16:38:55 user nova-compute[73091]:     </serial>
Aug 09 16:38:55 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:38:55 user nova-compute[73091]:     <video>
Aug 09 16:38:55 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:38:55 user nova-compute[73091]:     </video>
Aug 09 16:38:55 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:38:55 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:38:55 user nova-compute[73091]:     </rng>
Aug 09 16:38:55 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:38:55 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:38:55 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:38:55 user nova-compute[73091]:     </memballoon>
Aug 09 16:38:55 user nova-compute[73091]:   </devices>
Aug 09 16:38:55 user nova-compute[73091]: </domain>
Aug 09 16:38:55 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1547715163',display_name='tempest-VolumesActionsTest-instance-1547715163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1547715163',id=18,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4c24350e3214cfe89b2a4e2f1298121',ramdisk_id='',reservation_id='r-dgluis1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1284523061',owner_user_name='tempest-VolumesActionsTest-1284523061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:38:53Z,user_data=None,user_id='54214e99474245ff8c66816e1a103260',uuid=37428447-3a47-4598-aa09-ee4019e0f193,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d24e3ae-7181-4507-a0ba-43657ee1ff71", "address": "fa:16:3e:aa:26:57", "network": {"id": "5bae1654-cc49-420b-ab90-299d2f87c8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-433837263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c24350e3214cfe89b2a4e2f1298121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e3ae-71", "ovs_interfaceid": "9d24e3ae-7181-4507-a0ba-43657ee1ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Converting VIF {"id": "9d24e3ae-7181-4507-a0ba-43657ee1ff71", "address": "fa:16:3e:aa:26:57", "network": {"id": "5bae1654-cc49-420b-ab90-299d2f87c8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-433837263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c24350e3214cfe89b2a4e2f1298121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e3ae-71", "ovs_interfaceid": "9d24e3ae-7181-4507-a0ba-43657ee1ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:26:57,bridge_name='br-int',has_traffic_filtering=True,id=9d24e3ae-7181-4507-a0ba-43657ee1ff71,network=Network(5bae1654-cc49-420b-ab90-299d2f87c8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d24e3ae-71') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG os_vif [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:26:57,bridge_name='br-int',has_traffic_filtering=True,id=9d24e3ae-7181-4507-a0ba-43657ee1ff71,network=Network(5bae1654-cc49-420b-ab90-299d2f87c8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d24e3ae-71') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d24e3ae-71, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:38:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9d24e3ae-71, col_values=(('external_ids', {'iface-id': '9d24e3ae-7181-4507-a0ba-43657ee1ff71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:26:57', 'vm-uuid': '37428447-3a47-4598-aa09-ee4019e0f193'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:56 user nova-compute[73091]: INFO os_vif [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:26:57,bridge_name='br-int',has_traffic_filtering=True,id=9d24e3ae-7181-4507-a0ba-43657ee1ff71,network=Network(5bae1654-cc49-420b-ab90-299d2f87c8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d24e3ae-71')
Aug 09 16:38:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] No VIF found with MAC fa:16:3e:aa:26:57, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.200s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.150s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk 1073741824" returned: 0 in 0.070s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG nova.network.neutron [req-a9a998dc-56c4-444c-9ec7-3c6b586d4e70 req-0278c6b7-fb78-44a7-9cf5-f128ce3b4bef service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Updated VIF entry in instance network info cache for port 9d24e3ae-7181-4507-a0ba-43657ee1ff71. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG nova.network.neutron [req-a9a998dc-56c4-444c-9ec7-3c6b586d4e70 req-0278c6b7-fb78-44a7-9cf5-f128ce3b4bef service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Updating instance_info_cache with network_info: [{"id": "9d24e3ae-7181-4507-a0ba-43657ee1ff71", "address": "fa:16:3e:aa:26:57", "network": {"id": "5bae1654-cc49-420b-ab90-299d2f87c8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-433837263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c24350e3214cfe89b2a4e2f1298121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e3ae-71", "ovs_interfaceid": "9d24e3ae-7181-4507-a0ba-43657ee1ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Successfully created port: c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9a998dc-56c4-444c-9ec7-3c6b586d4e70 req-0278c6b7-fb78-44a7-9cf5-f128ce3b4bef service nova] Releasing lock "refresh_cache-37428447-3a47-4598-aa09-ee4019e0f193" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:38:56 user nova-compute[73091]: INFO nova.compute.claims [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Claim successful on node user
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Cannot resize image /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'migration_context' on Instance uuid f939fe27-017a-481e-babc-147bf98e0132 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Ensure instance console log exists: /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG nova.network.neutron [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:38:57 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:38:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG nova.policy [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef7727ab5d1b46d383bfc02750d29ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a03dd6b23c840c7b4a07f0235c1051b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:38:57 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Creating image(s)
Aug 09 16:38:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "/opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "/opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Successfully updated port: c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "refresh_cache-f939fe27-017a-481e-babc-147bf98e0132" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquired lock "refresh_cache-f939fe27-017a-481e-babc-147bf98e0132" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-70c5e567-284b-45db-8214-578d90a9a2ab req-9d7818fc-e30d-4992-8719-1b3f9a87e7ff service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received event network-changed-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-70c5e567-284b-45db-8214-578d90a9a2ab req-9d7818fc-e30d-4992-8719-1b3f9a87e7ff service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Refreshing instance network info cache due to event network-changed-c830ef2e-da54-4321-905f-845e0440a759. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-70c5e567-284b-45db-8214-578d90a9a2ab req-9d7818fc-e30d-4992-8719-1b3f9a87e7ff service nova] Acquiring lock "refresh_cache-f939fe27-017a-481e-babc-147bf98e0132" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.133s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk 1073741824" returned: 0 in 0.051s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.296s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:38:57 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Updating instance_info_cache with network_info: [{"id": "c830ef2e-da54-4321-905f-845e0440a759", "address": "fa:16:3e:b5:68:3c", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc830ef2e-da", "ovs_interfaceid": "c830ef2e-da54-4321-905f-845e0440a759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Releasing lock "refresh_cache-f939fe27-017a-481e-babc-147bf98e0132" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Instance network_info: |[{"id": "c830ef2e-da54-4321-905f-845e0440a759", "address": "fa:16:3e:b5:68:3c", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc830ef2e-da", "ovs_interfaceid": "c830ef2e-da54-4321-905f-845e0440a759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-70c5e567-284b-45db-8214-578d90a9a2ab req-9d7818fc-e30d-4992-8719-1b3f9a87e7ff service nova] Acquired lock "refresh_cache-f939fe27-017a-481e-babc-147bf98e0132" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.network.neutron [req-70c5e567-284b-45db-8214-578d90a9a2ab req-9d7818fc-e30d-4992-8719-1b3f9a87e7ff service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Refreshing network info cache for port c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Start _get_guest_xml network_info=[{"id": "c830ef2e-da54-4321-905f-845e0440a759", "address": "fa:16:3e:b5:68:3c", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc830ef2e-da", "ovs_interfaceid": "c830ef2e-da54-4321-905f-845e0440a759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Cannot resize image /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.objects.instance [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'migration_context' on Instance uuid 8fc884a8-24bb-488a-baeb-ef2b1faf239d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:38:58 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:38:58 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Ensure instance console log exists: /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1580969082',display_name='tempest-ServerRescueNegativeTestJSON-server-1580969082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1580969082',id=19,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a03dd6b23c840c7b4a07f0235c1051b',ramdisk_id='',reservation_id='r-5cttsoe9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-596687024',owner_user_name='tempest-ServerRescueNegativeTestJSON-596687024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:38:56Z,user_data=None,user_id='ef7727ab5d1b46d383bfc02750d29ec7',uuid=f939fe27-017a-481e-babc-147bf98e0132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c830ef2e-da54-4321-905f-845e0440a759", "address": "fa:16:3e:b5:68:3c", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc830ef2e-da", "ovs_interfaceid": "c830ef2e-da54-4321-905f-845e0440a759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converting VIF {"id": "c830ef2e-da54-4321-905f-845e0440a759", "address": "fa:16:3e:b5:68:3c", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc830ef2e-da", "ovs_interfaceid": "c830ef2e-da54-4321-905f-845e0440a759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:68:3c,bridge_name='br-int',has_traffic_filtering=True,id=c830ef2e-da54-4321-905f-845e0440a759,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc830ef2e-da') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'pci_devices' on Instance uuid f939fe27-017a-481e-babc-147bf98e0132 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:38:58 user nova-compute[73091]:   <uuid>f939fe27-017a-481e-babc-147bf98e0132</uuid>
Aug 09 16:38:58 user nova-compute[73091]:   <name>instance-00000013</name>
Aug 09 16:38:58 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:38:58 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:38:58 user nova-compute[73091]:   <metadata>
Aug 09 16:38:58 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:38:58 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:38:58 user nova-compute[73091]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1580969082</nova:name>
Aug 09 16:38:58 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:38:58</nova:creationTime>
Aug 09 16:38:58 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:38:58 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:38:58 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:38:58 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:38:58 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:38:58 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:38:58 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:38:58 user nova-compute[73091]:       <nova:owner>
Aug 09 16:38:58 user nova-compute[73091]:         <nova:user uuid="ef7727ab5d1b46d383bfc02750d29ec7">tempest-ServerRescueNegativeTestJSON-596687024-project-member</nova:user>
Aug 09 16:38:58 user nova-compute[73091]:         <nova:project uuid="1a03dd6b23c840c7b4a07f0235c1051b">tempest-ServerRescueNegativeTestJSON-596687024</nova:project>
Aug 09 16:38:58 user nova-compute[73091]:       </nova:owner>
Aug 09 16:38:58 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:38:58 user nova-compute[73091]:       <nova:ports>
Aug 09 16:38:58 user nova-compute[73091]:         <nova:port uuid="c830ef2e-da54-4321-905f-845e0440a759">
Aug 09 16:38:58 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 16:38:58 user nova-compute[73091]:         </nova:port>
Aug 09 16:38:58 user nova-compute[73091]:       </nova:ports>
Aug 09 16:38:58 user nova-compute[73091]:     </nova:instance>
Aug 09 16:38:58 user nova-compute[73091]:   </metadata>
Aug 09 16:38:58 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:38:58 user nova-compute[73091]:     <system>
Aug 09 16:38:58 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:38:58 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:38:58 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:38:58 user nova-compute[73091]:       <entry name="serial">f939fe27-017a-481e-babc-147bf98e0132</entry>
Aug 09 16:38:58 user nova-compute[73091]:       <entry name="uuid">f939fe27-017a-481e-babc-147bf98e0132</entry>
Aug 09 16:38:58 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:38:58 user nova-compute[73091]:     </system>
Aug 09 16:38:58 user nova-compute[73091]:   </sysinfo>
Aug 09 16:38:58 user nova-compute[73091]:   <os>
Aug 09 16:38:58 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:38:58 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:38:58 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:38:58 user nova-compute[73091]:   </os>
Aug 09 16:38:58 user nova-compute[73091]:   <features>
Aug 09 16:38:58 user nova-compute[73091]:     <acpi/>
Aug 09 16:38:58 user nova-compute[73091]:     <apic/>
Aug 09 16:38:58 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:38:58 user nova-compute[73091]:   </features>
Aug 09 16:38:58 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:38:58 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:38:58 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:38:58 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:38:58 user nova-compute[73091]:   </clock>
Aug 09 16:38:58 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:38:58 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:38:58 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:38:58 user nova-compute[73091]:   </cpu>
Aug 09 16:38:58 user nova-compute[73091]:   <devices>
Aug 09 16:38:58 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:38:58 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:38:58 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk"/>
Aug 09 16:38:58 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:38:58 user nova-compute[73091]:     </disk>
Aug 09 16:38:58 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:38:58 user nova-compute[73091]:       <mac address="fa:16:3e:b5:68:3c"/>
Aug 09 16:38:58 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:38:58 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:38:58 user nova-compute[73091]:       <target dev="tapc830ef2e-da"/>
Aug 09 16:38:58 user nova-compute[73091]:     </interface>
Aug 09 16:38:58 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:38:58 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/console.log" append="off"/>
Aug 09 16:38:58 user nova-compute[73091]:     </serial>
Aug 09 16:38:58 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:38:58 user nova-compute[73091]:     <video>
Aug 09 16:38:58 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:38:58 user nova-compute[73091]:     </video>
Aug 09 16:38:58 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:38:58 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:38:58 user nova-compute[73091]:     </rng>
Aug 09 16:38:58 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:38:58 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:38:58 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:38:58 user nova-compute[73091]:     </memballoon>
Aug 09 16:38:58 user nova-compute[73091]:   </devices>
Aug 09 16:38:58 user nova-compute[73091]: </domain>
Aug 09 16:38:58 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1580969082',display_name='tempest-ServerRescueNegativeTestJSON-server-1580969082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1580969082',id=19,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a03dd6b23c840c7b4a07f0235c1051b',ramdisk_id='',reservation_id='r-5cttsoe9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-596687024',owner_user_name='tempest-ServerRescueNegativeTestJSON-596687024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:38:56Z,user_data=None,user_id='ef7727ab5d1b46d383bfc02750d29ec7',uuid=f939fe27-017a-481e-babc-147bf98e0132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c830ef2e-da54-4321-905f-845e0440a759", "address": "fa:16:3e:b5:68:3c", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc830ef2e-da", "ovs_interfaceid": "c830ef2e-da54-4321-905f-845e0440a759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converting VIF {"id": "c830ef2e-da54-4321-905f-845e0440a759", "address": "fa:16:3e:b5:68:3c", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc830ef2e-da", "ovs_interfaceid": "c830ef2e-da54-4321-905f-845e0440a759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:68:3c,bridge_name='br-int',has_traffic_filtering=True,id=c830ef2e-da54-4321-905f-845e0440a759,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc830ef2e-da') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG os_vif [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:68:3c,bridge_name='br-int',has_traffic_filtering=True,id=c830ef2e-da54-4321-905f-845e0440a759,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc830ef2e-da') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc830ef2e-da, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc830ef2e-da, col_values=(('external_ids', {'iface-id': 'c830ef2e-da54-4321-905f-845e0440a759', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:68:3c', 'vm-uuid': 'f939fe27-017a-481e-babc-147bf98e0132'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:58 user nova-compute[73091]: INFO os_vif [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:68:3c,bridge_name='br-int',has_traffic_filtering=True,id=c830ef2e-da54-4321-905f-845e0440a759,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc830ef2e-da')
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] No VIF found with MAC fa:16:3e:b5:68:3c, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.network.neutron [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Successfully created port: 38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.network.neutron [req-70c5e567-284b-45db-8214-578d90a9a2ab req-9d7818fc-e30d-4992-8719-1b3f9a87e7ff service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Updated VIF entry in instance network info cache for port c830ef2e-da54-4321-905f-845e0440a759. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.network.neutron [req-70c5e567-284b-45db-8214-578d90a9a2ab req-9d7818fc-e30d-4992-8719-1b3f9a87e7ff service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Updating instance_info_cache with network_info: [{"id": "c830ef2e-da54-4321-905f-845e0440a759", "address": "fa:16:3e:b5:68:3c", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc830ef2e-da", "ovs_interfaceid": "c830ef2e-da54-4321-905f-845e0440a759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-ad25abb3-f879-41dc-b117-015b3e205a46 req-38acc1f8-524f-48ea-8d91-4d3ba47040a7 service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Received event network-vif-plugged-9d24e3ae-7181-4507-a0ba-43657ee1ff71 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ad25abb3-f879-41dc-b117-015b3e205a46 req-38acc1f8-524f-48ea-8d91-4d3ba47040a7 service nova] Acquiring lock "37428447-3a47-4598-aa09-ee4019e0f193-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ad25abb3-f879-41dc-b117-015b3e205a46 req-38acc1f8-524f-48ea-8d91-4d3ba47040a7 service nova] Lock "37428447-3a47-4598-aa09-ee4019e0f193-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ad25abb3-f879-41dc-b117-015b3e205a46 req-38acc1f8-524f-48ea-8d91-4d3ba47040a7 service nova] Lock "37428447-3a47-4598-aa09-ee4019e0f193-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-ad25abb3-f879-41dc-b117-015b3e205a46 req-38acc1f8-524f-48ea-8d91-4d3ba47040a7 service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] No waiting events found dispatching network-vif-plugged-9d24e3ae-7181-4507-a0ba-43657ee1ff71 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:38:58 user nova-compute[73091]: WARNING nova.compute.manager [req-ad25abb3-f879-41dc-b117-015b3e205a46 req-38acc1f8-524f-48ea-8d91-4d3ba47040a7 service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Received unexpected event network-vif-plugged-9d24e3ae-7181-4507-a0ba-43657ee1ff71 for instance with vm_state building and task_state spawning.
Aug 09 16:38:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-70c5e567-284b-45db-8214-578d90a9a2ab req-9d7818fc-e30d-4992-8719-1b3f9a87e7ff service nova] Releasing lock "refresh_cache-f939fe27-017a-481e-babc-147bf98e0132" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:38:58 user nova-compute[73091]: INFO nova.compute.manager [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Detaching volume 08a95280-01c7-4844-b6a9-ae5a8748583f
Aug 09 16:38:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:58 user nova-compute[73091]: INFO nova.virt.block_device [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Attempting to driver detach volume 08a95280-01c7-4844-b6a9-ae5a8748583f from mountpoint /dev/vdc
Aug 09 16:38:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Attempting to detach device vdc from instance f3e2ea27-5fa4-4437-83d0-2eeda59506a9 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:38:58 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:38:58 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 16:38:58 user nova-compute[73091]:   <target dev="vdc" bus="virtio"/>
Aug 09 16:38:58 user nova-compute[73091]:   <serial>08a95280-01c7-4844-b6a9-ae5a8748583f</serial>
Aug 09 16:38:58 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 16:38:58 user nova-compute[73091]: </disk>
Aug 09 16:38:58 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Successfully detached device vdc from instance f3e2ea27-5fa4-4437-83d0-2eeda59506a9 from the persistent domain config.
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f3e2ea27-5fa4-4437-83d0-2eeda59506a9 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:38:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:38:58 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:38:58 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 16:38:58 user nova-compute[73091]:   <target dev="vdc" bus="virtio"/>
Aug 09 16:38:58 user nova-compute[73091]:   <serial>08a95280-01c7-4844-b6a9-ae5a8748583f</serial>
Aug 09 16:38:58 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 16:38:58 user nova-compute[73091]: </disk>
Aug 09 16:38:58 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691599139.5029814, f3e2ea27-5fa4-4437-83d0-2eeda59506a9 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f3e2ea27-5fa4-4437-83d0-2eeda59506a9 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:38:59 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Successfully detached device vdc from instance f3e2ea27-5fa4-4437-83d0-2eeda59506a9 from the live domain config.
Aug 09 16:38:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbXBOVwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:38:59 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:38:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c4973b-2542-46b1-ab11-a51b72888f1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6be180-3918-4143-8e7f-a774d5b10ff3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f (non-flash)
Aug 09 16:38:59 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:38:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f (non-flash)
Aug 09 16:38:59 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:38:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff08025a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bff867-7d7d-40e7-b182-39ddfd4200ce]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[facaf7af-020a-4e22-9b92-e4a9b2d68e4a]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG nova.network.neutron [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Successfully updated port: 38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e51a20-f54c-46ba-aa3a-bd879503e619]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "refresh_cache-8fc884a8-24bb-488a-baeb-ef2b1faf239d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquired lock "refresh_cache-8fc884a8-24bb-488a-baeb-ef2b1faf239d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG nova.network.neutron [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG nova.network.neutron [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.115s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63966d7-b74b-4272-8d30-715e0ded20e9]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[049bebe5-07bd-42ee-8b43-3b8daacd76b6]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[460ca859-a66c-4be7-926b-08830aded323]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f, portal: 172.16.0.220,3260]
Aug 09 16:38:59 user nova-compute[73091]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f, portal: 172.16.0.220,3260] successful.
Aug 09 16:38:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a95280-01c7-4844-b6a9-ae5a8748583f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2c823d-94ba-405a-a2ae-fe8232185a43]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] <== disconnect_volume: return (383ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:38:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.network.neutron [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Updating instance_info_cache with network_info: [{"id": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "address": "fa:16:3e:b3:de:fe", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ffdd03-c8", "ovs_interfaceid": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-3136a5a3-bfe6-4cfa-8443-8e5318185a64 req-6260b35a-33d6-4e0a-9d87-6e4bd875212d service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received event network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3136a5a3-bfe6-4cfa-8443-8e5318185a64 req-6260b35a-33d6-4e0a-9d87-6e4bd875212d service nova] Acquiring lock "f939fe27-017a-481e-babc-147bf98e0132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3136a5a3-bfe6-4cfa-8443-8e5318185a64 req-6260b35a-33d6-4e0a-9d87-6e4bd875212d service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3136a5a3-bfe6-4cfa-8443-8e5318185a64 req-6260b35a-33d6-4e0a-9d87-6e4bd875212d service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-3136a5a3-bfe6-4cfa-8443-8e5318185a64 req-6260b35a-33d6-4e0a-9d87-6e4bd875212d service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] No waiting events found dispatching network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:39:00 user nova-compute[73091]: WARNING nova.compute.manager [req-3136a5a3-bfe6-4cfa-8443-8e5318185a64 req-6260b35a-33d6-4e0a-9d87-6e4bd875212d service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received unexpected event network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 for instance with vm_state building and task_state spawning.
Aug 09 16:39:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Releasing lock "refresh_cache-8fc884a8-24bb-488a-baeb-ef2b1faf239d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Instance network_info: |[{"id": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "address": "fa:16:3e:b3:de:fe", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ffdd03-c8", "ovs_interfaceid": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Start _get_guest_xml network_info=[{"id": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "address": "fa:16:3e:b3:de:fe", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ffdd03-c8", "ovs_interfaceid": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:39:00 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:39:00 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1973705747',display_name='tempest-ServerRescueNegativeTestJSON-server-1973705747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1973705747',id=20,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a03dd6b23c840c7b4a07f0235c1051b',ramdisk_id='',reservation_id='r-hw9kblzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-596687024',owner_user_name='tempest-ServerRescueNegativeTestJSON-596687024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:38:57Z,user_data=None,user_id='ef7727ab5d1b46d383bfc02750d29ec7',uuid=8fc884a8-24bb-488a-baeb-ef2b1faf239d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "address": "fa:16:3e:b3:de:fe", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ffdd03-c8", "ovs_interfaceid": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converting VIF {"id": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "address": "fa:16:3e:b3:de:fe", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ffdd03-c8", "ovs_interfaceid": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:de:fe,bridge_name='br-int',has_traffic_filtering=True,id=38ffdd03-c883-43bd-9607-036e5f5bd8e7,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38ffdd03-c8') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.objects.instance [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fc884a8-24bb-488a-baeb-ef2b1faf239d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:39:00 user nova-compute[73091]:   <uuid>8fc884a8-24bb-488a-baeb-ef2b1faf239d</uuid>
Aug 09 16:39:00 user nova-compute[73091]:   <name>instance-00000014</name>
Aug 09 16:39:00 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:39:00 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:39:00 user nova-compute[73091]:   <metadata>
Aug 09 16:39:00 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:39:00 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:39:00 user nova-compute[73091]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1973705747</nova:name>
Aug 09 16:39:00 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:39:00</nova:creationTime>
Aug 09 16:39:00 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:39:00 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:39:00 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:39:00 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:39:00 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:39:00 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:39:00 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:39:00 user nova-compute[73091]:       <nova:owner>
Aug 09 16:39:00 user nova-compute[73091]:         <nova:user uuid="ef7727ab5d1b46d383bfc02750d29ec7">tempest-ServerRescueNegativeTestJSON-596687024-project-member</nova:user>
Aug 09 16:39:00 user nova-compute[73091]:         <nova:project uuid="1a03dd6b23c840c7b4a07f0235c1051b">tempest-ServerRescueNegativeTestJSON-596687024</nova:project>
Aug 09 16:39:00 user nova-compute[73091]:       </nova:owner>
Aug 09 16:39:00 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:39:00 user nova-compute[73091]:       <nova:ports>
Aug 09 16:39:00 user nova-compute[73091]:         <nova:port uuid="38ffdd03-c883-43bd-9607-036e5f5bd8e7">
Aug 09 16:39:00 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 16:39:00 user nova-compute[73091]:         </nova:port>
Aug 09 16:39:00 user nova-compute[73091]:       </nova:ports>
Aug 09 16:39:00 user nova-compute[73091]:     </nova:instance>
Aug 09 16:39:00 user nova-compute[73091]:   </metadata>
Aug 09 16:39:00 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:39:00 user nova-compute[73091]:     <system>
Aug 09 16:39:00 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:39:00 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:39:00 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:39:00 user nova-compute[73091]:       <entry name="serial">8fc884a8-24bb-488a-baeb-ef2b1faf239d</entry>
Aug 09 16:39:00 user nova-compute[73091]:       <entry name="uuid">8fc884a8-24bb-488a-baeb-ef2b1faf239d</entry>
Aug 09 16:39:00 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:39:00 user nova-compute[73091]:     </system>
Aug 09 16:39:00 user nova-compute[73091]:   </sysinfo>
Aug 09 16:39:00 user nova-compute[73091]:   <os>
Aug 09 16:39:00 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:39:00 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:39:00 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:39:00 user nova-compute[73091]:   </os>
Aug 09 16:39:00 user nova-compute[73091]:   <features>
Aug 09 16:39:00 user nova-compute[73091]:     <acpi/>
Aug 09 16:39:00 user nova-compute[73091]:     <apic/>
Aug 09 16:39:00 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:39:00 user nova-compute[73091]:   </features>
Aug 09 16:39:00 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:39:00 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:39:00 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:39:00 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:39:00 user nova-compute[73091]:   </clock>
Aug 09 16:39:00 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:39:00 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:39:00 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:39:00 user nova-compute[73091]:   </cpu>
Aug 09 16:39:00 user nova-compute[73091]:   <devices>
Aug 09 16:39:00 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:39:00 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:39:00 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk"/>
Aug 09 16:39:00 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:39:00 user nova-compute[73091]:     </disk>
Aug 09 16:39:00 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:39:00 user nova-compute[73091]:       <mac address="fa:16:3e:b3:de:fe"/>
Aug 09 16:39:00 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:39:00 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:39:00 user nova-compute[73091]:       <target dev="tap38ffdd03-c8"/>
Aug 09 16:39:00 user nova-compute[73091]:     </interface>
Aug 09 16:39:00 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:39:00 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/console.log" append="off"/>
Aug 09 16:39:00 user nova-compute[73091]:     </serial>
Aug 09 16:39:00 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:39:00 user nova-compute[73091]:     <video>
Aug 09 16:39:00 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:39:00 user nova-compute[73091]:     </video>
Aug 09 16:39:00 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:39:00 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:39:00 user nova-compute[73091]:     </rng>
Aug 09 16:39:00 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:39:00 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:39:00 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:39:00 user nova-compute[73091]:     </memballoon>
Aug 09 16:39:00 user nova-compute[73091]:   </devices>
Aug 09 16:39:00 user nova-compute[73091]: </domain>
Aug 09 16:39:00 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1973705747',display_name='tempest-ServerRescueNegativeTestJSON-server-1973705747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1973705747',id=20,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a03dd6b23c840c7b4a07f0235c1051b',ramdisk_id='',reservation_id='r-hw9kblzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-596687024',owner_user_name='tempest-ServerRescueNegativeTestJSON-596687024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:38:57Z,user_data=None,user_id='ef7727ab5d1b46d383bfc02750d29ec7',uuid=8fc884a8-24bb-488a-baeb-ef2b1faf239d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "address": "fa:16:3e:b3:de:fe", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ffdd03-c8", "ovs_interfaceid": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converting VIF {"id": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "address": "fa:16:3e:b3:de:fe", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ffdd03-c8", "ovs_interfaceid": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:de:fe,bridge_name='br-int',has_traffic_filtering=True,id=38ffdd03-c883-43bd-9607-036e5f5bd8e7,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38ffdd03-c8') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG os_vif [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:de:fe,bridge_name='br-int',has_traffic_filtering=True,id=38ffdd03-c883-43bd-9607-036e5f5bd8e7,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38ffdd03-c8') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38ffdd03-c8, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38ffdd03-c8, col_values=(('external_ids', {'iface-id': '38ffdd03-c883-43bd-9607-036e5f5bd8e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:de:fe', 'vm-uuid': '8fc884a8-24bb-488a-baeb-ef2b1faf239d'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:00 user nova-compute[73091]: INFO os_vif [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:de:fe,bridge_name='br-int',has_traffic_filtering=True,id=38ffdd03-c883-43bd-9607-036e5f5bd8e7,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38ffdd03-c8')
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] No VIF found with MAC fa:16:3e:b3:de:fe, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-8f86bc3c-933e-4f6a-aaf5-ac2af3bdb745 req-516d1d8b-6b6a-484d-ae99-9105522fdf0b service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Received event network-vif-plugged-9d24e3ae-7181-4507-a0ba-43657ee1ff71 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8f86bc3c-933e-4f6a-aaf5-ac2af3bdb745 req-516d1d8b-6b6a-484d-ae99-9105522fdf0b service nova] Acquiring lock "37428447-3a47-4598-aa09-ee4019e0f193-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8f86bc3c-933e-4f6a-aaf5-ac2af3bdb745 req-516d1d8b-6b6a-484d-ae99-9105522fdf0b service nova] Lock "37428447-3a47-4598-aa09-ee4019e0f193-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8f86bc3c-933e-4f6a-aaf5-ac2af3bdb745 req-516d1d8b-6b6a-484d-ae99-9105522fdf0b service nova] Lock "37428447-3a47-4598-aa09-ee4019e0f193-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-8f86bc3c-933e-4f6a-aaf5-ac2af3bdb745 req-516d1d8b-6b6a-484d-ae99-9105522fdf0b service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] No waiting events found dispatching network-vif-plugged-9d24e3ae-7181-4507-a0ba-43657ee1ff71 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:39:00 user nova-compute[73091]: WARNING nova.compute.manager [req-8f86bc3c-933e-4f6a-aaf5-ac2af3bdb745 req-516d1d8b-6b6a-484d-ae99-9105522fdf0b service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Received unexpected event network-vif-plugged-9d24e3ae-7181-4507-a0ba-43657ee1ff71 for instance with vm_state building and task_state spawning.
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-8f86bc3c-933e-4f6a-aaf5-ac2af3bdb745 req-516d1d8b-6b6a-484d-ae99-9105522fdf0b service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Received event network-changed-38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-8f86bc3c-933e-4f6a-aaf5-ac2af3bdb745 req-516d1d8b-6b6a-484d-ae99-9105522fdf0b service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Refreshing instance network info cache due to event network-changed-38ffdd03-c883-43bd-9607-036e5f5bd8e7. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8f86bc3c-933e-4f6a-aaf5-ac2af3bdb745 req-516d1d8b-6b6a-484d-ae99-9105522fdf0b service nova] Acquiring lock "refresh_cache-8fc884a8-24bb-488a-baeb-ef2b1faf239d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8f86bc3c-933e-4f6a-aaf5-ac2af3bdb745 req-516d1d8b-6b6a-484d-ae99-9105522fdf0b service nova] Acquired lock "refresh_cache-8fc884a8-24bb-488a-baeb-ef2b1faf239d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.network.neutron [req-8f86bc3c-933e-4f6a-aaf5-ac2af3bdb745 req-516d1d8b-6b6a-484d-ae99-9105522fdf0b service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Refreshing network info cache for port 38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.objects.instance [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'flavor' on Instance uuid f3e2ea27-5fa4-4437-83d0-2eeda59506a9 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-801291f1-2fdd-48a5-bc15-a172f9f36f20 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.250s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 16:39:00 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:39:01 user nova-compute[73091]: DEBUG nova.network.neutron [req-8f86bc3c-933e-4f6a-aaf5-ac2af3bdb745 req-516d1d8b-6b6a-484d-ae99-9105522fdf0b service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Updated VIF entry in instance network info cache for port 38ffdd03-c883-43bd-9607-036e5f5bd8e7. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:39:01 user nova-compute[73091]: DEBUG nova.network.neutron [req-8f86bc3c-933e-4f6a-aaf5-ac2af3bdb745 req-516d1d8b-6b6a-484d-ae99-9105522fdf0b service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Updating instance_info_cache with network_info: [{"id": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "address": "fa:16:3e:b3:de:fe", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ffdd03-c8", "ovs_interfaceid": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:39:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8f86bc3c-933e-4f6a-aaf5-ac2af3bdb745 req-516d1d8b-6b6a-484d-ae99-9105522fdf0b service nova] Releasing lock "refresh_cache-8fc884a8-24bb-488a-baeb-ef2b1faf239d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:39:01 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599141.5311108, 37428447-3a47-4598-aa09-ee4019e0f193 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:39:01 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] VM Resumed (Lifecycle Event)
Aug 09 16:39:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:39:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:39:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Instance spawned successfully.
Aug 09 16:39:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:39:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:39:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:39:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:01 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:39:01 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599141.532796, 37428447-3a47-4598-aa09-ee4019e0f193 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:39:01 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] VM Started (Lifecycle Event)
Aug 09 16:39:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:39:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:39:01 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:39:01 user nova-compute[73091]: INFO nova.compute.manager [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Took 8.20 seconds to spawn the instance on the hypervisor.
Aug 09 16:39:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:39:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:01 user nova-compute[73091]: INFO nova.compute.manager [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Took 9.10 seconds to build instance.
Aug 09 16:39:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9d382eb5-02cb-4854-a512-1b6003d67509 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "37428447-3a47-4598-aa09-ee4019e0f193" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.240s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-eaf282e6-04ed-4cdf-9781-964b88e89579 req-9c68ce37-6b91-4cd6-ad99-cc2e880c395e service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received event network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eaf282e6-04ed-4cdf-9781-964b88e89579 req-9c68ce37-6b91-4cd6-ad99-cc2e880c395e service nova] Acquiring lock "f939fe27-017a-481e-babc-147bf98e0132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eaf282e6-04ed-4cdf-9781-964b88e89579 req-9c68ce37-6b91-4cd6-ad99-cc2e880c395e service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eaf282e6-04ed-4cdf-9781-964b88e89579 req-9c68ce37-6b91-4cd6-ad99-cc2e880c395e service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-eaf282e6-04ed-4cdf-9781-964b88e89579 req-9c68ce37-6b91-4cd6-ad99-cc2e880c395e service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] No waiting events found dispatching network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:39:02 user nova-compute[73091]: WARNING nova.compute.manager [req-eaf282e6-04ed-4cdf-9781-964b88e89579 req-9c68ce37-6b91-4cd6-ad99-cc2e880c395e service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received unexpected event network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 for instance with vm_state building and task_state spawning.
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599142.2438586, f939fe27-017a-481e-babc-147bf98e0132 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:39:02 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] VM Resumed (Lifecycle Event)
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:39:02 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: f939fe27-017a-481e-babc-147bf98e0132] Instance spawned successfully.
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:02 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599142.2480738, f939fe27-017a-481e-babc-147bf98e0132 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:39:02 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] VM Started (Lifecycle Event)
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:39:02 user nova-compute[73091]: INFO nova.compute.manager [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Took 6.45 seconds to spawn the instance on the hypervisor.
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:39:02 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:39:02 user nova-compute[73091]: INFO nova.compute.manager [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Took 7.36 seconds to build instance.
Aug 09 16:39:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c617d1b3-d640-42b0-a433-49303e5ea1f7 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "f939fe27-017a-481e-babc-147bf98e0132" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.455s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-4e65e701-d311-418f-8094-89dae5a8757c req-8ac843e2-6557-4266-ae67-133284bddf68 service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Received event network-vif-plugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4e65e701-d311-418f-8094-89dae5a8757c req-8ac843e2-6557-4266-ae67-133284bddf68 service nova] Acquiring lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4e65e701-d311-418f-8094-89dae5a8757c req-8ac843e2-6557-4266-ae67-133284bddf68 service nova] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4e65e701-d311-418f-8094-89dae5a8757c req-8ac843e2-6557-4266-ae67-133284bddf68 service nova] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-4e65e701-d311-418f-8094-89dae5a8757c req-8ac843e2-6557-4266-ae67-133284bddf68 service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] No waiting events found dispatching network-vif-plugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:39:02 user nova-compute[73091]: WARNING nova.compute.manager [req-4e65e701-d311-418f-8094-89dae5a8757c req-8ac843e2-6557-4266-ae67-133284bddf68 service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Received unexpected event network-vif-plugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 for instance with vm_state building and task_state spawning.
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-4e65e701-d311-418f-8094-89dae5a8757c req-8ac843e2-6557-4266-ae67-133284bddf68 service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Received event network-vif-plugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4e65e701-d311-418f-8094-89dae5a8757c req-8ac843e2-6557-4266-ae67-133284bddf68 service nova] Acquiring lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4e65e701-d311-418f-8094-89dae5a8757c req-8ac843e2-6557-4266-ae67-133284bddf68 service nova] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4e65e701-d311-418f-8094-89dae5a8757c req-8ac843e2-6557-4266-ae67-133284bddf68 service nova] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-4e65e701-d311-418f-8094-89dae5a8757c req-8ac843e2-6557-4266-ae67-133284bddf68 service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] No waiting events found dispatching network-vif-plugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:39:02 user nova-compute[73091]: WARNING nova.compute.manager [req-4e65e701-d311-418f-8094-89dae5a8757c req-8ac843e2-6557-4266-ae67-133284bddf68 service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Received unexpected event network-vif-plugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 for instance with vm_state building and task_state spawning.
Aug 09 16:39:02 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:39:03 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:39:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:39:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-18d8e887-0f91-42e1-ba79-13db5aa9b84b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:39:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-18d8e887-0f91-42e1-ba79-13db5aa9b84b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:39:03 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:39:04 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599144.0324116, 8fc884a8-24bb-488a-baeb-ef2b1faf239d => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:39:04 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] VM Resumed (Lifecycle Event)
Aug 09 16:39:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:39:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:39:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Instance spawned successfully.
Aug 09 16:39:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:39:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:39:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:39:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:04 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:39:04 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599144.0374804, 8fc884a8-24bb-488a-baeb-ef2b1faf239d => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:39:04 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] VM Started (Lifecycle Event)
Aug 09 16:39:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:39:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:39:04 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:39:04 user nova-compute[73091]: INFO nova.compute.manager [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Took 7.01 seconds to spawn the instance on the hypervisor.
Aug 09 16:39:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:39:04 user nova-compute[73091]: INFO nova.compute.manager [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Took 7.92 seconds to build instance.
Aug 09 16:39:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-273615dd-b451-4264-bae2-6158896a0e86 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.111s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:04 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Updating instance_info_cache with network_info: [{"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:39:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-18d8e887-0f91-42e1-ba79-13db5aa9b84b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:39:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:39:04 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:39:04 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:39:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:04 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:39:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:06 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:39:07 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:39:07 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:39:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:07 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:39:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:39:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:11 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:39:11 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:39:11 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7547MB free_disk=25.550312042236328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:39:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f3e2ea27-5fa4-4437-83d0-2eeda59506a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance b43afe67-19e9-42b5-ba1b-f00b4aa56fc7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 68d63bc2-d726-49d8-91de-bc5cc66bb119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 93e10fd4-8841-4043-b4e2-7489c4dea3e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 38051bca-7190-4dff-91d1-3d99b4e4182b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 37428447-3a47-4598-aa09-ee4019e0f193 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f939fe27-017a-481e-babc-147bf98e0132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8fc884a8-24bb-488a-baeb-ef2b1faf239d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing inventories for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Updating ProviderTree inventory for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Updating inventory in ProviderTree for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing aggregate associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing trait associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, traits: HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:39:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.034s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_power_states {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid 18d8e887-0f91-42e1-ba79-13db5aa9b84b {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid b43afe67-19e9-42b5-ba1b-f00b4aa56fc7 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid 68d63bc2-d726-49d8-91de-bc5cc66bb119 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid 93e10fd4-8841-4043-b4e2-7489c4dea3e6 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid 38051bca-7190-4dff-91d1-3d99b4e4182b {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid 37428447-3a47-4598-aa09-ee4019e0f193 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid f939fe27-017a-481e-babc-147bf98e0132 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid 8fc884a8-24bb-488a-baeb-ef2b1faf239d {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid f3e2ea27-5fa4-4437-83d0-2eeda59506a9 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "68d63bc2-d726-49d8-91de-bc5cc66bb119" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "38051bca-7190-4dff-91d1-3d99b4e4182b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "37428447-3a47-4598-aa09-ee4019e0f193" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "37428447-3a47-4598-aa09-ee4019e0f193" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "f939fe27-017a-481e-babc-147bf98e0132" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "f939fe27-017a-481e-babc-147bf98e0132" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "f939fe27-017a-481e-babc-147bf98e0132" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "37428447-3a47-4598-aa09-ee4019e0f193" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.126s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "45447959-13b8-4cb4-aefd-8675ab284bb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "45447959-13b8-4cb4-aefd-8675ab284bb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.154s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.159s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.181s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5011 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:39:15 user nova-compute[73091]: INFO nova.compute.claims [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Claim successful on node user
Aug 09 16:39:15 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:39:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:39:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:39:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:39:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:39:16 user nova-compute[73091]: INFO nova.virt.block_device [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Booting with volume snapshot 40258c9d-872a-4ca7-8735-7cf62b8762c2 at /dev/vda
Aug 09 16:39:16 user nova-compute[73091]: DEBUG nova.policy [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69ccebf0e9d54502a2318c809ce11369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d3dfd232d54594808dad271baa5192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:39:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Successfully created port: 610fa224-8ef6-425c-9f3c-65ea46ab984b {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:39:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Successfully updated port: 610fa224-8ef6-425c-9f3c-65ea46ab984b {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:39:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "refresh_cache-45447959-13b8-4cb4-aefd-8675ab284bb8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:39:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquired lock "refresh_cache-45447959-13b8-4cb4-aefd-8675ab284bb8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:39:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:39:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-cabb1084-3774-4a1e-83cd-3395e014b431 req-7d2d7410-8d22-47b8-8344-0b4ecfd161ae service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Received event network-changed-a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:39:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-cabb1084-3774-4a1e-83cd-3395e014b431 req-7d2d7410-8d22-47b8-8344-0b4ecfd161ae service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Refreshing instance network info cache due to event network-changed-a701119d-6f96-488f-ad0f-ea05c96e5268. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:39:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cabb1084-3774-4a1e-83cd-3395e014b431 req-7d2d7410-8d22-47b8-8344-0b4ecfd161ae service nova] Acquiring lock "refresh_cache-b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:39:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cabb1084-3774-4a1e-83cd-3395e014b431 req-7d2d7410-8d22-47b8-8344-0b4ecfd161ae service nova] Acquired lock "refresh_cache-b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:39:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-cabb1084-3774-4a1e-83cd-3395e014b431 req-7d2d7410-8d22-47b8-8344-0b4ecfd161ae service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Refreshing network info cache for port a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:39:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:39:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Updating instance_info_cache with network_info: [{"id": "610fa224-8ef6-425c-9f3c-65ea46ab984b", "address": "fa:16:3e:cd:a2:79", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap610fa224-8e", "ovs_interfaceid": "610fa224-8ef6-425c-9f3c-65ea46ab984b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:39:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Releasing lock "refresh_cache-45447959-13b8-4cb4-aefd-8675ab284bb8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:39:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Instance network_info: |[{"id": "610fa224-8ef6-425c-9f3c-65ea46ab984b", "address": "fa:16:3e:cd:a2:79", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap610fa224-8e", "ovs_interfaceid": "610fa224-8ef6-425c-9f3c-65ea46ab984b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:39:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-cabb1084-3774-4a1e-83cd-3395e014b431 req-7d2d7410-8d22-47b8-8344-0b4ecfd161ae service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Updated VIF entry in instance network info cache for port a701119d-6f96-488f-ad0f-ea05c96e5268. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:39:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-cabb1084-3774-4a1e-83cd-3395e014b431 req-7d2d7410-8d22-47b8-8344-0b4ecfd161ae service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Updating instance_info_cache with network_info: [{"id": "a701119d-6f96-488f-ad0f-ea05c96e5268", "address": "fa:16:3e:32:fc:e5", "network": {"id": "e72f54ab-788d-4574-bf12-9fa76ea48145", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-414514792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb392d70735f4df8860e29e2ed4f114c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa701119d-6f", "ovs_interfaceid": "a701119d-6f96-488f-ad0f-ea05c96e5268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:39:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cabb1084-3774-4a1e-83cd-3395e014b431 req-7d2d7410-8d22-47b8-8344-0b4ecfd161ae service nova] Releasing lock "refresh_cache-b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:39:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:20 user nova-compute[73091]: INFO nova.compute.manager [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Rebuilding instance
Aug 09 16:39:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lazy-loading 'trusted_certs' on Instance uuid b43afe67-19e9-42b5-ba1b-f00b4aa56fc7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:39:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:39:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lazy-loading 'pci_requests' on Instance uuid b43afe67-19e9-42b5-ba1b-f00b4aa56fc7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:39:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lazy-loading 'pci_devices' on Instance uuid b43afe67-19e9-42b5-ba1b-f00b4aa56fc7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:39:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lazy-loading 'resources' on Instance uuid b43afe67-19e9-42b5-ba1b-f00b4aa56fc7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:39:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lazy-loading 'migration_context' on Instance uuid b43afe67-19e9-42b5-ba1b-f00b4aa56fc7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:39:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73091) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-5ca82a67-1e34-49ee-ac0d-b34fc8b40c9f req-5e845a2a-d4ca-4be1-8bd9-8aab6fb166f2 service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Received event network-changed-610fa224-8ef6-425c-9f3c-65ea46ab984b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-5ca82a67-1e34-49ee-ac0d-b34fc8b40c9f req-5e845a2a-d4ca-4be1-8bd9-8aab6fb166f2 service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Refreshing instance network info cache due to event network-changed-610fa224-8ef6-425c-9f3c-65ea46ab984b. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5ca82a67-1e34-49ee-ac0d-b34fc8b40c9f req-5e845a2a-d4ca-4be1-8bd9-8aab6fb166f2 service nova] Acquiring lock "refresh_cache-45447959-13b8-4cb4-aefd-8675ab284bb8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5ca82a67-1e34-49ee-ac0d-b34fc8b40c9f req-5e845a2a-d4ca-4be1-8bd9-8aab6fb166f2 service nova] Acquired lock "refresh_cache-45447959-13b8-4cb4-aefd-8675ab284bb8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG nova.network.neutron [req-5ca82a67-1e34-49ee-ac0d-b34fc8b40c9f req-5e845a2a-d4ca-4be1-8bd9-8aab6fb166f2 service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Refreshing network info cache for port 610fa224-8ef6-425c-9f3c-65ea46ab984b {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:39:21 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Instance destroyed successfully.
Aug 09 16:39:21 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Instance destroyed successfully.
Aug 09 16:39:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:37:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1832276351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-795799594',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkZLgMs6m+7dg3Hs5GmhpEj7horlTD7kkT8Ur0MpazXAI51/Bo/IRROyxIbVDzm2mgAMl3z17iPI2mWhvCp8vxCgW/ifPXfNJE8PGmzhO69XbpdWA00iHhl3K8a22Tf2A==',key_name='tempest-keypair-1207467283',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:37:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cb392d70735f4df8860e29e2ed4f114c',ramdisk_id='',reservation_id='r-ixolz5ob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-24876138',owner_user_name='tempest-ServerActionsV293TestJSON-24876138-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:39:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8363e87670bc4cbe85d05285f4a29fc5',uuid=b43afe67-19e9-42b5-ba1b-f00b4aa56fc7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a701119d-6f96-488f-ad0f-ea05c96e5268", "address": "fa:16:3e:32:fc:e5", "network": {"id": "e72f54ab-788d-4574-bf12-9fa76ea48145", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-414514792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb392d70735f4df8860e29e2ed4f114c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa701119d-6f", "ovs_interfaceid": "a701119d-6f96-488f-ad0f-ea05c96e5268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Converting VIF {"id": "a701119d-6f96-488f-ad0f-ea05c96e5268", "address": "fa:16:3e:32:fc:e5", "network": {"id": "e72f54ab-788d-4574-bf12-9fa76ea48145", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-414514792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb392d70735f4df8860e29e2ed4f114c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa701119d-6f", "ovs_interfaceid": "a701119d-6f96-488f-ad0f-ea05c96e5268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=a701119d-6f96-488f-ad0f-ea05c96e5268,network=Network(e72f54ab-788d-4574-bf12-9fa76ea48145),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa701119d-6f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG os_vif [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=a701119d-6f96-488f-ad0f-ea05c96e5268,network=Network(e72f54ab-788d-4574-bf12-9fa76ea48145),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa701119d-6f') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa701119d-6f, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:39:21 user nova-compute[73091]: INFO os_vif [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=a701119d-6f96-488f-ad0f-ea05c96e5268,network=Network(e72f54ab-788d-4574-bf12-9fa76ea48145),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa701119d-6f')
Aug 09 16:39:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crBXfeax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:39:21 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 16:39:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dea4af-da78-44e0-9af1-436a98116043]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b889dfb5-5eb8-45b9-8ddf-42e39b8a3ca3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:39:21 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:39:21 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0603e3880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c9375e-3a1c-4aa7-bc2c-282314bda515]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0e5f71-9420-4d50-b44f-76d4edbc8b17]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG os_brick.utils [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda363f7-f734-44bb-931c-fdceb6327d45]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa71338-7ea1-4da3-b409-70e7b634a675]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG nova.network.neutron [req-5ca82a67-1e34-49ee-ac0d-b34fc8b40c9f req-5e845a2a-d4ca-4be1-8bd9-8aab6fb166f2 service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Updated VIF entry in instance network info cache for port 610fa224-8ef6-425c-9f3c-65ea46ab984b. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG nova.network.neutron [req-5ca82a67-1e34-49ee-ac0d-b34fc8b40c9f req-5e845a2a-d4ca-4be1-8bd9-8aab6fb166f2 service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Updating instance_info_cache with network_info: [{"id": "610fa224-8ef6-425c-9f3c-65ea46ab984b", "address": "fa:16:3e:cd:a2:79", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap610fa224-8e", "ovs_interfaceid": "610fa224-8ef6-425c-9f3c-65ea46ab984b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b609db00-dd48-4649-932a-7b5ad0299c4a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5ca82a67-1e34-49ee-ac0d-b34fc8b40c9f req-5e845a2a-d4ca-4be1-8bd9-8aab6fb166f2 service nova] Releasing lock "refresh_cache-45447959-13b8-4cb4-aefd-8675ab284bb8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-5ca82a67-1e34-49ee-ac0d-b34fc8b40c9f req-5e845a2a-d4ca-4be1-8bd9-8aab6fb166f2 service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Received event network-vif-unplugged-a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5ca82a67-1e34-49ee-ac0d-b34fc8b40c9f req-5e845a2a-d4ca-4be1-8bd9-8aab6fb166f2 service nova] Acquiring lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5ca82a67-1e34-49ee-ac0d-b34fc8b40c9f req-5e845a2a-d4ca-4be1-8bd9-8aab6fb166f2 service nova] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5ca82a67-1e34-49ee-ac0d-b34fc8b40c9f req-5e845a2a-d4ca-4be1-8bd9-8aab6fb166f2 service nova] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-5ca82a67-1e34-49ee-ac0d-b34fc8b40c9f req-5e845a2a-d4ca-4be1-8bd9-8aab6fb166f2 service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] No waiting events found dispatching network-vif-unplugged-a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:39:21 user nova-compute[73091]: WARNING nova.compute.manager [req-5ca82a67-1e34-49ee-ac0d-b34fc8b40c9f req-5e845a2a-d4ca-4be1-8bd9-8aab6fb166f2 service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Received unexpected event network-vif-unplugged-a701119d-6f96-488f-ad0f-ea05c96e5268 for instance with vm_state active and task_state rebuilding.
Aug 09 16:39:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.066s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[af05a702-c474-4e5d-b274-f960991d4974]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a1ccc6-49db-4317-8c6d-bccd365b8633]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_6fc8f3fb', '/dev/disk/by-id/scsi-26165626232663665', '/dev/disk/by-id/scsi-1SCST_BIO6fc8f3fb-aebb2f6e7924fb0c') {{(pid=83925) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[69233b9b-0622-49be-a290-206efabbb7e1]: (4, None) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91ff2ad-1440-4225-bc29-c43d904900bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d910afb-047a-4bd5-960c-364c26d60190]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:39:22 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a419dd-f621-4687-ae71-aab1d6fede28]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.utils [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Updating existing volume attachment record: 9ef0cb4c-c846-44b9-8fc8-1f7349fe1c95 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a85c854-e336-4edd-a7b0-e767f8016607]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd, portal: 172.16.0.220,3260]
Aug 09 16:39:22 user nova-compute[73091]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd, portal: 172.16.0.220,3260] successful.
Aug 09 16:39:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6272b0c-86f2-4e2e-9d9b-f46256516fc5]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] <== disconnect_volume: return (379ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:39:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Deleting instance files /opt/stack/data/nova/instances/b43afe67-19e9-42b5-ba1b-f00b4aa56fc7_del
Aug 09 16:39:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Deletion of /opt/stack/data/nova/instances/b43afe67-19e9-42b5-ba1b-f00b4aa56fc7_del complete
Aug 09 16:39:22 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance b43afe67-19e9-42b5-ba1b-f00b4aa56fc7 could not be found.
Aug 09 16:39:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crBXfeax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:39:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[409dec17-4b95-47c6-ae27-df2569a66175]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 09 16:39:22 user nova-compute[73091]: : NotImplementedError
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[179d1d3c-9a8f-4974-9d97-a77bf4736253]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 16:39:22 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 16:39:22 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:39:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 16:39:22 user nova-compute[73091]: : NotImplementedError
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff060202ef0>, {}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Disconnecting from: [] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.045s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] <== disconnect_volume: return (47ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:39:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:39:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Preparing to wait for external event volume-reimaged-af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd {{(pid=73091) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 09 16:39:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Acquiring lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-da50b2a1-3d32-43b1-8a19-5defa8451711 req-18d56988-cc0b-45e7-8603-93d94ef373e9 service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Received event network-vif-plugged-a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:39:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da50b2a1-3d32-43b1-8a19-5defa8451711 req-18d56988-cc0b-45e7-8603-93d94ef373e9 service nova] Acquiring lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da50b2a1-3d32-43b1-8a19-5defa8451711 req-18d56988-cc0b-45e7-8603-93d94ef373e9 service nova] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da50b2a1-3d32-43b1-8a19-5defa8451711 req-18d56988-cc0b-45e7-8603-93d94ef373e9 service nova] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-da50b2a1-3d32-43b1-8a19-5defa8451711 req-18d56988-cc0b-45e7-8603-93d94ef373e9 service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] No event matching network-vif-plugged-a701119d-6f96-488f-ad0f-ea05c96e5268 in dict_keys([('volume-reimaged', 'af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd')]) {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 09 16:39:23 user nova-compute[73091]: WARNING nova.compute.manager [req-da50b2a1-3d32-43b1-8a19-5defa8451711 req-18d56988-cc0b-45e7-8603-93d94ef373e9 service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Received unexpected event network-vif-plugged-a701119d-6f96-488f-ad0f-ea05c96e5268 for instance with vm_state active and task_state rebuilding.
Aug 09 16:39:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:39:30 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Creating image(s)
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Ensure instance console log exists: /opt/stack/data/nova/instances/45447959-13b8-4cb4-aefd-8675ab284bb8/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Start _get_guest_xml network_info=[{"id": "610fa224-8ef6-425c-9f3c-65ea46ab984b", "address": "fa:16:3e:cd:a2:79", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap610fa224-8e", "ovs_interfaceid": "610fa224-8ef6-425c-9f3c-65ea46ab984b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '9ef0cb4c-c846-44b9-8fc8-1f7349fe1c95', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfClAXER', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '45447959-13b8-4cb4-aefd-8675ab284bb8', 'attached_at': '', 'detached_at': '', 'volume_id': '83185933-d7ab-4b1f-b505-38c4cdfe9a0f', 'serial': '83185933-d7ab-4b1f-b505-38c4cdfe9a0f'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:39:30 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:39:30 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfClAXER', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:39:30 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:39:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:39:30 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:39:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:39:30 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:39:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dd8abe-48d9-4aa9-8d86-e3a6d8697388]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:39:30 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a57842-fc2e-4508-b078-ea4010228437]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f] added
Aug 09 16:39:30 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c1e5ec-b4e9-4a53-96e3-4f0543830d4b]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dc8609-04dc-4dd9-b5ff-a30958e54364]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qfClAXER {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qfClAXER" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07b0bfa-c9da-4ca1-89d5-6d04050053e7]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qfClAXER'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:39:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[86aaea4b-fe30-4fd6-97a5-a3b798f7a4a0]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9336e22-9faa-484c-bd65-1f2f8f68770d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 16:39:31 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 16:39:31 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:39:31 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 16:39:31 user nova-compute[73091]: 
Aug 09 16:39:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5482f2a7-62db-4cda-8f2c-2c91af383b48]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f, portal: 172.16.0.220,3260]
Aug 09 16:39:31 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f, portal: 172.16.0.220,3260] successful.
Aug 09 16:39:31 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7833ce-fbc4-4891-ba76-5723238a26d2]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1038761-3b46-4081-a9e0-f0ef3eb239ba]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:39:31 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:39:31 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[837a0b4f-900c-4183-9e15-95cfa0b45c0a]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfClAXER', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:39:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26533663036613631', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533663036613631', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1761745280',display_name='tempest-TestVolumeBootPattern-server-1761745280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1761745280',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d3dfd232d54594808dad271baa5192',ramdisk_id='',reservation_id='r-lpajow9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1605875873',owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:39:16Z,user_data=None,user_id='69ccebf0e9d54502a2318c809ce11369',uuid=45447959-13b8-4cb4-aefd-8675ab284bb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "610fa224-8ef6-425c-9f3c-65ea46ab984b", "address": "fa:16:3e:cd:a2:79", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap610fa224-8e", "ovs_interfaceid": "610fa224-8ef6-425c-9f3c-65ea46ab984b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converting VIF {"id": "610fa224-8ef6-425c-9f3c-65ea46ab984b", "address": "fa:16:3e:cd:a2:79", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap610fa224-8e", "ovs_interfaceid": "610fa224-8ef6-425c-9f3c-65ea46ab984b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:a2:79,bridge_name='br-int',has_traffic_filtering=True,id=610fa224-8ef6-425c-9f3c-65ea46ab984b,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap610fa224-8e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG nova.objects.instance [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lazy-loading 'pci_devices' on Instance uuid 45447959-13b8-4cb4-aefd-8675ab284bb8 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:39:32 user nova-compute[73091]:   <uuid>45447959-13b8-4cb4-aefd-8675ab284bb8</uuid>
Aug 09 16:39:32 user nova-compute[73091]:   <name>instance-00000015</name>
Aug 09 16:39:32 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:39:32 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:39:32 user nova-compute[73091]:   <metadata>
Aug 09 16:39:32 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:39:32 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:39:32 user nova-compute[73091]:       <nova:name>tempest-TestVolumeBootPattern-server-1761745280</nova:name>
Aug 09 16:39:32 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:39:30</nova:creationTime>
Aug 09 16:39:32 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:39:32 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:39:32 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:39:32 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:39:32 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:39:32 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:39:32 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:39:32 user nova-compute[73091]:       <nova:owner>
Aug 09 16:39:32 user nova-compute[73091]:         <nova:user uuid="69ccebf0e9d54502a2318c809ce11369">tempest-TestVolumeBootPattern-1605875873-project-member</nova:user>
Aug 09 16:39:32 user nova-compute[73091]:         <nova:project uuid="64d3dfd232d54594808dad271baa5192">tempest-TestVolumeBootPattern-1605875873</nova:project>
Aug 09 16:39:32 user nova-compute[73091]:       </nova:owner>
Aug 09 16:39:32 user nova-compute[73091]:       <nova:ports>
Aug 09 16:39:32 user nova-compute[73091]:         <nova:port uuid="610fa224-8ef6-425c-9f3c-65ea46ab984b">
Aug 09 16:39:32 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 16:39:32 user nova-compute[73091]:         </nova:port>
Aug 09 16:39:32 user nova-compute[73091]:       </nova:ports>
Aug 09 16:39:32 user nova-compute[73091]:     </nova:instance>
Aug 09 16:39:32 user nova-compute[73091]:   </metadata>
Aug 09 16:39:32 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:39:32 user nova-compute[73091]:     <system>
Aug 09 16:39:32 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:39:32 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:39:32 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:39:32 user nova-compute[73091]:       <entry name="serial">45447959-13b8-4cb4-aefd-8675ab284bb8</entry>
Aug 09 16:39:32 user nova-compute[73091]:       <entry name="uuid">45447959-13b8-4cb4-aefd-8675ab284bb8</entry>
Aug 09 16:39:32 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:39:32 user nova-compute[73091]:     </system>
Aug 09 16:39:32 user nova-compute[73091]:   </sysinfo>
Aug 09 16:39:32 user nova-compute[73091]:   <os>
Aug 09 16:39:32 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:39:32 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:39:32 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:39:32 user nova-compute[73091]:   </os>
Aug 09 16:39:32 user nova-compute[73091]:   <features>
Aug 09 16:39:32 user nova-compute[73091]:     <acpi/>
Aug 09 16:39:32 user nova-compute[73091]:     <apic/>
Aug 09 16:39:32 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:39:32 user nova-compute[73091]:   </features>
Aug 09 16:39:32 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:39:32 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:39:32 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:39:32 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:39:32 user nova-compute[73091]:   </clock>
Aug 09 16:39:32 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:39:32 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:39:32 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:39:32 user nova-compute[73091]:   </cpu>
Aug 09 16:39:32 user nova-compute[73091]:   <devices>
Aug 09 16:39:32 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:39:32 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:39:32 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 09 16:39:32 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:39:32 user nova-compute[73091]:       <serial>83185933-d7ab-4b1f-b505-38c4cdfe9a0f</serial>
Aug 09 16:39:32 user nova-compute[73091]:     </disk>
Aug 09 16:39:32 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:39:32 user nova-compute[73091]:       <mac address="fa:16:3e:cd:a2:79"/>
Aug 09 16:39:32 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:39:32 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:39:32 user nova-compute[73091]:       <target dev="tap610fa224-8e"/>
Aug 09 16:39:32 user nova-compute[73091]:     </interface>
Aug 09 16:39:32 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:39:32 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/45447959-13b8-4cb4-aefd-8675ab284bb8/console.log" append="off"/>
Aug 09 16:39:32 user nova-compute[73091]:     </serial>
Aug 09 16:39:32 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:39:32 user nova-compute[73091]:     <video>
Aug 09 16:39:32 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:39:32 user nova-compute[73091]:     </video>
Aug 09 16:39:32 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:39:32 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:39:32 user nova-compute[73091]:     </rng>
Aug 09 16:39:32 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:39:32 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:39:32 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:39:32 user nova-compute[73091]:     </memballoon>
Aug 09 16:39:32 user nova-compute[73091]:   </devices>
Aug 09 16:39:32 user nova-compute[73091]: </domain>
Aug 09 16:39:32 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1761745280',display_name='tempest-TestVolumeBootPattern-server-1761745280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1761745280',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d3dfd232d54594808dad271baa5192',ramdisk_id='',reservation_id='r-lpajow9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1605875873',owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:39:16Z,user_data=None,user_id='69ccebf0e9d54502a2318c809ce11369',uuid=45447959-13b8-4cb4-aefd-8675ab284bb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "610fa224-8ef6-425c-9f3c-65ea46ab984b", "address": "fa:16:3e:cd:a2:79", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap610fa224-8e", "ovs_interfaceid": "610fa224-8ef6-425c-9f3c-65ea46ab984b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converting VIF {"id": "610fa224-8ef6-425c-9f3c-65ea46ab984b", "address": "fa:16:3e:cd:a2:79", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap610fa224-8e", "ovs_interfaceid": "610fa224-8ef6-425c-9f3c-65ea46ab984b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:a2:79,bridge_name='br-int',has_traffic_filtering=True,id=610fa224-8ef6-425c-9f3c-65ea46ab984b,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap610fa224-8e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG os_vif [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:a2:79,bridge_name='br-int',has_traffic_filtering=True,id=610fa224-8ef6-425c-9f3c-65ea46ab984b,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap610fa224-8e') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap610fa224-8e, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap610fa224-8e, col_values=(('external_ids', {'iface-id': '610fa224-8ef6-425c-9f3c-65ea46ab984b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:a2:79', 'vm-uuid': '45447959-13b8-4cb4-aefd-8675ab284bb8'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:32 user nova-compute[73091]: INFO os_vif [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:a2:79,bridge_name='br-int',has_traffic_filtering=True,id=610fa224-8ef6-425c-9f3c-65ea46ab984b,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap610fa224-8e')
Aug 09 16:39:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:39:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] No VIF found with MAC fa:16:3e:cd:a2:79, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:39:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-e518c4ec-5270-473a-bbef-40e30c0d936f req-9fbe4c31-4fb5-482e-be52-1135a20f5bae service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Received event network-vif-plugged-610fa224-8ef6-425c-9f3c-65ea46ab984b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:39:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e518c4ec-5270-473a-bbef-40e30c0d936f req-9fbe4c31-4fb5-482e-be52-1135a20f5bae service nova] Acquiring lock "45447959-13b8-4cb4-aefd-8675ab284bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e518c4ec-5270-473a-bbef-40e30c0d936f req-9fbe4c31-4fb5-482e-be52-1135a20f5bae service nova] Lock "45447959-13b8-4cb4-aefd-8675ab284bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e518c4ec-5270-473a-bbef-40e30c0d936f req-9fbe4c31-4fb5-482e-be52-1135a20f5bae service nova] Lock "45447959-13b8-4cb4-aefd-8675ab284bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-e518c4ec-5270-473a-bbef-40e30c0d936f req-9fbe4c31-4fb5-482e-be52-1135a20f5bae service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] No waiting events found dispatching network-vif-plugged-610fa224-8ef6-425c-9f3c-65ea46ab984b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:39:33 user nova-compute[73091]: WARNING nova.compute.manager [req-e518c4ec-5270-473a-bbef-40e30c0d936f req-9fbe4c31-4fb5-482e-be52-1135a20f5bae service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Received unexpected event network-vif-plugged-610fa224-8ef6-425c-9f3c-65ea46ab984b for instance with vm_state building and task_state spawning.
Aug 09 16:39:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:35 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599175.6704779, 45447959-13b8-4cb4-aefd-8675ab284bb8 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:39:35 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] VM Resumed (Lifecycle Event)
Aug 09 16:39:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:39:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:39:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:39:35 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Instance spawned successfully.
Aug 09 16:39:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:39:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:39:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:35 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:39:35 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599175.6722546, 45447959-13b8-4cb4-aefd-8675ab284bb8 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:39:35 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] VM Started (Lifecycle Event)
Aug 09 16:39:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:39:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:39:35 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:39:35 user nova-compute[73091]: INFO nova.compute.manager [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Took 5.01 seconds to spawn the instance on the hypervisor.
Aug 09 16:39:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:39:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-d219e6ff-92e1-4209-95a7-9eedaee6160e req-208775a7-81d8-45c7-b377-d743d29ddb79 service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Received event network-vif-plugged-610fa224-8ef6-425c-9f3c-65ea46ab984b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:39:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d219e6ff-92e1-4209-95a7-9eedaee6160e req-208775a7-81d8-45c7-b377-d743d29ddb79 service nova] Acquiring lock "45447959-13b8-4cb4-aefd-8675ab284bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d219e6ff-92e1-4209-95a7-9eedaee6160e req-208775a7-81d8-45c7-b377-d743d29ddb79 service nova] Lock "45447959-13b8-4cb4-aefd-8675ab284bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d219e6ff-92e1-4209-95a7-9eedaee6160e req-208775a7-81d8-45c7-b377-d743d29ddb79 service nova] Lock "45447959-13b8-4cb4-aefd-8675ab284bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-d219e6ff-92e1-4209-95a7-9eedaee6160e req-208775a7-81d8-45c7-b377-d743d29ddb79 service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] No waiting events found dispatching network-vif-plugged-610fa224-8ef6-425c-9f3c-65ea46ab984b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:39:35 user nova-compute[73091]: WARNING nova.compute.manager [req-d219e6ff-92e1-4209-95a7-9eedaee6160e req-208775a7-81d8-45c7-b377-d743d29ddb79 service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Received unexpected event network-vif-plugged-610fa224-8ef6-425c-9f3c-65ea46ab984b for instance with vm_state building and task_state spawning.
Aug 09 16:39:35 user nova-compute[73091]: INFO nova.compute.manager [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Took 20.53 seconds to build instance.
Aug 09 16:39:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9f8bc223-fee8-43f5-a88f-461c3f7b5ce0 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "45447959-13b8-4cb4-aefd-8675ab284bb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.673s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:36 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599161.7091565, b43afe67-19e9-42b5-ba1b-f00b4aa56fc7 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:39:36 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] VM Stopped (Lifecycle Event)
Aug 09 16:39:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5720f82e-e87d-4636-a9a3-7a95b0952335 None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:39:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-747e74cc-6caa-434c-9e3c-cc64d15222e6 req-e1e57b83-a7bd-4336-b5e5-2bf453eb66ad service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Received event volume-reimaged-af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:39:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-747e74cc-6caa-434c-9e3c-cc64d15222e6 req-e1e57b83-a7bd-4336-b5e5-2bf453eb66ad service nova] Acquiring lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-747e74cc-6caa-434c-9e3c-cc64d15222e6 req-e1e57b83-a7bd-4336-b5e5-2bf453eb66ad service nova] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-747e74cc-6caa-434c-9e3c-cc64d15222e6 req-e1e57b83-a7bd-4336-b5e5-2bf453eb66ad service nova] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-747e74cc-6caa-434c-9e3c-cc64d15222e6 req-e1e57b83-a7bd-4336-b5e5-2bf453eb66ad service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Processing event volume-reimaged-af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 09 16:39:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:39:40 user nova-compute[73091]: INFO nova.virt.block_device [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Booting with volume af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd at /dev/vda
Aug 09 16:39:41 user nova-compute[73091]: DEBUG os_brick.utils [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:39:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3480357-5300-4b31-aa55-c53793ba1560]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c929b8-ba51-4ec1-b0d4-5066fe90d632]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3371eb8f-fb60-46a5-806a-566ab30a266f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b79cf36-7832-4b74-b9f5-6ef2a0cce48a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:39:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:39:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:39:41 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:39:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[073c126b-854d-48e7-bf93-e09f3bce05bb]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:39:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:39:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:39:41 user nova-compute[73091]: DEBUG os_brick.utils [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:39:41 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Updating existing volume attachment record: c411456b-ed0d-4f0e-8752-eb7754117a8d {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:39:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:48 user nova-compute[73091]: INFO nova.compute.manager [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Terminating instance
Aug 09 16:39:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-0b7c8a15-8d33-4005-97f7-893336aec0f0 req-9f3a405a-1d45-438f-9cf1-3a41cfe8129b service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received event network-vif-unplugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0b7c8a15-8d33-4005-97f7-893336aec0f0 req-9f3a405a-1d45-438f-9cf1-3a41cfe8129b service nova] Acquiring lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0b7c8a15-8d33-4005-97f7-893336aec0f0 req-9f3a405a-1d45-438f-9cf1-3a41cfe8129b service nova] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0b7c8a15-8d33-4005-97f7-893336aec0f0 req-9f3a405a-1d45-438f-9cf1-3a41cfe8129b service nova] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-0b7c8a15-8d33-4005-97f7-893336aec0f0 req-9f3a405a-1d45-438f-9cf1-3a41cfe8129b service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] No waiting events found dispatching network-vif-unplugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-0b7c8a15-8d33-4005-97f7-893336aec0f0 req-9f3a405a-1d45-438f-9cf1-3a41cfe8129b service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received event network-vif-unplugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:39:49 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Creating image(s)
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Ensure instance console log exists: /opt/stack/data/nova/instances/b43afe67-19e9-42b5-ba1b-f00b4aa56fc7/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Start _get_guest_xml network_info=[{"id": "a701119d-6f96-488f-ad0f-ea05c96e5268", "address": "fa:16:3e:32:fc:e5", "network": {"id": "e72f54ab-788d-4574-bf12-9fa76ea48145", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-414514792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb392d70735f4df8860e29e2ed4f114c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa701119d-6f", "ovs_interfaceid": "a701119d-6f96-488f-ad0f-ea05c96e5268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'c411456b-ed0d-4f0e-8752-eb7754117a8d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crBXfeax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b43afe67-19e9-42b5-ba1b-f00b4aa56fc7', 'attached_at': '', 'detached_at': '', 'volume_id': 'af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd', 'serial': 'af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:39:49 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 16:39:49 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.objects.instance [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lazy-loading 'vcpu_model' on Instance uuid b43afe67-19e9-42b5-ba1b-f00b4aa56fc7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crBXfeax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:39:49 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 16:39:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:39:49 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 16:39:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:39:49 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:39:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:49 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Instance destroyed successfully.
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'resources' on Instance uuid f3e2ea27-5fa4-4437-83d0-2eeda59506a9 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[517c0523-4073-4d05-87a0-942e46576e2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:39:49 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T16:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1616872134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1616872134',id=3,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAITbZ0bekUUaQcD9JG/a45LmgmiGDqXNdBL8us/+D3kEuK3lX64SC3DS9c5RvpZzIppm7AwxfGpJ8le2Ng0oRqLADK98z9cmOu+DwcKkC/ohl31CHyQco0JJV2LY0z1qQ==',key_name='tempest-keypair-2075151971',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:37:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8000a47d82748ce8d43d306682d62c6',ramdisk_id='',reservation_id='r-3yoej5re',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1451982310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1451982310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:37:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343ec5734ef547f292ee631dbb272359',uuid=f3e2ea27-5fa4-4437-83d0-2eeda59506a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converting VIF {"id": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "address": "fa:16:3e:dd:62:67", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93308f09-a0", "ovs_interfaceid": "93308f09-a0e7-49b6-8b29-dc0999acbfc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:62:67,bridge_name='br-int',has_traffic_filtering=True,id=93308f09-a0e7-49b6-8b29-dc0999acbfc1,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93308f09-a0') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG os_vif [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:62:67,bridge_name='br-int',has_traffic_filtering=True,id=93308f09-a0e7-49b6-8b29-dc0999acbfc1,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93308f09-a0') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a23b6b-9c0c-40eb-ab1f-f9d541639ae2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd] added
Aug 09 16:39:49 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93308f09-a0, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:39:49 user nova-compute[73091]: INFO os_vif [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:62:67,bridge_name='br-int',has_traffic_filtering=True,id=93308f09-a0e7-49b6-8b29-dc0999acbfc1,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93308f09-a0')
Aug 09 16:39:49 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Deleting instance files /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9_del
Aug 09 16:39:49 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Deletion of /opt/stack/data/nova/instances/f3e2ea27-5fa4-4437-83d0-2eeda59506a9_del complete
Aug 09 16:39:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9d4480-59e0-4275-a640-f021a9386b24]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[28002049-7aaf-48cd-8788-2f7abbaf8ad6]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v crBXfeax {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v crBXfeax" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b85af57-acf9-40ec-9ab4-01038962ce8a]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'crBXfeax'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:50 user nova-compute[73091]: INFO nova.compute.manager [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaf191e-1192-453f-8de5-8acb41e0b48a]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[40038c0f-7a19-4bda-8292-cfa089c5e4c4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:39:50 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:39:50 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dda795-ad16-4fbd-9d28-ebdd23565aa8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd, portal: 172.16.0.220,3260]
Aug 09 16:39:50 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd, portal: 172.16.0.220,3260] successful.
Aug 09 16:39:50 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e159ee4b-d1f5-459f-941b-0f9bc62fcfe5]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a741640c-4871-4b62-b06d-a8b1673316e2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:39:50 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:39:50 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:39:50 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:39:50 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.111s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd2e400-9019-4058-82b1-a5a476728f4a]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:39:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crBXfeax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:39:51 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Took 1.19 seconds to deallocate network for instance.
Aug 09 16:39:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '26165626232663665', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165626232663665', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T16:37:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1832276351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-795799594',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkZLgMs6m+7dg3Hs5GmhpEj7horlTD7kkT8Ur0MpazXAI51/Bo/IRROyxIbVDzm2mgAMl3z17iPI2mWhvCp8vxCgW/ifPXfNJE8PGmzhO69XbpdWA00iHhl3K8a22Tf2A==',key_name='tempest-keypair-1207467283',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:37:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cb392d70735f4df8860e29e2ed4f114c',ramdisk_id='',reservation_id='r-ixolz5ob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-24876138',owner_user_name='tempest-ServerActionsV293TestJSON-24876138-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:39:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8363e87670bc4cbe85d05285f4a29fc5',uuid=b43afe67-19e9-42b5-ba1b-f00b4aa56fc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a701119d-6f96-488f-ad0f-ea05c96e5268", "address": "fa:16:3e:32:fc:e5", "network": {"id": "e72f54ab-788d-4574-bf12-9fa76ea48145", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-414514792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb392d70735f4df8860e29e2ed4f114c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa701119d-6f", "ovs_interfaceid": "a701119d-6f96-488f-ad0f-ea05c96e5268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Converting VIF {"id": "a701119d-6f96-488f-ad0f-ea05c96e5268", "address": "fa:16:3e:32:fc:e5", "network": {"id": "e72f54ab-788d-4574-bf12-9fa76ea48145", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-414514792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb392d70735f4df8860e29e2ed4f114c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa701119d-6f", "ovs_interfaceid": "a701119d-6f96-488f-ad0f-ea05c96e5268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=a701119d-6f96-488f-ad0f-ea05c96e5268,network=Network(e72f54ab-788d-4574-bf12-9fa76ea48145),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa701119d-6f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:39:51 user nova-compute[73091]:   <uuid>b43afe67-19e9-42b5-ba1b-f00b4aa56fc7</uuid>
Aug 09 16:39:51 user nova-compute[73091]:   <name>instance-0000000e</name>
Aug 09 16:39:51 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:39:51 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:39:51 user nova-compute[73091]:   <metadata>
Aug 09 16:39:51 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:39:51 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:39:51 user nova-compute[73091]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1832276351</nova:name>
Aug 09 16:39:51 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:39:49</nova:creationTime>
Aug 09 16:39:51 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:39:51 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:39:51 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:39:51 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:39:51 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:39:51 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:39:51 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:39:51 user nova-compute[73091]:       <nova:owner>
Aug 09 16:39:51 user nova-compute[73091]:         <nova:user uuid="8363e87670bc4cbe85d05285f4a29fc5">tempest-ServerActionsV293TestJSON-24876138-project-member</nova:user>
Aug 09 16:39:51 user nova-compute[73091]:         <nova:project uuid="cb392d70735f4df8860e29e2ed4f114c">tempest-ServerActionsV293TestJSON-24876138</nova:project>
Aug 09 16:39:51 user nova-compute[73091]:       </nova:owner>
Aug 09 16:39:51 user nova-compute[73091]:       <nova:ports>
Aug 09 16:39:51 user nova-compute[73091]:         <nova:port uuid="a701119d-6f96-488f-ad0f-ea05c96e5268">
Aug 09 16:39:51 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 16:39:51 user nova-compute[73091]:         </nova:port>
Aug 09 16:39:51 user nova-compute[73091]:       </nova:ports>
Aug 09 16:39:51 user nova-compute[73091]:     </nova:instance>
Aug 09 16:39:51 user nova-compute[73091]:   </metadata>
Aug 09 16:39:51 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:39:51 user nova-compute[73091]:     <system>
Aug 09 16:39:51 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:39:51 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:39:51 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:39:51 user nova-compute[73091]:       <entry name="serial">b43afe67-19e9-42b5-ba1b-f00b4aa56fc7</entry>
Aug 09 16:39:51 user nova-compute[73091]:       <entry name="uuid">b43afe67-19e9-42b5-ba1b-f00b4aa56fc7</entry>
Aug 09 16:39:51 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:39:51 user nova-compute[73091]:     </system>
Aug 09 16:39:51 user nova-compute[73091]:   </sysinfo>
Aug 09 16:39:51 user nova-compute[73091]:   <os>
Aug 09 16:39:51 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:39:51 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:39:51 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:39:51 user nova-compute[73091]:   </os>
Aug 09 16:39:51 user nova-compute[73091]:   <features>
Aug 09 16:39:51 user nova-compute[73091]:     <acpi/>
Aug 09 16:39:51 user nova-compute[73091]:     <apic/>
Aug 09 16:39:51 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:39:51 user nova-compute[73091]:   </features>
Aug 09 16:39:51 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:39:51 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:39:51 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:39:51 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:39:51 user nova-compute[73091]:   </clock>
Aug 09 16:39:51 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:39:51 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:39:51 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:39:51 user nova-compute[73091]:   </cpu>
Aug 09 16:39:51 user nova-compute[73091]:   <devices>
Aug 09 16:39:51 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:39:51 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:39:51 user nova-compute[73091]:       <source dev="/dev/sdc"/>
Aug 09 16:39:51 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:39:51 user nova-compute[73091]:       <serial>af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd</serial>
Aug 09 16:39:51 user nova-compute[73091]:     </disk>
Aug 09 16:39:51 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:39:51 user nova-compute[73091]:       <mac address="fa:16:3e:32:fc:e5"/>
Aug 09 16:39:51 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:39:51 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:39:51 user nova-compute[73091]:       <target dev="tapa701119d-6f"/>
Aug 09 16:39:51 user nova-compute[73091]:     </interface>
Aug 09 16:39:51 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:39:51 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/b43afe67-19e9-42b5-ba1b-f00b4aa56fc7/console.log" append="off"/>
Aug 09 16:39:51 user nova-compute[73091]:     </serial>
Aug 09 16:39:51 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:39:51 user nova-compute[73091]:     <video>
Aug 09 16:39:51 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:39:51 user nova-compute[73091]:     </video>
Aug 09 16:39:51 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:39:51 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:39:51 user nova-compute[73091]:     </rng>
Aug 09 16:39:51 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:39:51 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:39:51 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:39:51 user nova-compute[73091]:     </memballoon>
Aug 09 16:39:51 user nova-compute[73091]:   </devices>
Aug 09 16:39:51 user nova-compute[73091]: </domain>
Aug 09 16:39:51 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T16:37:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1832276351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-795799594',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkZLgMs6m+7dg3Hs5GmhpEj7horlTD7kkT8Ur0MpazXAI51/Bo/IRROyxIbVDzm2mgAMl3z17iPI2mWhvCp8vxCgW/ifPXfNJE8PGmzhO69XbpdWA00iHhl3K8a22Tf2A==',key_name='tempest-keypair-1207467283',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:37:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cb392d70735f4df8860e29e2ed4f114c',ramdisk_id='',reservation_id='r-ixolz5ob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-24876138',owner_user_name='tempest-ServerActionsV293TestJSON-24876138-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:39:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8363e87670bc4cbe85d05285f4a29fc5',uuid=b43afe67-19e9-42b5-ba1b-f00b4aa56fc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a701119d-6f96-488f-ad0f-ea05c96e5268", "address": "fa:16:3e:32:fc:e5", "network": {"id": "e72f54ab-788d-4574-bf12-9fa76ea48145", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-414514792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb392d70735f4df8860e29e2ed4f114c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa701119d-6f", "ovs_interfaceid": "a701119d-6f96-488f-ad0f-ea05c96e5268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Converting VIF {"id": "a701119d-6f96-488f-ad0f-ea05c96e5268", "address": "fa:16:3e:32:fc:e5", "network": {"id": "e72f54ab-788d-4574-bf12-9fa76ea48145", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-414514792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb392d70735f4df8860e29e2ed4f114c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa701119d-6f", "ovs_interfaceid": "a701119d-6f96-488f-ad0f-ea05c96e5268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=a701119d-6f96-488f-ad0f-ea05c96e5268,network=Network(e72f54ab-788d-4574-bf12-9fa76ea48145),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa701119d-6f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG os_vif [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=a701119d-6f96-488f-ad0f-ea05c96e5268,network=Network(e72f54ab-788d-4574-bf12-9fa76ea48145),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa701119d-6f') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa701119d-6f, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa701119d-6f, col_values=(('external_ids', {'iface-id': 'a701119d-6f96-488f-ad0f-ea05c96e5268', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:fc:e5', 'vm-uuid': 'b43afe67-19e9-42b5-ba1b-f00b4aa56fc7'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:51 user nova-compute[73091]: INFO os_vif [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=a701119d-6f96-488f-ad0f-ea05c96e5268,network=Network(e72f54ab-788d-4574-bf12-9fa76ea48145),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa701119d-6f')
Aug 09 16:39:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-24e63759-edcd-4e72-b8dc-db1f11e78c2a req-3eb88229-2e5a-44ea-993a-d9329cfad9a7 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received event network-vif-plugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-24e63759-edcd-4e72-b8dc-db1f11e78c2a req-3eb88229-2e5a-44ea-993a-d9329cfad9a7 service nova] Acquiring lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-24e63759-edcd-4e72-b8dc-db1f11e78c2a req-3eb88229-2e5a-44ea-993a-d9329cfad9a7 service nova] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-24e63759-edcd-4e72-b8dc-db1f11e78c2a req-3eb88229-2e5a-44ea-993a-d9329cfad9a7 service nova] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-24e63759-edcd-4e72-b8dc-db1f11e78c2a req-3eb88229-2e5a-44ea-993a-d9329cfad9a7 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] No waiting events found dispatching network-vif-plugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:39:51 user nova-compute[73091]: WARNING nova.compute.manager [req-24e63759-edcd-4e72-b8dc-db1f11e78c2a req-3eb88229-2e5a-44ea-993a-d9329cfad9a7 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received unexpected event network-vif-plugged-93308f09-a0e7-49b6-8b29-dc0999acbfc1 for instance with vm_state deleted and task_state None.
Aug 09 16:39:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-24e63759-edcd-4e72-b8dc-db1f11e78c2a req-3eb88229-2e5a-44ea-993a-d9329cfad9a7 service nova] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Received event network-vif-deleted-93308f09-a0e7-49b6-8b29-dc0999acbfc1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] No VIF found with MAC fa:16:3e:32:fc:e5, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:39:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:52 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Deleted allocations for instance f3e2ea27-5fa4-4437-83d0-2eeda59506a9
Aug 09 16:39:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d30d9bef-65d5-47ec-b80d-1a0689fb77a0 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "f3e2ea27-5fa4-4437-83d0-2eeda59506a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.155s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-1875fc25-455e-40a6-bcf9-2d15edd93756 req-883d255e-02d4-4a6a-8a70-720d2efe2799 service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Received event network-vif-plugged-a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:39:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1875fc25-455e-40a6-bcf9-2d15edd93756 req-883d255e-02d4-4a6a-8a70-720d2efe2799 service nova] Acquiring lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1875fc25-455e-40a6-bcf9-2d15edd93756 req-883d255e-02d4-4a6a-8a70-720d2efe2799 service nova] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1875fc25-455e-40a6-bcf9-2d15edd93756 req-883d255e-02d4-4a6a-8a70-720d2efe2799 service nova] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-1875fc25-455e-40a6-bcf9-2d15edd93756 req-883d255e-02d4-4a6a-8a70-720d2efe2799 service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] No waiting events found dispatching network-vif-plugged-a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:39:52 user nova-compute[73091]: WARNING nova.compute.manager [req-1875fc25-455e-40a6-bcf9-2d15edd93756 req-883d255e-02d4-4a6a-8a70-720d2efe2799 service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Received unexpected event network-vif-plugged-a701119d-6f96-488f-ad0f-ea05c96e5268 for instance with vm_state active and task_state rebuild_spawning.
Aug 09 16:39:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:54 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599194.8805473, b43afe67-19e9-42b5-ba1b-f00b4aa56fc7 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:39:54 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] VM Resumed (Lifecycle Event)
Aug 09 16:39:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:39:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:39:54 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Instance spawned successfully.
Aug 09 16:39:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:39:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:39:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:39:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:39:54 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 16:39:54 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599194.882838, b43afe67-19e9-42b5-ba1b-f00b4aa56fc7 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:39:54 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] VM Started (Lifecycle Event)
Aug 09 16:39:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:39:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:39:54 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 16:39:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:39:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-faf00c5e-2f62-4792-a18c-d7a53708acaa req-6c2302ed-071e-4a9a-88e1-2267b4ce2ba0 service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Received event network-vif-plugged-a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:39:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-faf00c5e-2f62-4792-a18c-d7a53708acaa req-6c2302ed-071e-4a9a-88e1-2267b4ce2ba0 service nova] Acquiring lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-faf00c5e-2f62-4792-a18c-d7a53708acaa req-6c2302ed-071e-4a9a-88e1-2267b4ce2ba0 service nova] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-faf00c5e-2f62-4792-a18c-d7a53708acaa req-6c2302ed-071e-4a9a-88e1-2267b4ce2ba0 service nova] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-faf00c5e-2f62-4792-a18c-d7a53708acaa req-6c2302ed-071e-4a9a-88e1-2267b4ce2ba0 service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] No waiting events found dispatching network-vif-plugged-a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:39:55 user nova-compute[73091]: WARNING nova.compute.manager [req-faf00c5e-2f62-4792-a18c-d7a53708acaa req-6c2302ed-071e-4a9a-88e1-2267b4ce2ba0 service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Received unexpected event network-vif-plugged-a701119d-6f96-488f-ad0f-ea05c96e5268 for instance with vm_state active and task_state rebuild_spawning.
Aug 09 16:39:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:39:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:39:55 user nova-compute[73091]: DEBUG nova.objects.instance [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73091) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 16:39:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-747e74cc-6caa-434c-9e3c-cc64d15222e6 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.069s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:39:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:39:58 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:39:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:40:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:40:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-c9cca9cd-a582-4fb4-b45d-af528c91a32a req-fc0b2c9e-3c91-4075-8946-7d08781de135 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received event network-changed-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:40:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-c9cca9cd-a582-4fb4-b45d-af528c91a32a req-fc0b2c9e-3c91-4075-8946-7d08781de135 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Refreshing instance network info cache due to event network-changed-93d41bee-7cab-45a7-b409-dd19fc3b88b6. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:40:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9cca9cd-a582-4fb4-b45d-af528c91a32a req-fc0b2c9e-3c91-4075-8946-7d08781de135 service nova] Acquiring lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:40:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9cca9cd-a582-4fb4-b45d-af528c91a32a req-fc0b2c9e-3c91-4075-8946-7d08781de135 service nova] Acquired lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:40:01 user nova-compute[73091]: DEBUG nova.network.neutron [req-c9cca9cd-a582-4fb4-b45d-af528c91a32a req-fc0b2c9e-3c91-4075-8946-7d08781de135 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Refreshing network info cache for port 93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:40:02 user nova-compute[73091]: DEBUG nova.network.neutron [req-c9cca9cd-a582-4fb4-b45d-af528c91a32a req-fc0b2c9e-3c91-4075-8946-7d08781de135 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Updated VIF entry in instance network info cache for port 93d41bee-7cab-45a7-b409-dd19fc3b88b6. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:40:02 user nova-compute[73091]: DEBUG nova.network.neutron [req-c9cca9cd-a582-4fb4-b45d-af528c91a32a req-fc0b2c9e-3c91-4075-8946-7d08781de135 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Updating instance_info_cache with network_info: [{"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:40:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9cca9cd-a582-4fb4-b45d-af528c91a32a req-fc0b2c9e-3c91-4075-8946-7d08781de135 service nova] Releasing lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:40:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:04 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:40:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:40:04 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599189.8444386, f3e2ea27-5fa4-4437-83d0-2eeda59506a9 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:40:04 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] VM Stopped (Lifecycle Event)
Aug 09 16:40:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ffeec55b-f839-4f30-9bdc-35c3911ed0d5 None None] [instance: f3e2ea27-5fa4-4437-83d0-2eeda59506a9] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:40:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:40:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:40:05 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:40:05 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Updating instance_info_cache with network_info: [{"id": "a701119d-6f96-488f-ad0f-ea05c96e5268", "address": "fa:16:3e:32:fc:e5", "network": {"id": "e72f54ab-788d-4574-bf12-9fa76ea48145", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-414514792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb392d70735f4df8860e29e2ed4f114c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa701119d-6f", "ovs_interfaceid": "a701119d-6f96-488f-ad0f-ea05c96e5268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:40:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:40:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:40:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:40:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:40:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:06 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:40:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-fca663cd-edbe-4bf6-b4f4-f3f40e09a663 req-2a7e6877-9e26-4379-b43d-730d0cd869ee service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Received event network-changed-c79746b9-c9d0-4f25-8934-f7f10a46f558 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:40:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-fca663cd-edbe-4bf6-b4f4-f3f40e09a663 req-2a7e6877-9e26-4379-b43d-730d0cd869ee service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Refreshing instance network info cache due to event network-changed-c79746b9-c9d0-4f25-8934-f7f10a46f558. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:40:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fca663cd-edbe-4bf6-b4f4-f3f40e09a663 req-2a7e6877-9e26-4379-b43d-730d0cd869ee service nova] Acquiring lock "refresh_cache-93e10fd4-8841-4043-b4e2-7489c4dea3e6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:40:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fca663cd-edbe-4bf6-b4f4-f3f40e09a663 req-2a7e6877-9e26-4379-b43d-730d0cd869ee service nova] Acquired lock "refresh_cache-93e10fd4-8841-4043-b4e2-7489c4dea3e6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:40:07 user nova-compute[73091]: DEBUG nova.network.neutron [req-fca663cd-edbe-4bf6-b4f4-f3f40e09a663 req-2a7e6877-9e26-4379-b43d-730d0cd869ee service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Refreshing network info cache for port c79746b9-c9d0-4f25-8934-f7f10a46f558 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:40:08 user nova-compute[73091]: DEBUG nova.network.neutron [req-fca663cd-edbe-4bf6-b4f4-f3f40e09a663 req-2a7e6877-9e26-4379-b43d-730d0cd869ee service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Updated VIF entry in instance network info cache for port c79746b9-c9d0-4f25-8934-f7f10a46f558. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:40:08 user nova-compute[73091]: DEBUG nova.network.neutron [req-fca663cd-edbe-4bf6-b4f4-f3f40e09a663 req-2a7e6877-9e26-4379-b43d-730d0cd869ee service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Updating instance_info_cache with network_info: [{"id": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "address": "fa:16:3e:0b:7a:ff", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79746b9-c9", "ovs_interfaceid": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:40:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fca663cd-edbe-4bf6-b4f4-f3f40e09a663 req-2a7e6877-9e26-4379-b43d-730d0cd869ee service nova] Releasing lock "refresh_cache-93e10fd4-8841-4043-b4e2-7489c4dea3e6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:40:08 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:40:08 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:40:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:40:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:09 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:40:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:40:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:40:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-3d50aeae-7752-4642-9801-341ad376014a req-013a6825-e350-4cb5-9976-92b4db1af1ea service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received event network-changed-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:40:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-3d50aeae-7752-4642-9801-341ad376014a req-013a6825-e350-4cb5-9976-92b4db1af1ea service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Refreshing instance network info cache due to event network-changed-50f0d7f2-7e34-475a-9d69-145a0e321400. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:40:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3d50aeae-7752-4642-9801-341ad376014a req-013a6825-e350-4cb5-9976-92b4db1af1ea service nova] Acquiring lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:40:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3d50aeae-7752-4642-9801-341ad376014a req-013a6825-e350-4cb5-9976-92b4db1af1ea service nova] Acquired lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:40:12 user nova-compute[73091]: DEBUG nova.network.neutron [req-3d50aeae-7752-4642-9801-341ad376014a req-013a6825-e350-4cb5-9976-92b4db1af1ea service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Refreshing network info cache for port 50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:40:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:13 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:40:13 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7134MB free_disk=25.482242584228516GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.objects.instance [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lazy-loading 'flavor' on Instance uuid 93e10fd4-8841-4043-b4e2-7489c4dea3e6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance b43afe67-19e9-42b5-ba1b-f00b4aa56fc7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 68d63bc2-d726-49d8-91de-bc5cc66bb119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 93e10fd4-8841-4043-b4e2-7489c4dea3e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 38051bca-7190-4dff-91d1-3d99b4e4182b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 37428447-3a47-4598-aa09-ee4019e0f193 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f939fe27-017a-481e-babc-147bf98e0132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8fc884a8-24bb-488a-baeb-ef2b1faf239d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 45447959-13b8-4cb4-aefd-8675ab284bb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:13 user nova-compute[73091]: INFO nova.compute.manager [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Attaching volume ddc0a5bd-b8d9-418b-9c65-fb76852e446c to /dev/vdb
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.network.neutron [req-3d50aeae-7752-4642-9801-341ad376014a req-013a6825-e350-4cb5-9976-92b4db1af1ea service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Updated VIF entry in instance network info cache for port 50f0d7f2-7e34-475a-9d69-145a0e321400. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.network.neutron [req-3d50aeae-7752-4642-9801-341ad376014a req-013a6825-e350-4cb5-9976-92b4db1af1ea service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Updating instance_info_cache with network_info: [{"id": "50f0d7f2-7e34-475a-9d69-145a0e321400", "address": "fa:16:3e:25:e0:ab", "network": {"id": "5868d9d5-2152-496d-93e2-8e1308b2ad18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d65ef533e7c145faae7d9af3815007ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0d7f2-7e", "ovs_interfaceid": "50f0d7f2-7e34-475a-9d69-145a0e321400", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3d50aeae-7752-4642-9801-341ad376014a req-013a6825-e350-4cb5-9976-92b4db1af1ea service nova] Releasing lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG os_brick.utils [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cb2820-71c2-4d0a-971b-20fe8d0a8f2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e19b20-c677-450d-baee-c04931a10066]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:13 user nova-compute[73091]: INFO nova.compute.manager [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] instance snapshotting
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf857c00-cfb9-493a-a60f-2c65c87e05bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b298f33-57c7-4eae-a078-29c65a687826]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:40:13 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[40aeb07e-bbd8-4109-ae81-62ee63bea11f]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG os_brick.utils [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Updating existing volume attachment record: 513cb73d-2eeb-4550-8053-54f602dc4624 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:40:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Beginning live snapshot process
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.557s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json -f qcow2" returned: 0 in 0.135s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.166s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_ee3weui/146d2e4263264c0f86b28e336a72925d.delta 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_ee3weui/146d2e4263264c0f86b28e336a72925d.delta 1073741824" returned: 0 in 0.050s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 16:40:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:40:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:40:15 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 16:40:15 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 16:40:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_ee3weui/146d2e4263264c0f86b28e336a72925d.delta /opt/stack/data/nova/instances/snapshots/tmp_ee3weui/146d2e4263264c0f86b28e336a72925d {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_ee3weui/146d2e4263264c0f86b28e336a72925d.delta /opt/stack/data/nova/instances/snapshots/tmp_ee3weui/146d2e4263264c0f86b28e336a72925d" returned: 0 in 0.764s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Snapshot extracted, beginning image upload
Aug 09 16:40:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:18 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Snapshot image upload complete
Aug 09 16:40:18 user nova-compute[73091]: INFO nova.compute.manager [None req-d2ba8c94-aab0-4ad7-a577-6229aa530e06 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Took 5.41 seconds to snapshot the instance on the hypervisor.
Aug 09 16:40:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:40:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zYiRQVPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:40:21 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:40:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:40:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:40:21 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:40:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:40:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:40:21 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:40:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[148dbf3c-09a4-4bff-83f5-d06e09cb5575]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:40:21 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e27be7e-829e-4e53-98b5-bfe114c0e4fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c] added
Aug 09 16:40:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6019bf0-2d88-4ee6-b68b-7f4cb5a97b7e]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2009d889-1453-47d0-875c-98461a527303]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zYiRQVPU {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zYiRQVPU" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c8d38e-e3ac-4bbe-823e-cbe0ab816bc6]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zYiRQVPU'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[506b7e31-b57e-48e1-ba05-893da1e06b13]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3697c9ed-daba-4972-a92b-70f17b92a79b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:40:22 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:40:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:40:22 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:40:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[baec3171-fa94-4da5-aadd-960261a269ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c, portal: 172.16.0.220,3260]
Aug 09 16:40:22 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c, portal: 172.16.0.220,3260] successful.
Aug 09 16:40:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dfa63f-e9f8-4a40-a114-06875c590e7f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[131cfef9-f604-4b01-8dcc-a5411617560c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:40:22 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:40:22 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c (non-flash)
Aug 09 16:40:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:40:22 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:40:22 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c (non-flash)
Aug 09 16:40:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9554bbe5-76cd-4aa7-9e0a-691d87105fa3]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:40:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zYiRQVPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:40:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:40:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23838363038663334', 'path': '/dev/sdd'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:40:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838363038663334', 'path': '/dev/sdd'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:40:23 user nova-compute[73091]: DEBUG nova.objects.instance [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lazy-loading 'flavor' on Instance uuid 93e10fd4-8841-4043-b4e2-7489c4dea3e6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:40:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:40:23 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:40:23 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 09 16:40:23 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:40:23 user nova-compute[73091]:   <serial>ddc0a5bd-b8d9-418b-9c65-fb76852e446c</serial>
Aug 09 16:40:23 user nova-compute[73091]: </disk>
Aug 09 16:40:23 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:40:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:40:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:40:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] No VIF found with MAC fa:16:3e:0b:7a:ff, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:40:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0ab0553d-3e47-4670-86d1-ef168950869d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.660s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:24 user nova-compute[73091]: INFO nova.compute.manager [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Detaching volume ddc0a5bd-b8d9-418b-9c65-fb76852e446c
Aug 09 16:40:24 user nova-compute[73091]: INFO nova.virt.block_device [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Attempting to driver detach volume ddc0a5bd-b8d9-418b-9c65-fb76852e446c from mountpoint /dev/vdb
Aug 09 16:40:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Attempting to detach device vdb from instance 93e10fd4-8841-4043-b4e2-7489c4dea3e6 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:40:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:40:24 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:40:24 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 09 16:40:24 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:40:24 user nova-compute[73091]:   <serial>ddc0a5bd-b8d9-418b-9c65-fb76852e446c</serial>
Aug 09 16:40:24 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:40:24 user nova-compute[73091]: </disk>
Aug 09 16:40:24 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:40:24 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Successfully detached device vdb from instance 93e10fd4-8841-4043-b4e2-7489c4dea3e6 from the persistent domain config.
Aug 09 16:40:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 93e10fd4-8841-4043-b4e2-7489c4dea3e6 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:40:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:40:24 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:40:24 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 09 16:40:24 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:40:24 user nova-compute[73091]:   <serial>ddc0a5bd-b8d9-418b-9c65-fb76852e446c</serial>
Aug 09 16:40:24 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:40:24 user nova-compute[73091]: </disk>
Aug 09 16:40:24 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:40:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691599225.074388, 93e10fd4-8841-4043-b4e2-7489c4dea3e6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 93e10fd4-8841-4043-b4e2-7489c4dea3e6 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:40:25 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Successfully detached device vdb from instance 93e10fd4-8841-4043-b4e2-7489c4dea3e6 from the live domain config.
Aug 09 16:40:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zYiRQVPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:40:25 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:40:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9881bce3-3896-407e-9923-07ab88cc4094]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf1b6c1-2ad4-4d1f-93ae-7c97104246a6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:40:25 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:40:25 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c (non-flash)
Aug 09 16:40:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:40:25 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:40:25 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c (non-flash)
Aug 09 16:40:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff08d55c310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c'): ({'sdd'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Removing single pathed devices sdd {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a587f7e5-dc84-484e-9d8a-6957fbb10430]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adb1797-44e9-4c4c-bbc0-761c3bd60b68]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Flushing IO for device /dev/sdd {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0dcf29-41f1-4e58-a90b-5e68dd4c4cea]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[620d4de5-772c-410d-9e57-eadf826a5990]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bdc67c-37ad-4ccd-bc96-9dde26fe926f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdbfcff-ec7d-4f02-b222-d4d22ffbeacb]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c, portal: 172.16.0.220,3260]
Aug 09 16:40:25 user nova-compute[73091]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c, portal: 172.16.0.220,3260] successful.
Aug 09 16:40:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddc0a5bd-b8d9-418b-9c65-fb76852e446c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e7dc34-ac27-4345-bcfb-301164b9bf09]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] <== disconnect_volume: return (297ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:40:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:40:26 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lazy-loading 'flavor' on Instance uuid 93e10fd4-8841-4043-b4e2-7489c4dea3e6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:40:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5010a198-eed9-44cb-8eef-0eed2428dfff tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.652s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lazy-loading 'flavor' on Instance uuid 18d8e887-0f91-42e1-ba79-13db5aa9b84b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:27 user nova-compute[73091]: INFO nova.compute.manager [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Attaching volume 236f66cb-c459-4991-8bd4-04b9f070e374 to /dev/vdb
Aug 09 16:40:27 user nova-compute[73091]: DEBUG os_brick.utils [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab699be9-8b0b-41bc-a2cf-b80ce9b9ff9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[518d0ab4-de58-411a-8d04-7e6dd2a79c1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f638b0b-9ed3-4410-aa90-4ae1d6e1f3ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3ed0da-5b12-4087-a0e9-e49c8f8a37ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:40:27 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:40:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a777bced-1a21-4821-8aae-d01ade9a78d2]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG os_brick.utils [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:40:27 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Updating existing volume attachment record: ec318748-c9f5-48b0-838d-238b7d6ee2b3 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:40:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfwOMhCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:40:36 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:40:36 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:40:36 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c8d89f-019c-4954-a325-d161a7d9baa7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:40:36 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[702b9e0f-e6c5-4556-b1e1-cca8a3527e28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374] added
Aug 09 16:40:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf8c35f-d667-4ce3-afe6-028715351582]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea42c8ee-c9ab-4486-97fd-efc5e76a49d9]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfwOMhCH {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfwOMhCH" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f71ba2-c8a9-4dae-a44a-419359123acc]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DfwOMhCH'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a04ec7-9498-4dae-ab96-c120a2cc4c13]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[152970bc-bf93-4d22-8f97-3561908297e0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:40:36 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:40:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:40:36 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:40:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba3bb3d-4d19-4525-99aa-eefc4f904d2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374, portal: 172.16.0.220,3260]
Aug 09 16:40:36 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374, portal: 172.16.0.220,3260] successful.
Aug 09 16:40:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ceba71a-bc81-4423-a5f1-022c46527ea6]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0158b21c-5aac-4f26-9a4d-5c0b0606641f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:40:36 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:40:36 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:40:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:40:36 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:40:36 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:40:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b25f97-16d2-4fbf-b1c0-9e0d3264c417]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:40:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfwOMhCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:40:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:40:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26564666161326630', 'path': '/dev/sdd'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:40:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564666161326630', 'path': '/dev/sdd'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:40:37 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lazy-loading 'flavor' on Instance uuid 18d8e887-0f91-42e1-ba79-13db5aa9b84b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:40:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:40:37 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:40:37 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 09 16:40:37 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:40:37 user nova-compute[73091]:   <serial>236f66cb-c459-4991-8bd4-04b9f070e374</serial>
Aug 09 16:40:37 user nova-compute[73091]: </disk>
Aug 09 16:40:37 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:40:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:40:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:40:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] No VIF found with MAC fa:16:3e:45:c1:ba, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:40:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b5ae0e7a-bb65-4324-b159-e3964f2cb30f tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.418s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:39 user nova-compute[73091]: INFO nova.compute.manager [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Rebuilding instance
Aug 09 16:40:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lazy-loading 'trusted_certs' on Instance uuid 18d8e887-0f91-42e1-ba79-13db5aa9b84b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:40:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:40:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lazy-loading 'pci_requests' on Instance uuid 18d8e887-0f91-42e1-ba79-13db5aa9b84b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:40:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lazy-loading 'pci_devices' on Instance uuid 18d8e887-0f91-42e1-ba79-13db5aa9b84b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:40:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lazy-loading 'resources' on Instance uuid 18d8e887-0f91-42e1-ba79-13db5aa9b84b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:40:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lazy-loading 'migration_context' on Instance uuid 18d8e887-0f91-42e1-ba79-13db5aa9b84b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:40:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73091) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 16:40:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-561d6cbf-8549-4b31-9c6b-c8a6ec21612e req-56383882-131d-4770-9bdd-5de75cf92642 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Received event network-vif-unplugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:40:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-561d6cbf-8549-4b31-9c6b-c8a6ec21612e req-56383882-131d-4770-9bdd-5de75cf92642 service nova] Acquiring lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-561d6cbf-8549-4b31-9c6b-c8a6ec21612e req-56383882-131d-4770-9bdd-5de75cf92642 service nova] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-561d6cbf-8549-4b31-9c6b-c8a6ec21612e req-56383882-131d-4770-9bdd-5de75cf92642 service nova] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-561d6cbf-8549-4b31-9c6b-c8a6ec21612e req-56383882-131d-4770-9bdd-5de75cf92642 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] No waiting events found dispatching network-vif-unplugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:40:39 user nova-compute[73091]: WARNING nova.compute.manager [req-561d6cbf-8549-4b31-9c6b-c8a6ec21612e req-56383882-131d-4770-9bdd-5de75cf92642 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Received unexpected event network-vif-unplugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 for instance with vm_state active and task_state rebuilding.
Aug 09 16:40:40 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Instance destroyed successfully.
Aug 09 16:40:40 user nova-compute[73091]: INFO nova.compute.manager [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Detaching volume 236f66cb-c459-4991-8bd4-04b9f070e374
Aug 09 16:40:40 user nova-compute[73091]: INFO nova.virt.block_device [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Attempting to driver detach volume 236f66cb-c459-4991-8bd4-04b9f070e374 from mountpoint /dev/vdb
Aug 09 16:40:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Attempting to detach device vdb from instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:40:40 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:40:40 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 09 16:40:40 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:40:40 user nova-compute[73091]:   <serial>236f66cb-c459-4991-8bd4-04b9f070e374</serial>
Aug 09 16:40:40 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:40:40 user nova-compute[73091]: </disk>
Aug 09 16:40:40 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:40:40 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Successfully detached device vdb from instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b from the persistent domain config.
Aug 09 16:40:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfwOMhCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:40:40 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 16:40:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ffa80d-97d7-43a4-86ec-849d28dcac28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa5bf34-2db4-4859-8d79-7ed32535014f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:40:40 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:40:40 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:40:40 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:40:40 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:40:40 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:40:40 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff08032b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374'): ({'sdd'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Removing single pathed devices sdd {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aaf0838-8b83-468f-94b6-83accfb305f9]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da32295-da69-44af-949c-616ee8803261]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Flushing IO for device /dev/sdd {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[735e8f91-b8b7-474c-bc8c-05b72d488e62]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[32188402-9197-4961-9e33-78b870a34b95]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3917f05-97e2-4115-aa06-8a9708a41761]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[79777436-6ee9-41c2-bf30-b4d5c777669f]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374, portal: 172.16.0.220,3260]
Aug 09 16:40:40 user nova-compute[73091]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374, portal: 172.16.0.220,3260] successful.
Aug 09 16:40:40 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9394b602-fd3e-4c78-8cde-cc0c1c364534]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] <== disconnect_volume: return (337ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:40:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:41 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Instance destroyed successfully.
Aug 09 16:40:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:36:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1364187165',display_name='tempest-ServerActionsTestOtherA-server-1013159509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1364187165',id=13,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILfado63mW6+CgjHmwYiNct4RkaQ/hFrQzjzGZX9fcd5tmDChxbl9riU31kjgrW3xhMcxzy/FY8sPsumtyuqQ7ittcRZasxYBvL6XWrt/5jr8BpeJz8IvTq6jqpzExzYw==',key_name='tempest-keypair-1434010925',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='38c913ceef2c4610a26bd19df29ee896',ramdisk_id='',reservation_id='r-m5ng6wc3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-813213856',owner_user_name='tempest-ServerActionsTestOtherA-813213856-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:40:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8956fad221ec4dedb700f034d5230c06',uuid=18d8e887-0f91-42e1-ba79-13db5aa9b84b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converting VIF {"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:c1:ba,bridge_name='br-int',has_traffic_filtering=True,id=54c1bb8c-584f-446c-9b64-c840c486a4f1,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c1bb8c-58') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG os_vif [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:c1:ba,bridge_name='br-int',has_traffic_filtering=True,id=54c1bb8c-584f-446c-9b64-c840c486a4f1,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c1bb8c-58') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54c1bb8c-58, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:40:41 user nova-compute[73091]: INFO os_vif [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:c1:ba,bridge_name='br-int',has_traffic_filtering=True,id=54c1bb8c-584f-446c-9b64-c840c486a4f1,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c1bb8c-58')
Aug 09 16:40:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfwOMhCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:40:41 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 16:40:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[194b3cf3-545f-4443-b2f2-d861e76af9a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1971db3c-b70d-4684-809b-fbab98596f96]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:40:41 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:40:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:40:41 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:40:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff060255a20>, {}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Disconnecting from: [] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.052s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] <== disconnect_volume: return (53ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:40:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:40:41 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Deleting instance files /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b_del
Aug 09 16:40:41 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Deletion of /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b_del complete
Aug 09 16:40:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-2fca5f21-f478-4b13-b476-2ed9c6b9b5c5 req-2abb33bb-5a69-40ad-ae34-37d4ddcf8c89 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Received event network-vif-plugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2fca5f21-f478-4b13-b476-2ed9c6b9b5c5 req-2abb33bb-5a69-40ad-ae34-37d4ddcf8c89 service nova] Acquiring lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2fca5f21-f478-4b13-b476-2ed9c6b9b5c5 req-2abb33bb-5a69-40ad-ae34-37d4ddcf8c89 service nova] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2fca5f21-f478-4b13-b476-2ed9c6b9b5c5 req-2abb33bb-5a69-40ad-ae34-37d4ddcf8c89 service nova] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-2fca5f21-f478-4b13-b476-2ed9c6b9b5c5 req-2abb33bb-5a69-40ad-ae34-37d4ddcf8c89 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] No waiting events found dispatching network-vif-plugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:40:42 user nova-compute[73091]: WARNING nova.compute.manager [req-2fca5f21-f478-4b13-b476-2ed9c6b9b5c5 req-2abb33bb-5a69-40ad-ae34-37d4ddcf8c89 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Received unexpected event network-vif-plugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 for instance with vm_state active and task_state rebuilding.
Aug 09 16:40:42 user nova-compute[73091]: INFO nova.virt.block_device [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Booting with volume 236f66cb-c459-4991-8bd4-04b9f070e374 at /dev/vdb
Aug 09 16:40:42 user nova-compute[73091]: DEBUG os_brick.utils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8935a53-88c1-4075-8c63-01e2effabc05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af8c85a-ae5b-4333-964a-de8c188064e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[571d81f4-f051-47b7-bd5f-5edac7ba5723]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a6a846-9d6d-4705-ba2d-33b15be87bf3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:40:42 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:40:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0494c381-f8fc-4f06-ad28-7edf22ce9a35]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG os_brick.utils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:40:42 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Updating existing volume attachment record: 8d2c6c9e-f81f-4839-98a1-39d4dabab163 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:40:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Acquiring lock "37428447-3a47-4598-aa09-ee4019e0f193" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "37428447-3a47-4598-aa09-ee4019e0f193" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Acquiring lock "37428447-3a47-4598-aa09-ee4019e0f193-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "37428447-3a47-4598-aa09-ee4019e0f193-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "37428447-3a47-4598-aa09-ee4019e0f193-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:43 user nova-compute[73091]: INFO nova.compute.manager [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Terminating instance
Aug 09 16:40:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:40:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "e03ff609-e74d-427d-b6e6-109fbee09e40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:40:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:40:43 user nova-compute[73091]: INFO nova.compute.claims [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Claim successful on node user
Aug 09 16:40:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-74fe078a-5d55-40cc-9545-c863cfb93a9a req-28782fb9-f52b-49a3-9b3d-91edc3861579 service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Received event network-vif-unplugged-9d24e3ae-7181-4507-a0ba-43657ee1ff71 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-74fe078a-5d55-40cc-9545-c863cfb93a9a req-28782fb9-f52b-49a3-9b3d-91edc3861579 service nova] Acquiring lock "37428447-3a47-4598-aa09-ee4019e0f193-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-74fe078a-5d55-40cc-9545-c863cfb93a9a req-28782fb9-f52b-49a3-9b3d-91edc3861579 service nova] Lock "37428447-3a47-4598-aa09-ee4019e0f193-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-74fe078a-5d55-40cc-9545-c863cfb93a9a req-28782fb9-f52b-49a3-9b3d-91edc3861579 service nova] Lock "37428447-3a47-4598-aa09-ee4019e0f193-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-74fe078a-5d55-40cc-9545-c863cfb93a9a req-28782fb9-f52b-49a3-9b3d-91edc3861579 service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] No waiting events found dispatching network-vif-unplugged-9d24e3ae-7181-4507-a0ba-43657ee1ff71 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-74fe078a-5d55-40cc-9545-c863cfb93a9a req-28782fb9-f52b-49a3-9b3d-91edc3861579 service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Received event network-vif-unplugged-9d24e3ae-7181-4507-a0ba-43657ee1ff71 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:40:44 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Instance destroyed successfully.
Aug 09 16:40:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lazy-loading 'resources' on Instance uuid 37428447-3a47-4598-aa09-ee4019e0f193 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1547715163',display_name='tempest-VolumesActionsTest-instance-1547715163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1547715163',id=18,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:39:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4c24350e3214cfe89b2a4e2f1298121',ramdisk_id='',reservation_id='r-dgluis1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1284523061',owner_user_name='tempest-VolumesActionsTest-1284523061-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:39:02Z,user_data=None,user_id='54214e99474245ff8c66816e1a103260',uuid=37428447-3a47-4598-aa09-ee4019e0f193,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d24e3ae-7181-4507-a0ba-43657ee1ff71", "address": "fa:16:3e:aa:26:57", "network": {"id": "5bae1654-cc49-420b-ab90-299d2f87c8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-433837263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c24350e3214cfe89b2a4e2f1298121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e3ae-71", "ovs_interfaceid": "9d24e3ae-7181-4507-a0ba-43657ee1ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Converting VIF {"id": "9d24e3ae-7181-4507-a0ba-43657ee1ff71", "address": "fa:16:3e:aa:26:57", "network": {"id": "5bae1654-cc49-420b-ab90-299d2f87c8c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-433837263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4c24350e3214cfe89b2a4e2f1298121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d24e3ae-71", "ovs_interfaceid": "9d24e3ae-7181-4507-a0ba-43657ee1ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:26:57,bridge_name='br-int',has_traffic_filtering=True,id=9d24e3ae-7181-4507-a0ba-43657ee1ff71,network=Network(5bae1654-cc49-420b-ab90-299d2f87c8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d24e3ae-71') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG os_vif [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:26:57,bridge_name='br-int',has_traffic_filtering=True,id=9d24e3ae-7181-4507-a0ba-43657ee1ff71,network=Network(5bae1654-cc49-420b-ab90-299d2f87c8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d24e3ae-71') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d24e3ae-71, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:40:44 user nova-compute[73091]: INFO os_vif [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:26:57,bridge_name='br-int',has_traffic_filtering=True,id=9d24e3ae-7181-4507-a0ba-43657ee1ff71,network=Network(5bae1654-cc49-420b-ab90-299d2f87c8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d24e3ae-71')
Aug 09 16:40:44 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Deleting instance files /opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193_del
Aug 09 16:40:44 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Deletion of /opt/stack/data/nova/instances/37428447-3a47-4598-aa09-ee4019e0f193_del complete
Aug 09 16:40:44 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:40:44 user nova-compute[73091]: INFO nova.compute.manager [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 09 16:40:44 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.708s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:40:44 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:40:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG nova.policy [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '343ec5734ef547f292ee631dbb272359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8000a47d82748ce8d43d306682d62c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:40:44 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Creating image(s)
Aug 09 16:40:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "/opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "/opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "/opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.150s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.152s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk 1073741824" returned: 0 in 0.065s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-c2f4e01a-f9ef-4761-8319-1ab3bc17a11e req-cb331b57-cb2e-4837-8b06-bc1d72170f33 service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Received event network-vif-deleted-9d24e3ae-7181-4507-a0ba-43657ee1ff71 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:40:45 user nova-compute[73091]: INFO nova.compute.manager [req-c2f4e01a-f9ef-4761-8319-1ab3bc17a11e req-cb331b57-cb2e-4837-8b06-bc1d72170f33 service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Neutron deleted interface 9d24e3ae-7181-4507-a0ba-43657ee1ff71; detaching it from the instance and deleting it from the info cache
Aug 09 16:40:45 user nova-compute[73091]: DEBUG nova.network.neutron [req-c2f4e01a-f9ef-4761-8319-1ab3bc17a11e req-cb331b57-cb2e-4837-8b06-bc1d72170f33 service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:40:45 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Took 0.79 seconds to deallocate network for instance.
Aug 09 16:40:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-c2f4e01a-f9ef-4761-8319-1ab3bc17a11e req-cb331b57-cb2e-4837-8b06-bc1d72170f33 service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Detach interface failed, port_id=9d24e3ae-7181-4507-a0ba-43657ee1ff71, reason: Instance 37428447-3a47-4598-aa09-ee4019e0f193 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Successfully created port: 78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Cannot resize image /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG nova.objects.instance [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'migration_context' on Instance uuid e03ff609-e74d-427d-b6e6-109fbee09e40 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Ensure instance console log exists: /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:40:45 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:46 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Deleted allocations for instance 37428447-3a47-4598-aa09-ee4019e0f193
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-dcb53be1-5dc9-468f-906f-e0a23eeeab94 req-419b195b-b93b-43f3-8457-965a38d16805 service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Received event network-vif-plugged-9d24e3ae-7181-4507-a0ba-43657ee1ff71 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dcb53be1-5dc9-468f-906f-e0a23eeeab94 req-419b195b-b93b-43f3-8457-965a38d16805 service nova] Acquiring lock "37428447-3a47-4598-aa09-ee4019e0f193-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dcb53be1-5dc9-468f-906f-e0a23eeeab94 req-419b195b-b93b-43f3-8457-965a38d16805 service nova] Lock "37428447-3a47-4598-aa09-ee4019e0f193-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dcb53be1-5dc9-468f-906f-e0a23eeeab94 req-419b195b-b93b-43f3-8457-965a38d16805 service nova] Lock "37428447-3a47-4598-aa09-ee4019e0f193-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-dcb53be1-5dc9-468f-906f-e0a23eeeab94 req-419b195b-b93b-43f3-8457-965a38d16805 service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] No waiting events found dispatching network-vif-plugged-9d24e3ae-7181-4507-a0ba-43657ee1ff71 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:40:46 user nova-compute[73091]: WARNING nova.compute.manager [req-dcb53be1-5dc9-468f-906f-e0a23eeeab94 req-419b195b-b93b-43f3-8457-965a38d16805 service nova] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Received unexpected event network-vif-plugged-9d24e3ae-7181-4507-a0ba-43657ee1ff71 for instance with vm_state deleted and task_state None.
Aug 09 16:40:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-df04b2e5-946f-44a4-9c36-33800347e3f6 tempest-VolumesActionsTest-1284523061 tempest-VolumesActionsTest-1284523061-project-member] Lock "37428447-3a47-4598-aa09-ee4019e0f193" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.597s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:46 user nova-compute[73091]: INFO nova.compute.manager [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Rescuing
Aug 09 16:40:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "refresh_cache-8fc884a8-24bb-488a-baeb-ef2b1faf239d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquired lock "refresh_cache-8fc884a8-24bb-488a-baeb-ef2b1faf239d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Successfully updated port: 78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquired lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Updating instance_info_cache with network_info: [{"id": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "address": "fa:16:3e:b3:de:fe", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ffdd03-c8", "ovs_interfaceid": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Updating instance_info_cache with network_info: [{"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Releasing lock "refresh_cache-8fc884a8-24bb-488a-baeb-ef2b1faf239d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Releasing lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Instance network_info: |[{"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Start _get_guest_xml network_info=[{"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:40:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:40:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-631186991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-631186991',id=22,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNf3A+5Z7pIEBlhzfnQHoxgivCxTPlvm/huyNXliMpXw073U0iPJQNiNLgMagYal2KPG1QBF641Llp0BRSjbgXgq3B8bIM/yGSRax/YnqZ6VB4oH6+6U8bfE9BQdhXTbjQ==',key_name='tempest-keypair-767621827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8000a47d82748ce8d43d306682d62c6',ramdisk_id='',reservation_id='r-kkx3fv25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1451982310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1451982310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343ec5734ef547f292ee631dbb272359',uuid=e03ff609-e74d-427d-b6e6-109fbee09e40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converting VIF {"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ea:23,bridge_name='br-int',has_traffic_filtering=True,id=78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ad4923-b2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.objects.instance [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'pci_devices' on Instance uuid e03ff609-e74d-427d-b6e6-109fbee09e40 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:40:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:40:46 user nova-compute[73091]:   <uuid>e03ff609-e74d-427d-b6e6-109fbee09e40</uuid>
Aug 09 16:40:46 user nova-compute[73091]:   <name>instance-00000016</name>
Aug 09 16:40:46 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:40:46 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:40:46 user nova-compute[73091]:   <metadata>
Aug 09 16:40:46 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:40:46 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:40:46 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-631186991</nova:name>
Aug 09 16:40:46 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:40:46</nova:creationTime>
Aug 09 16:40:46 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:40:46 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:40:46 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:40:46 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:40:46 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:40:46 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:40:46 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:40:46 user nova-compute[73091]:       <nova:owner>
Aug 09 16:40:46 user nova-compute[73091]:         <nova:user uuid="343ec5734ef547f292ee631dbb272359">tempest-AttachVolumeShelveTestJSON-1451982310-project-member</nova:user>
Aug 09 16:40:46 user nova-compute[73091]:         <nova:project uuid="b8000a47d82748ce8d43d306682d62c6">tempest-AttachVolumeShelveTestJSON-1451982310</nova:project>
Aug 09 16:40:46 user nova-compute[73091]:       </nova:owner>
Aug 09 16:40:46 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:40:46 user nova-compute[73091]:       <nova:ports>
Aug 09 16:40:46 user nova-compute[73091]:         <nova:port uuid="78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8">
Aug 09 16:40:46 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 16:40:46 user nova-compute[73091]:         </nova:port>
Aug 09 16:40:46 user nova-compute[73091]:       </nova:ports>
Aug 09 16:40:46 user nova-compute[73091]:     </nova:instance>
Aug 09 16:40:46 user nova-compute[73091]:   </metadata>
Aug 09 16:40:46 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:40:46 user nova-compute[73091]:     <system>
Aug 09 16:40:46 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:40:46 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:40:46 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:40:46 user nova-compute[73091]:       <entry name="serial">e03ff609-e74d-427d-b6e6-109fbee09e40</entry>
Aug 09 16:40:46 user nova-compute[73091]:       <entry name="uuid">e03ff609-e74d-427d-b6e6-109fbee09e40</entry>
Aug 09 16:40:46 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:40:46 user nova-compute[73091]:     </system>
Aug 09 16:40:46 user nova-compute[73091]:   </sysinfo>
Aug 09 16:40:46 user nova-compute[73091]:   <os>
Aug 09 16:40:46 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:40:46 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:40:46 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:40:46 user nova-compute[73091]:   </os>
Aug 09 16:40:46 user nova-compute[73091]:   <features>
Aug 09 16:40:46 user nova-compute[73091]:     <acpi/>
Aug 09 16:40:46 user nova-compute[73091]:     <apic/>
Aug 09 16:40:46 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:40:46 user nova-compute[73091]:   </features>
Aug 09 16:40:46 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:40:46 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:40:46 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:40:46 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:40:46 user nova-compute[73091]:   </clock>
Aug 09 16:40:46 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:40:46 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:40:46 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:40:46 user nova-compute[73091]:   </cpu>
Aug 09 16:40:46 user nova-compute[73091]:   <devices>
Aug 09 16:40:46 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:40:46 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:40:46 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk"/>
Aug 09 16:40:46 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:40:46 user nova-compute[73091]:     </disk>
Aug 09 16:40:46 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:40:46 user nova-compute[73091]:       <mac address="fa:16:3e:3a:ea:23"/>
Aug 09 16:40:46 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:40:46 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:40:46 user nova-compute[73091]:       <target dev="tap78ad4923-b2"/>
Aug 09 16:40:46 user nova-compute[73091]:     </interface>
Aug 09 16:40:46 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:40:46 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/console.log" append="off"/>
Aug 09 16:40:46 user nova-compute[73091]:     </serial>
Aug 09 16:40:46 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:40:46 user nova-compute[73091]:     <video>
Aug 09 16:40:46 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:40:46 user nova-compute[73091]:     </video>
Aug 09 16:40:46 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:40:46 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:40:46 user nova-compute[73091]:     </rng>
Aug 09 16:40:46 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:40:46 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:40:46 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:40:46 user nova-compute[73091]:     </memballoon>
Aug 09 16:40:46 user nova-compute[73091]:   </devices>
Aug 09 16:40:46 user nova-compute[73091]: </domain>
Aug 09 16:40:46 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:40:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-631186991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-631186991',id=22,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNf3A+5Z7pIEBlhzfnQHoxgivCxTPlvm/huyNXliMpXw073U0iPJQNiNLgMagYal2KPG1QBF641Llp0BRSjbgXgq3B8bIM/yGSRax/YnqZ6VB4oH6+6U8bfE9BQdhXTbjQ==',key_name='tempest-keypair-767621827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8000a47d82748ce8d43d306682d62c6',ramdisk_id='',reservation_id='r-kkx3fv25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1451982310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1451982310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343ec5734ef547f292ee631dbb272359',uuid=e03ff609-e74d-427d-b6e6-109fbee09e40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:40:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converting VIF {"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:40:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ea:23,bridge_name='br-int',has_traffic_filtering=True,id=78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ad4923-b2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:40:47 user nova-compute[73091]: DEBUG os_vif [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ea:23,bridge_name='br-int',has_traffic_filtering=True,id=78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ad4923-b2') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:40:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:40:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:40:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78ad4923-b2, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:40:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap78ad4923-b2, col_values=(('external_ids', {'iface-id': '78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:ea:23', 'vm-uuid': 'e03ff609-e74d-427d-b6e6-109fbee09e40'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:40:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:40:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:47 user nova-compute[73091]: INFO os_vif [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ea:23,bridge_name='br-int',has_traffic_filtering=True,id=78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ad4923-b2')
Aug 09 16:40:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:40:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] No VIF found with MAC fa:16:3e:3a:ea:23, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:40:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc57309b-96e9-4738-a208-4aa091eccfa9 req-08b2f478-9abc-4d29-bebd-e07431cfdd2d service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received event network-changed-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc57309b-96e9-4738-a208-4aa091eccfa9 req-08b2f478-9abc-4d29-bebd-e07431cfdd2d service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Refreshing instance network info cache due to event network-changed-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc57309b-96e9-4738-a208-4aa091eccfa9 req-08b2f478-9abc-4d29-bebd-e07431cfdd2d service nova] Acquiring lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc57309b-96e9-4738-a208-4aa091eccfa9 req-08b2f478-9abc-4d29-bebd-e07431cfdd2d service nova] Acquired lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-cc57309b-96e9-4738-a208-4aa091eccfa9 req-08b2f478-9abc-4d29-bebd-e07431cfdd2d service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Refreshing network info cache for port 78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:40:48 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Instance destroyed successfully.
Aug 09 16:40:48 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Attempting rescue
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73091) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 16:40:48 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Creating image(s)
Aug 09 16:40:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "/opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "/opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8fc884a8-24bb-488a-baeb-ef2b1faf239d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.146s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue" returned: 0 in 0.049s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'migration_context' on Instance uuid 8fc884a8-24bb-488a-baeb-ef2b1faf239d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Start _get_guest_xml network_info=[{"id": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "address": "fa:16:3e:b3:de:fe", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "vif_mac": "fa:16:3e:b3:de:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ffdd03-c8", "ovs_interfaceid": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'resources' on Instance uuid 8fc884a8-24bb-488a-baeb-ef2b1faf239d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'numa_topology' on Instance uuid 8fc884a8-24bb-488a-baeb-ef2b1faf239d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:40:48 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:40:48 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8fc884a8-24bb-488a-baeb-ef2b1faf239d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1973705747',display_name='tempest-ServerRescueNegativeTestJSON-server-1973705747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1973705747',id=20,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:39:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a03dd6b23c840c7b4a07f0235c1051b',ramdisk_id='',reservation_id='r-hw9kblzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-596687024',owner_user_name='tempest-ServerRescueNegativeTestJSON-596687024-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:39:04Z,user_data=None,user_id='ef7727ab5d1b46d383bfc02750d29ec7',uuid=8fc884a8-24bb-488a-baeb-ef2b1faf239d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "address": "fa:16:3e:b3:de:fe", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "vif_mac": "fa:16:3e:b3:de:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ffdd03-c8", "ovs_interfaceid": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converting VIF {"id": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "address": "fa:16:3e:b3:de:fe", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "vif_mac": "fa:16:3e:b3:de:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ffdd03-c8", "ovs_interfaceid": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:de:fe,bridge_name='br-int',has_traffic_filtering=True,id=38ffdd03-c883-43bd-9607-036e5f5bd8e7,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38ffdd03-c8') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fc884a8-24bb-488a-baeb-ef2b1faf239d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-cc57309b-96e9-4738-a208-4aa091eccfa9 req-08b2f478-9abc-4d29-bebd-e07431cfdd2d service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Updated VIF entry in instance network info cache for port 78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-cc57309b-96e9-4738-a208-4aa091eccfa9 req-08b2f478-9abc-4d29-bebd-e07431cfdd2d service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Updating instance_info_cache with network_info: [{"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:40:48 user nova-compute[73091]:   <uuid>8fc884a8-24bb-488a-baeb-ef2b1faf239d</uuid>
Aug 09 16:40:48 user nova-compute[73091]:   <name>instance-00000014</name>
Aug 09 16:40:48 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:40:48 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:40:48 user nova-compute[73091]:   <metadata>
Aug 09 16:40:48 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:40:48 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:40:48 user nova-compute[73091]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1973705747</nova:name>
Aug 09 16:40:48 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:40:48</nova:creationTime>
Aug 09 16:40:48 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:40:48 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:40:48 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:40:48 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:40:48 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:40:48 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:40:48 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:40:48 user nova-compute[73091]:       <nova:owner>
Aug 09 16:40:48 user nova-compute[73091]:         <nova:user uuid="ef7727ab5d1b46d383bfc02750d29ec7">tempest-ServerRescueNegativeTestJSON-596687024-project-member</nova:user>
Aug 09 16:40:48 user nova-compute[73091]:         <nova:project uuid="1a03dd6b23c840c7b4a07f0235c1051b">tempest-ServerRescueNegativeTestJSON-596687024</nova:project>
Aug 09 16:40:48 user nova-compute[73091]:       </nova:owner>
Aug 09 16:40:48 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:40:48 user nova-compute[73091]:       <nova:ports>
Aug 09 16:40:48 user nova-compute[73091]:         <nova:port uuid="38ffdd03-c883-43bd-9607-036e5f5bd8e7">
Aug 09 16:40:48 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 16:40:48 user nova-compute[73091]:         </nova:port>
Aug 09 16:40:48 user nova-compute[73091]:       </nova:ports>
Aug 09 16:40:48 user nova-compute[73091]:     </nova:instance>
Aug 09 16:40:48 user nova-compute[73091]:   </metadata>
Aug 09 16:40:48 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:40:48 user nova-compute[73091]:     <system>
Aug 09 16:40:48 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:40:48 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:40:48 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:40:48 user nova-compute[73091]:       <entry name="serial">8fc884a8-24bb-488a-baeb-ef2b1faf239d</entry>
Aug 09 16:40:48 user nova-compute[73091]:       <entry name="uuid">8fc884a8-24bb-488a-baeb-ef2b1faf239d</entry>
Aug 09 16:40:48 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:40:48 user nova-compute[73091]:     </system>
Aug 09 16:40:48 user nova-compute[73091]:   </sysinfo>
Aug 09 16:40:48 user nova-compute[73091]:   <os>
Aug 09 16:40:48 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:40:48 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:40:48 user nova-compute[73091]:   </os>
Aug 09 16:40:48 user nova-compute[73091]:   <features>
Aug 09 16:40:48 user nova-compute[73091]:     <acpi/>
Aug 09 16:40:48 user nova-compute[73091]:     <apic/>
Aug 09 16:40:48 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:40:48 user nova-compute[73091]:   </features>
Aug 09 16:40:48 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:40:48 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:40:48 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:40:48 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:40:48 user nova-compute[73091]:   </clock>
Aug 09 16:40:48 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:40:48 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:40:48 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:40:48 user nova-compute[73091]:   </cpu>
Aug 09 16:40:48 user nova-compute[73091]:   <devices>
Aug 09 16:40:48 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:40:48 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:40:48 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue"/>
Aug 09 16:40:48 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:40:48 user nova-compute[73091]:     </disk>
Aug 09 16:40:48 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:40:48 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:40:48 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk"/>
Aug 09 16:40:48 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 09 16:40:48 user nova-compute[73091]:     </disk>
Aug 09 16:40:48 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:40:48 user nova-compute[73091]:       <mac address="fa:16:3e:b3:de:fe"/>
Aug 09 16:40:48 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:40:48 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:40:48 user nova-compute[73091]:       <target dev="tap38ffdd03-c8"/>
Aug 09 16:40:48 user nova-compute[73091]:     </interface>
Aug 09 16:40:48 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:40:48 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/console.log" append="off"/>
Aug 09 16:40:48 user nova-compute[73091]:     </serial>
Aug 09 16:40:48 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:40:48 user nova-compute[73091]:     <video>
Aug 09 16:40:48 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:40:48 user nova-compute[73091]:     </video>
Aug 09 16:40:48 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:40:48 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:40:48 user nova-compute[73091]:     </rng>
Aug 09 16:40:48 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:40:48 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:40:48 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:40:48 user nova-compute[73091]:     </memballoon>
Aug 09 16:40:48 user nova-compute[73091]:   </devices>
Aug 09 16:40:48 user nova-compute[73091]: </domain>
Aug 09 16:40:48 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc57309b-96e9-4738-a208-4aa091eccfa9 req-08b2f478-9abc-4d29-bebd-e07431cfdd2d service nova] Releasing lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc57309b-96e9-4738-a208-4aa091eccfa9 req-08b2f478-9abc-4d29-bebd-e07431cfdd2d service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Received event network-vif-unplugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc57309b-96e9-4738-a208-4aa091eccfa9 req-08b2f478-9abc-4d29-bebd-e07431cfdd2d service nova] Acquiring lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc57309b-96e9-4738-a208-4aa091eccfa9 req-08b2f478-9abc-4d29-bebd-e07431cfdd2d service nova] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc57309b-96e9-4738-a208-4aa091eccfa9 req-08b2f478-9abc-4d29-bebd-e07431cfdd2d service nova] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc57309b-96e9-4738-a208-4aa091eccfa9 req-08b2f478-9abc-4d29-bebd-e07431cfdd2d service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] No waiting events found dispatching network-vif-unplugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:40:48 user nova-compute[73091]: WARNING nova.compute.manager [req-cc57309b-96e9-4738-a208-4aa091eccfa9 req-08b2f478-9abc-4d29-bebd-e07431cfdd2d service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Received unexpected event network-vif-unplugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 for instance with vm_state active and task_state rescuing.
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc57309b-96e9-4738-a208-4aa091eccfa9 req-08b2f478-9abc-4d29-bebd-e07431cfdd2d service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Received event network-vif-plugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc57309b-96e9-4738-a208-4aa091eccfa9 req-08b2f478-9abc-4d29-bebd-e07431cfdd2d service nova] Acquiring lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc57309b-96e9-4738-a208-4aa091eccfa9 req-08b2f478-9abc-4d29-bebd-e07431cfdd2d service nova] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc57309b-96e9-4738-a208-4aa091eccfa9 req-08b2f478-9abc-4d29-bebd-e07431cfdd2d service nova] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc57309b-96e9-4738-a208-4aa091eccfa9 req-08b2f478-9abc-4d29-bebd-e07431cfdd2d service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] No waiting events found dispatching network-vif-plugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:40:48 user nova-compute[73091]: WARNING nova.compute.manager [req-cc57309b-96e9-4738-a208-4aa091eccfa9 req-08b2f478-9abc-4d29-bebd-e07431cfdd2d service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Received unexpected event network-vif-plugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 for instance with vm_state active and task_state rescuing.
Aug 09 16:40:48 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Instance destroyed successfully.
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:40:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] No VIF found with MAC fa:16:3e:b3:de:fe, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:40:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-810dbf0f-ed75-41ae-8c41-2097413af715 req-1e4a6bc9-78f3-4c43-8768-c14c067157af service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received event network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:40:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-810dbf0f-ed75-41ae-8c41-2097413af715 req-1e4a6bc9-78f3-4c43-8768-c14c067157af service nova] Acquiring lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-810dbf0f-ed75-41ae-8c41-2097413af715 req-1e4a6bc9-78f3-4c43-8768-c14c067157af service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-810dbf0f-ed75-41ae-8c41-2097413af715 req-1e4a6bc9-78f3-4c43-8768-c14c067157af service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-810dbf0f-ed75-41ae-8c41-2097413af715 req-1e4a6bc9-78f3-4c43-8768-c14c067157af service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] No waiting events found dispatching network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:40:49 user nova-compute[73091]: WARNING nova.compute.manager [req-810dbf0f-ed75-41ae-8c41-2097413af715 req-1e4a6bc9-78f3-4c43-8768-c14c067157af service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received unexpected event network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 for instance with vm_state building and task_state spawning.
Aug 09 16:40:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-4399c5fb-d479-4997-aab2-1c5256c31bf7 req-f7c9e5af-3a37-459c-a7d6-2c9caf8858fa service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Received event network-vif-plugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:40:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4399c5fb-d479-4997-aab2-1c5256c31bf7 req-f7c9e5af-3a37-459c-a7d6-2c9caf8858fa service nova] Acquiring lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4399c5fb-d479-4997-aab2-1c5256c31bf7 req-f7c9e5af-3a37-459c-a7d6-2c9caf8858fa service nova] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4399c5fb-d479-4997-aab2-1c5256c31bf7 req-f7c9e5af-3a37-459c-a7d6-2c9caf8858fa service nova] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-4399c5fb-d479-4997-aab2-1c5256c31bf7 req-f7c9e5af-3a37-459c-a7d6-2c9caf8858fa service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] No waiting events found dispatching network-vif-plugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:40:50 user nova-compute[73091]: WARNING nova.compute.manager [req-4399c5fb-d479-4997-aab2-1c5256c31bf7 req-f7c9e5af-3a37-459c-a7d6-2c9caf8858fa service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Received unexpected event network-vif-plugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 for instance with vm_state active and task_state rescuing.
Aug 09 16:40:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-69628ef9-d4c0-4925-875a-c0538c303f86 req-2c1295ed-80c1-4e57-afaf-45546ce5e8ba service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received event network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:40:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-69628ef9-d4c0-4925-875a-c0538c303f86 req-2c1295ed-80c1-4e57-afaf-45546ce5e8ba service nova] Acquiring lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-69628ef9-d4c0-4925-875a-c0538c303f86 req-2c1295ed-80c1-4e57-afaf-45546ce5e8ba service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-69628ef9-d4c0-4925-875a-c0538c303f86 req-2c1295ed-80c1-4e57-afaf-45546ce5e8ba service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-69628ef9-d4c0-4925-875a-c0538c303f86 req-2c1295ed-80c1-4e57-afaf-45546ce5e8ba service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] No waiting events found dispatching network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:40:51 user nova-compute[73091]: WARNING nova.compute.manager [req-69628ef9-d4c0-4925-875a-c0538c303f86 req-2c1295ed-80c1-4e57-afaf-45546ce5e8ba service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received unexpected event network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 for instance with vm_state building and task_state spawning.
Aug 09 16:40:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:40:51 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Creating image(s)
Aug 09 16:40:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "/opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "/opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "/opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.127s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599252.1480007, e03ff609-e74d-427d-b6e6-109fbee09e40 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:40:52 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] VM Resumed (Lifecycle Event)
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk 1073741824" returned: 0 in 0.052s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:40:52 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Instance spawned successfully.
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:40:52 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599252.148517, e03ff609-e74d-427d-b6e6-109fbee09e40 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:40:52 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] VM Started (Lifecycle Event)
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:40:52 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:52 user nova-compute[73091]: INFO nova.compute.manager [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Took 7.49 seconds to spawn the instance on the hypervisor.
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Cannot resize image /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Ensure instance console log exists: /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Start _get_guest_xml network_info=[{"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '8d2c6c9e-f81f-4839-98a1-39d4dabab163', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfwOMhCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '18d8e887-0f91-42e1-ba79-13db5aa9b84b', 'attached_at': '', 'detached_at': '', 'volume_id': '236f66cb-c459-4991-8bd4-04b9f070e374', 'serial': '236f66cb-c459-4991-8bd4-04b9f070e374'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:40:52 user nova-compute[73091]: INFO nova.compute.manager [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Took 8.61 seconds to build instance.
Aug 09 16:40:52 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 16:40:52 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lazy-loading 'vcpu_model' on Instance uuid 18d8e887-0f91-42e1-ba79-13db5aa9b84b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cc0e825b-7b36-48a8-b389-12d846a94a13 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.759s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfwOMhCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:40:52 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:40:52 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:40:52 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7130ed8e-1f5e-4f28-a838-595dd2638289]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:40:52 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[77552255-9ca4-43a0-a621-ceb5d3f14fc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374] added
Aug 09 16:40:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f1ae24-4fda-4570-a80a-7f18c437405d]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6423f4-411d-44e5-b161-2b450f1d6beb]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfwOMhCH {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfwOMhCH" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[794f9673-f17f-4323-9dec-72fdb1991fcf]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DfwOMhCH'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf018d27-6eae-4a07-928a-203121eebfb8]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-6fb6d93b-a162-48d5-b150-87af24200105 req-9d98de34-0b1e-4a87-bbfe-b7b0390bfff4 service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Received event network-vif-plugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6fb6d93b-a162-48d5-b150-87af24200105 req-9d98de34-0b1e-4a87-bbfe-b7b0390bfff4 service nova] Acquiring lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6fb6d93b-a162-48d5-b150-87af24200105 req-9d98de34-0b1e-4a87-bbfe-b7b0390bfff4 service nova] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6fb6d93b-a162-48d5-b150-87af24200105 req-9d98de34-0b1e-4a87-bbfe-b7b0390bfff4 service nova] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-6fb6d93b-a162-48d5-b150-87af24200105 req-9d98de34-0b1e-4a87-bbfe-b7b0390bfff4 service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] No waiting events found dispatching network-vif-plugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:40:52 user nova-compute[73091]: WARNING nova.compute.manager [req-6fb6d93b-a162-48d5-b150-87af24200105 req-9d98de34-0b1e-4a87-bbfe-b7b0390bfff4 service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Received unexpected event network-vif-plugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 for instance with vm_state active and task_state rescuing.
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0a0b24-d618-4984-97d3-6b5ad2613f1c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:40:52 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:40:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:40:52 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:40:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Removed pending event for 8fc884a8-24bb-488a-baeb-ef2b1faf239d due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599252.7727199, 8fc884a8-24bb-488a-baeb-ef2b1faf239d => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:40:52 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] VM Resumed (Lifecycle Event)
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6144a9ee-15ae-495f-adb6-61357a1307c5 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b695e73-bfe1-495c-8c84-16ab17eebee4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374, portal: 172.16.0.220,3260]
Aug 09 16:40:52 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374, portal: 172.16.0.220,3260] successful.
Aug 09 16:40:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:52 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599252.7738128, 8fc884a8-24bb-488a-baeb-ef2b1faf239d => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:40:52 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] VM Started (Lifecycle Event)
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[41abb59f-edfd-4c12-9cf1-667e23e73223]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[00aa9337-4563-486d-b56d-e09844ce2082]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:40:52 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:40:52 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:40:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:40:52 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:40:52 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:40:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e80ef3-1089-4887-b40e-ed7104190744]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:40:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfwOMhCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:40:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:40:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26564666161326630', 'path': '/dev/sdd'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:40:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564666161326630', 'path': '/dev/sdd'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:40:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T16:36:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1364187165',display_name='tempest-ServerActionsTestOtherA-server-1013159509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1364187165',id=13,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILfado63mW6+CgjHmwYiNct4RkaQ/hFrQzjzGZX9fcd5tmDChxbl9riU31kjgrW3xhMcxzy/FY8sPsumtyuqQ7ittcRZasxYBvL6XWrt/5jr8BpeJz8IvTq6jqpzExzYw==',key_name='tempest-keypair-1434010925',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='38c913ceef2c4610a26bd19df29ee896',ramdisk_id='',reservation_id='r-m5ng6wc3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-813213856',owner_user_name='tempest-ServerActionsTestOtherA-813213856-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8956fad221ec4dedb700f034d5230c06',uuid=18d8e887-0f91-42e1-ba79-13db5aa9b84b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:40:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converting VIF {"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:40:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:c1:ba,bridge_name='br-int',has_traffic_filtering=True,id=54c1bb8c-584f-446c-9b64-c840c486a4f1,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c1bb8c-58') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:40:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:40:54 user nova-compute[73091]:   <uuid>18d8e887-0f91-42e1-ba79-13db5aa9b84b</uuid>
Aug 09 16:40:54 user nova-compute[73091]:   <name>instance-0000000d</name>
Aug 09 16:40:54 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:40:54 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:40:54 user nova-compute[73091]:   <metadata>
Aug 09 16:40:54 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:40:54 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:40:54 user nova-compute[73091]:       <nova:name>tempest-ServerActionsTestOtherA-server-1013159509</nova:name>
Aug 09 16:40:54 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:40:52</nova:creationTime>
Aug 09 16:40:54 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:40:54 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:40:54 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:40:54 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:40:54 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:40:54 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:40:54 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:40:54 user nova-compute[73091]:       <nova:owner>
Aug 09 16:40:54 user nova-compute[73091]:         <nova:user uuid="8956fad221ec4dedb700f034d5230c06">tempest-ServerActionsTestOtherA-813213856-project-member</nova:user>
Aug 09 16:40:54 user nova-compute[73091]:         <nova:project uuid="38c913ceef2c4610a26bd19df29ee896">tempest-ServerActionsTestOtherA-813213856</nova:project>
Aug 09 16:40:54 user nova-compute[73091]:       </nova:owner>
Aug 09 16:40:54 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:40:54 user nova-compute[73091]:       <nova:ports>
Aug 09 16:40:54 user nova-compute[73091]:         <nova:port uuid="54c1bb8c-584f-446c-9b64-c840c486a4f1">
Aug 09 16:40:54 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 16:40:54 user nova-compute[73091]:         </nova:port>
Aug 09 16:40:54 user nova-compute[73091]:       </nova:ports>
Aug 09 16:40:54 user nova-compute[73091]:     </nova:instance>
Aug 09 16:40:54 user nova-compute[73091]:   </metadata>
Aug 09 16:40:54 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:40:54 user nova-compute[73091]:     <system>
Aug 09 16:40:54 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:40:54 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:40:54 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:40:54 user nova-compute[73091]:       <entry name="serial">18d8e887-0f91-42e1-ba79-13db5aa9b84b</entry>
Aug 09 16:40:54 user nova-compute[73091]:       <entry name="uuid">18d8e887-0f91-42e1-ba79-13db5aa9b84b</entry>
Aug 09 16:40:54 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:40:54 user nova-compute[73091]:     </system>
Aug 09 16:40:54 user nova-compute[73091]:   </sysinfo>
Aug 09 16:40:54 user nova-compute[73091]:   <os>
Aug 09 16:40:54 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:40:54 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:40:54 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:40:54 user nova-compute[73091]:   </os>
Aug 09 16:40:54 user nova-compute[73091]:   <features>
Aug 09 16:40:54 user nova-compute[73091]:     <acpi/>
Aug 09 16:40:54 user nova-compute[73091]:     <apic/>
Aug 09 16:40:54 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:40:54 user nova-compute[73091]:   </features>
Aug 09 16:40:54 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:40:54 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:40:54 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:40:54 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:40:54 user nova-compute[73091]:   </clock>
Aug 09 16:40:54 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:40:54 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:40:54 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:40:54 user nova-compute[73091]:   </cpu>
Aug 09 16:40:54 user nova-compute[73091]:   <devices>
Aug 09 16:40:54 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:40:54 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:40:54 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk"/>
Aug 09 16:40:54 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:40:54 user nova-compute[73091]:     </disk>
Aug 09 16:40:54 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:40:54 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:40:54 user nova-compute[73091]:       <source dev="/dev/sdd"/>
Aug 09 16:40:54 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 09 16:40:54 user nova-compute[73091]:       <serial>236f66cb-c459-4991-8bd4-04b9f070e374</serial>
Aug 09 16:40:54 user nova-compute[73091]:     </disk>
Aug 09 16:40:54 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:40:54 user nova-compute[73091]:       <mac address="fa:16:3e:45:c1:ba"/>
Aug 09 16:40:54 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:40:54 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:40:54 user nova-compute[73091]:       <target dev="tap54c1bb8c-58"/>
Aug 09 16:40:54 user nova-compute[73091]:     </interface>
Aug 09 16:40:54 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:40:54 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/console.log" append="off"/>
Aug 09 16:40:54 user nova-compute[73091]:     </serial>
Aug 09 16:40:54 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:40:54 user nova-compute[73091]:     <video>
Aug 09 16:40:54 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:40:54 user nova-compute[73091]:     </video>
Aug 09 16:40:54 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:40:54 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:40:54 user nova-compute[73091]:     </rng>
Aug 09 16:40:54 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:40:54 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:40:54 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:40:54 user nova-compute[73091]:     </memballoon>
Aug 09 16:40:54 user nova-compute[73091]:   </devices>
Aug 09 16:40:54 user nova-compute[73091]: </domain>
Aug 09 16:40:54 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:40:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T16:36:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1364187165',display_name='tempest-ServerActionsTestOtherA-server-1013159509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1364187165',id=13,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILfado63mW6+CgjHmwYiNct4RkaQ/hFrQzjzGZX9fcd5tmDChxbl9riU31kjgrW3xhMcxzy/FY8sPsumtyuqQ7ittcRZasxYBvL6XWrt/5jr8BpeJz8IvTq6jqpzExzYw==',key_name='tempest-keypair-1434010925',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='38c913ceef2c4610a26bd19df29ee896',ramdisk_id='',reservation_id='r-m5ng6wc3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-813213856',owner_user_name='tempest-ServerActionsTestOtherA-813213856-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8956fad221ec4dedb700f034d5230c06',uuid=18d8e887-0f91-42e1-ba79-13db5aa9b84b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:40:54 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converting VIF {"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:40:54 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:c1:ba,bridge_name='br-int',has_traffic_filtering=True,id=54c1bb8c-584f-446c-9b64-c840c486a4f1,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c1bb8c-58') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:40:54 user nova-compute[73091]: DEBUG os_vif [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:c1:ba,bridge_name='br-int',has_traffic_filtering=True,id=54c1bb8c-584f-446c-9b64-c840c486a4f1,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c1bb8c-58') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:40:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:40:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:40:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54c1bb8c-58, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:40:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap54c1bb8c-58, col_values=(('external_ids', {'iface-id': '54c1bb8c-584f-446c-9b64-c840c486a4f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:c1:ba', 'vm-uuid': '18d8e887-0f91-42e1-ba79-13db5aa9b84b'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:40:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:40:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:54 user nova-compute[73091]: INFO os_vif [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:c1:ba,bridge_name='br-int',has_traffic_filtering=True,id=54c1bb8c-584f-446c-9b64-c840c486a4f1,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c1bb8c-58')
Aug 09 16:40:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:40:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:40:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] No VIF found with MAC fa:16:3e:45:c1:ba, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:40:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:55 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599240.3037083, 18d8e887-0f91-42e1-ba79-13db5aa9b84b => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:40:55 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] VM Stopped (Lifecycle Event)
Aug 09 16:40:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0d8f99bd-e067-4542-bd22-6af3129044e5 None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:40:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-abe33bb4-c4b0-4089-9f7c-585f63c4b16d req-4add96de-3961-42de-9a87-65ddc9e7f03d service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Received event network-vif-plugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:40:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-abe33bb4-c4b0-4089-9f7c-585f63c4b16d req-4add96de-3961-42de-9a87-65ddc9e7f03d service nova] Acquiring lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-abe33bb4-c4b0-4089-9f7c-585f63c4b16d req-4add96de-3961-42de-9a87-65ddc9e7f03d service nova] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-abe33bb4-c4b0-4089-9f7c-585f63c4b16d req-4add96de-3961-42de-9a87-65ddc9e7f03d service nova] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-abe33bb4-c4b0-4089-9f7c-585f63c4b16d req-4add96de-3961-42de-9a87-65ddc9e7f03d service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] No waiting events found dispatching network-vif-plugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:40:55 user nova-compute[73091]: WARNING nova.compute.manager [req-abe33bb4-c4b0-4089-9f7c-585f63c4b16d req-4add96de-3961-42de-9a87-65ddc9e7f03d service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Received unexpected event network-vif-plugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 for instance with vm_state active and task_state rebuild_spawning.
Aug 09 16:40:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:57 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599257.8966665, 18d8e887-0f91-42e1-ba79-13db5aa9b84b => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:40:57 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] VM Resumed (Lifecycle Event)
Aug 09 16:40:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:40:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:40:57 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Instance spawned successfully.
Aug 09 16:40:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:40:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:40:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:40:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-e6d15a9e-02cf-477a-a2df-058cd4c2e11e req-f57f5677-da6a-4d4d-9286-35561213cff2 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Received event network-vif-plugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:40:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e6d15a9e-02cf-477a-a2df-058cd4c2e11e req-f57f5677-da6a-4d4d-9286-35561213cff2 service nova] Acquiring lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e6d15a9e-02cf-477a-a2df-058cd4c2e11e req-f57f5677-da6a-4d4d-9286-35561213cff2 service nova] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e6d15a9e-02cf-477a-a2df-058cd4c2e11e req-f57f5677-da6a-4d4d-9286-35561213cff2 service nova] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-e6d15a9e-02cf-477a-a2df-058cd4c2e11e req-f57f5677-da6a-4d4d-9286-35561213cff2 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] No waiting events found dispatching network-vif-plugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:40:57 user nova-compute[73091]: WARNING nova.compute.manager [req-e6d15a9e-02cf-477a-a2df-058cd4c2e11e req-f57f5677-da6a-4d4d-9286-35561213cff2 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Received unexpected event network-vif-plugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 for instance with vm_state active and task_state rebuild_spawning.
Aug 09 16:40:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:40:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:40:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:40:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:40:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:40:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:40:57 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 16:40:57 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599257.9030957, 18d8e887-0f91-42e1-ba79-13db5aa9b84b => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:40:57 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] VM Started (Lifecycle Event)
Aug 09 16:40:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:40:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:40:58 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 16:40:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:40:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:58 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73091) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 16:40:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f8415e74-5124-4136-84ed-70db4a936508 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.079s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:40:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:59 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599244.4961326, 37428447-3a47-4598-aa09-ee4019e0f193 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:40:59 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] VM Stopped (Lifecycle Event)
Aug 09 16:40:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-698e2ca6-5f0b-480b-aefb-20730ad06cc3 None None] [instance: 37428447-3a47-4598-aa09-ee4019e0f193] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:40:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:40:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:40:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:40:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:41:00 user nova-compute[73091]: INFO nova.compute.claims [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Claim successful on node user
Aug 09 16:41:00 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:41:00 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:41:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:41:00 user nova-compute[73091]: DEBUG nova.network.neutron [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:41:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:41:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:41:00 user nova-compute[73091]: DEBUG nova.policy [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6652e0ef40d4e26b67628d261f2848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ecfa8609840b1950ed8563bd427d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:41:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:41:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:41:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Creating image(s)
Aug 09 16:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "/opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "/opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "028ea0f3fd2dc87a207f6a95f89827793b8f5216" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "028ea0f3fd2dc87a207f6a95f89827793b8f5216" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216.part --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216.part --force-share --output=json" returned: 0 in 0.168s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:01 user nova-compute[73091]: DEBUG nova.virt.images [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] 7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1 was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 16:41:01 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 16:41:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216.part /opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216.converted {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:01 user nova-compute[73091]: DEBUG nova.network.neutron [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Successfully created port: 2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:41:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216.part /opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216.converted" returned: 0 in 0.152s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216.converted --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216.converted --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "028ea0f3fd2dc87a207f6a95f89827793b8f5216" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.834s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216 --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216 --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "028ea0f3fd2dc87a207f6a95f89827793b8f5216" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "028ea0f3fd2dc87a207f6a95f89827793b8f5216" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216 --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216 --force-share --output=json" returned: 0 in 0.151s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216,backing_fmt=raw /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216,backing_fmt=raw /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk 1073741824" returned: 0 in 0.055s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "028ea0f3fd2dc87a207f6a95f89827793b8f5216" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216 --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216 --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Cannot resize image /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.objects.instance [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lazy-loading 'migration_context' on Instance uuid f8f52e24-8ce5-4128-a2aa-afc68ceb7213 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Ensure instance console log exists: /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.network.neutron [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Successfully updated port: 2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquired lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.network.neutron [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-8583d4c0-43aa-4c87-995e-c2c574888e7c req-a7fb4a2c-f427-43fd-8afc-86f7775b0d47 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received event network-changed-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-8583d4c0-43aa-4c87-995e-c2c574888e7c req-a7fb4a2c-f427-43fd-8afc-86f7775b0d47 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Refreshing instance network info cache due to event network-changed-2d1a984c-9df8-49a7-9460-bee934ea307f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8583d4c0-43aa-4c87-995e-c2c574888e7c req-a7fb4a2c-f427-43fd-8afc-86f7775b0d47 service nova] Acquiring lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.network.neutron [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.network.neutron [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Updating instance_info_cache with network_info: [{"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Releasing lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Instance network_info: |[{"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8583d4c0-43aa-4c87-995e-c2c574888e7c req-a7fb4a2c-f427-43fd-8afc-86f7775b0d47 service nova] Acquired lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.network.neutron [req-8583d4c0-43aa-4c87-995e-c2c574888e7c req-a7fb4a2c-f427-43fd-8afc-86f7775b0d47 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Refreshing network info cache for port 2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Start _get_guest_xml network_info=[{"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:40:57Z,direct_url=<?>,disk_format='qcow2',id=7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1,min_disk=0,min_ram=0,name='tempest-scenario-img--456119161',owner='2e1ecfa8609840b1950ed8563bd427d1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:40:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': '7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:41:02 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:41:02 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:40:57Z,direct_url=<?>,disk_format='qcow2',id=7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1,min_disk=0,min_ram=0,name='tempest-scenario-img--456119161',owner='2e1ecfa8609840b1950ed8563bd427d1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:40:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2111103488',display_name='tempest-TestMinimumBasicScenario-server-2111103488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2111103488',id=23,image_ref='7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4fcOiauymPg1Mn6EtQBUS6MQJ73JOzdMcX2vEpkzNb6cuhSFoEA59T/46bifiCrBZbHeOerT/inFpaPvwCybY3FALz6D+iNcGrn55JR/YB/RfNu/DBpwIJEcdSqkNNXQ==',key_name='tempest-TestMinimumBasicScenario-488048769',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e1ecfa8609840b1950ed8563bd427d1',ramdisk_id='',reservation_id='r-e4yztxi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-51921820',owner_user_name='tempest-TestMinimumBasicScenario-51921820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:41:01Z,user_data=None,user_id='d6652e0ef40d4e26b67628d261f2848e',uuid=f8f52e24-8ce5-4128-a2aa-afc68ceb7213,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Converting VIF {"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8c:6d,bridge_name='br-int',has_traffic_filtering=True,id=2d1a984c-9df8-49a7-9460-bee934ea307f,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d1a984c-9d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.objects.instance [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lazy-loading 'pci_devices' on Instance uuid f8f52e24-8ce5-4128-a2aa-afc68ceb7213 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:41:02 user nova-compute[73091]:   <uuid>f8f52e24-8ce5-4128-a2aa-afc68ceb7213</uuid>
Aug 09 16:41:02 user nova-compute[73091]:   <name>instance-00000017</name>
Aug 09 16:41:02 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:41:02 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:41:02 user nova-compute[73091]:   <metadata>
Aug 09 16:41:02 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:41:02 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:41:02 user nova-compute[73091]:       <nova:name>tempest-TestMinimumBasicScenario-server-2111103488</nova:name>
Aug 09 16:41:02 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:41:02</nova:creationTime>
Aug 09 16:41:02 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:41:02 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:41:02 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:41:02 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:41:02 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:41:02 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:41:02 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:41:02 user nova-compute[73091]:       <nova:owner>
Aug 09 16:41:02 user nova-compute[73091]:         <nova:user uuid="d6652e0ef40d4e26b67628d261f2848e">tempest-TestMinimumBasicScenario-51921820-project-member</nova:user>
Aug 09 16:41:02 user nova-compute[73091]:         <nova:project uuid="2e1ecfa8609840b1950ed8563bd427d1">tempest-TestMinimumBasicScenario-51921820</nova:project>
Aug 09 16:41:02 user nova-compute[73091]:       </nova:owner>
Aug 09 16:41:02 user nova-compute[73091]:       <nova:root type="image" uuid="7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1"/>
Aug 09 16:41:02 user nova-compute[73091]:       <nova:ports>
Aug 09 16:41:02 user nova-compute[73091]:         <nova:port uuid="2d1a984c-9df8-49a7-9460-bee934ea307f">
Aug 09 16:41:02 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 16:41:02 user nova-compute[73091]:         </nova:port>
Aug 09 16:41:02 user nova-compute[73091]:       </nova:ports>
Aug 09 16:41:02 user nova-compute[73091]:     </nova:instance>
Aug 09 16:41:02 user nova-compute[73091]:   </metadata>
Aug 09 16:41:02 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:41:02 user nova-compute[73091]:     <system>
Aug 09 16:41:02 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:41:02 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:41:02 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:41:02 user nova-compute[73091]:       <entry name="serial">f8f52e24-8ce5-4128-a2aa-afc68ceb7213</entry>
Aug 09 16:41:02 user nova-compute[73091]:       <entry name="uuid">f8f52e24-8ce5-4128-a2aa-afc68ceb7213</entry>
Aug 09 16:41:02 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:41:02 user nova-compute[73091]:     </system>
Aug 09 16:41:02 user nova-compute[73091]:   </sysinfo>
Aug 09 16:41:02 user nova-compute[73091]:   <os>
Aug 09 16:41:02 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:41:02 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:41:02 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:41:02 user nova-compute[73091]:   </os>
Aug 09 16:41:02 user nova-compute[73091]:   <features>
Aug 09 16:41:02 user nova-compute[73091]:     <acpi/>
Aug 09 16:41:02 user nova-compute[73091]:     <apic/>
Aug 09 16:41:02 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:41:02 user nova-compute[73091]:   </features>
Aug 09 16:41:02 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:41:02 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:41:02 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:41:02 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:41:02 user nova-compute[73091]:   </clock>
Aug 09 16:41:02 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:41:02 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:41:02 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:41:02 user nova-compute[73091]:   </cpu>
Aug 09 16:41:02 user nova-compute[73091]:   <devices>
Aug 09 16:41:02 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:41:02 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:41:02 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk"/>
Aug 09 16:41:02 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:41:02 user nova-compute[73091]:     </disk>
Aug 09 16:41:02 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:41:02 user nova-compute[73091]:       <mac address="fa:16:3e:c8:8c:6d"/>
Aug 09 16:41:02 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:41:02 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:41:02 user nova-compute[73091]:       <target dev="tap2d1a984c-9d"/>
Aug 09 16:41:02 user nova-compute[73091]:     </interface>
Aug 09 16:41:02 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:41:02 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/console.log" append="off"/>
Aug 09 16:41:02 user nova-compute[73091]:     </serial>
Aug 09 16:41:02 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:41:02 user nova-compute[73091]:     <video>
Aug 09 16:41:02 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:41:02 user nova-compute[73091]:     </video>
Aug 09 16:41:02 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:41:02 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:41:02 user nova-compute[73091]:     </rng>
Aug 09 16:41:02 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:41:02 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:41:02 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:41:02 user nova-compute[73091]:     </memballoon>
Aug 09 16:41:02 user nova-compute[73091]:   </devices>
Aug 09 16:41:02 user nova-compute[73091]: </domain>
Aug 09 16:41:02 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2111103488',display_name='tempest-TestMinimumBasicScenario-server-2111103488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2111103488',id=23,image_ref='7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4fcOiauymPg1Mn6EtQBUS6MQJ73JOzdMcX2vEpkzNb6cuhSFoEA59T/46bifiCrBZbHeOerT/inFpaPvwCybY3FALz6D+iNcGrn55JR/YB/RfNu/DBpwIJEcdSqkNNXQ==',key_name='tempest-TestMinimumBasicScenario-488048769',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e1ecfa8609840b1950ed8563bd427d1',ramdisk_id='',reservation_id='r-e4yztxi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-51921820',owner_user_name='tempest-TestMinimumBasicScenario-51921820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:41:01Z,user_data=None,user_id='d6652e0ef40d4e26b67628d261f2848e',uuid=f8f52e24-8ce5-4128-a2aa-afc68ceb7213,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Converting VIF {"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8c:6d,bridge_name='br-int',has_traffic_filtering=True,id=2d1a984c-9df8-49a7-9460-bee934ea307f,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d1a984c-9d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG os_vif [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8c:6d,bridge_name='br-int',has_traffic_filtering=True,id=2d1a984c-9df8-49a7-9460-bee934ea307f,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d1a984c-9d') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d1a984c-9d, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2d1a984c-9d, col_values=(('external_ids', {'iface-id': '2d1a984c-9df8-49a7-9460-bee934ea307f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:8c:6d', 'vm-uuid': 'f8f52e24-8ce5-4128-a2aa-afc68ceb7213'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:02 user nova-compute[73091]: INFO os_vif [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8c:6d,bridge_name='br-int',has_traffic_filtering=True,id=2d1a984c-9df8-49a7-9460-bee934ea307f,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d1a984c-9d')
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:41:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] No VIF found with MAC fa:16:3e:c8:8c:6d, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:41:03 user nova-compute[73091]: DEBUG nova.network.neutron [req-8583d4c0-43aa-4c87-995e-c2c574888e7c req-a7fb4a2c-f427-43fd-8afc-86f7775b0d47 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Updated VIF entry in instance network info cache for port 2d1a984c-9df8-49a7-9460-bee934ea307f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:41:03 user nova-compute[73091]: DEBUG nova.network.neutron [req-8583d4c0-43aa-4c87-995e-c2c574888e7c req-a7fb4a2c-f427-43fd-8afc-86f7775b0d47 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Updating instance_info_cache with network_info: [{"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:41:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8583d4c0-43aa-4c87-995e-c2c574888e7c req-a7fb4a2c-f427-43fd-8afc-86f7775b0d47 service nova] Releasing lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:41:03 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:41:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:41:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-bcd607e8-c822-4184-8c6d-7bee1cca1a1a req-906e69de-bc66-4965-93ab-93b78eec31d1 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received event network-vif-plugged-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:41:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bcd607e8-c822-4184-8c6d-7bee1cca1a1a req-906e69de-bc66-4965-93ab-93b78eec31d1 service nova] Acquiring lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bcd607e8-c822-4184-8c6d-7bee1cca1a1a req-906e69de-bc66-4965-93ab-93b78eec31d1 service nova] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bcd607e8-c822-4184-8c6d-7bee1cca1a1a req-906e69de-bc66-4965-93ab-93b78eec31d1 service nova] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-bcd607e8-c822-4184-8c6d-7bee1cca1a1a req-906e69de-bc66-4965-93ab-93b78eec31d1 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] No waiting events found dispatching network-vif-plugged-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:41:04 user nova-compute[73091]: WARNING nova.compute.manager [req-bcd607e8-c822-4184-8c6d-7bee1cca1a1a req-906e69de-bc66-4965-93ab-93b78eec31d1 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received unexpected event network-vif-plugged-2d1a984c-9df8-49a7-9460-bee934ea307f for instance with vm_state building and task_state spawning.
Aug 09 16:41:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:41:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:41:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 16:41:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "45447959-13b8-4cb4-aefd-8675ab284bb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "45447959-13b8-4cb4-aefd-8675ab284bb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "45447959-13b8-4cb4-aefd-8675ab284bb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "45447959-13b8-4cb4-aefd-8675ab284bb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "45447959-13b8-4cb4-aefd-8675ab284bb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:06 user nova-compute[73091]: INFO nova.compute.manager [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Terminating instance
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-9cdcb1ce-6248-4188-a38d-f2843dfdd1d7 req-ff94c42d-9c52-49d1-9517-c7d802be3790 service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Received event network-vif-unplugged-610fa224-8ef6-425c-9f3c-65ea46ab984b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9cdcb1ce-6248-4188-a38d-f2843dfdd1d7 req-ff94c42d-9c52-49d1-9517-c7d802be3790 service nova] Acquiring lock "45447959-13b8-4cb4-aefd-8675ab284bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9cdcb1ce-6248-4188-a38d-f2843dfdd1d7 req-ff94c42d-9c52-49d1-9517-c7d802be3790 service nova] Lock "45447959-13b8-4cb4-aefd-8675ab284bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9cdcb1ce-6248-4188-a38d-f2843dfdd1d7 req-ff94c42d-9c52-49d1-9517-c7d802be3790 service nova] Lock "45447959-13b8-4cb4-aefd-8675ab284bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-9cdcb1ce-6248-4188-a38d-f2843dfdd1d7 req-ff94c42d-9c52-49d1-9517-c7d802be3790 service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] No waiting events found dispatching network-vif-unplugged-610fa224-8ef6-425c-9f3c-65ea46ab984b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-9cdcb1ce-6248-4188-a38d-f2843dfdd1d7 req-ff94c42d-9c52-49d1-9517-c7d802be3790 service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Received event network-vif-unplugged-610fa224-8ef6-425c-9f3c-65ea46ab984b for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599266.6281645, f8f52e24-8ce5-4128-a2aa-afc68ceb7213 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:41:06 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] VM Resumed (Lifecycle Event)
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:41:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Instance spawned successfully.
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:41:06 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599266.6282747, f8f52e24-8ce5-4128-a2aa-afc68ceb7213 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:41:06 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] VM Started (Lifecycle Event)
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-4b1152d7-2fe4-414c-b35d-458bc0a66285 req-86da3545-6e1c-468b-a889-6ea233636157 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received event network-vif-plugged-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4b1152d7-2fe4-414c-b35d-458bc0a66285 req-86da3545-6e1c-468b-a889-6ea233636157 service nova] Acquiring lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4b1152d7-2fe4-414c-b35d-458bc0a66285 req-86da3545-6e1c-468b-a889-6ea233636157 service nova] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4b1152d7-2fe4-414c-b35d-458bc0a66285 req-86da3545-6e1c-468b-a889-6ea233636157 service nova] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-4b1152d7-2fe4-414c-b35d-458bc0a66285 req-86da3545-6e1c-468b-a889-6ea233636157 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] No waiting events found dispatching network-vif-plugged-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:41:06 user nova-compute[73091]: WARNING nova.compute.manager [req-4b1152d7-2fe4-414c-b35d-458bc0a66285 req-86da3545-6e1c-468b-a889-6ea233636157 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received unexpected event network-vif-plugged-2d1a984c-9df8-49a7-9460-bee934ea307f for instance with vm_state building and task_state spawning.
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:41:06 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:41:06 user nova-compute[73091]: INFO nova.compute.manager [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Took 6.08 seconds to spawn the instance on the hypervisor.
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:41:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Instance destroyed successfully.
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lazy-loading 'resources' on Instance uuid 45447959-13b8-4cb4-aefd-8675ab284bb8 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1761745280',display_name='tempest-TestVolumeBootPattern-server-1761745280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1761745280',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:39:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64d3dfd232d54594808dad271baa5192',ramdisk_id='',reservation_id='r-lpajow9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1605875873',owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:39:36Z,user_data=None,user_id='69ccebf0e9d54502a2318c809ce11369',uuid=45447959-13b8-4cb4-aefd-8675ab284bb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "610fa224-8ef6-425c-9f3c-65ea46ab984b", "address": "fa:16:3e:cd:a2:79", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap610fa224-8e", "ovs_interfaceid": "610fa224-8ef6-425c-9f3c-65ea46ab984b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converting VIF {"id": "610fa224-8ef6-425c-9f3c-65ea46ab984b", "address": "fa:16:3e:cd:a2:79", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap610fa224-8e", "ovs_interfaceid": "610fa224-8ef6-425c-9f3c-65ea46ab984b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:a2:79,bridge_name='br-int',has_traffic_filtering=True,id=610fa224-8ef6-425c-9f3c-65ea46ab984b,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap610fa224-8e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG os_vif [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:a2:79,bridge_name='br-int',has_traffic_filtering=True,id=610fa224-8ef6-425c-9f3c-65ea46ab984b,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap610fa224-8e') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap610fa224-8e, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:41:06 user nova-compute[73091]: INFO os_vif [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:a2:79,bridge_name='br-int',has_traffic_filtering=True,id=610fa224-8ef6-425c-9f3c-65ea46ab984b,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap610fa224-8e')
Aug 09 16:41:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfClAXER', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:41:06 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:41:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:06 user nova-compute[73091]: INFO nova.compute.manager [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Took 6.97 seconds to build instance.
Aug 09 16:41:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b826c7-70b3-41be-bde2-6b25cc99ce47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-713a2233-409b-4e4a-a654-b36edae68d79 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.068s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d19f1f9-d291-48ca-8aea-0878c27467ca]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:41:07 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:41:07 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:41:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f (non-flash)
Aug 09 16:41:07 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:41:07 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:41:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff08032b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[874409c4-0e23-4a14-a2f9-a184b4429904]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a9da04-3543-4edf-8078-83261b5ebcbf]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c468849-3661-4ea9-a2d9-7e516e240492]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38d3841-7c54-45e3-881f-d745bebbc9a9]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4a83c49-e3f06a61eb820701', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4a83c49', '/dev/disk/by-id/scsi-26533663036613631') {{(pid=83925) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 16:41:07 user nova-compute[73091]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO4a83c49-e3f06a61eb820701
Aug 09 16:41:07 user nova-compute[73091]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_4a83c49
Aug 09 16:41:07 user nova-compute[73091]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26533663036613631
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f32b43b-6a9c-4cf3-83f7-ed7b190c8159]: (4, None) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9fb6aa-c1f7-4ff7-ace3-b125ffa550d4]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7894bf-9e8f-4e27-b73a-8019b938269b]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f, portal: 172.16.0.220,3260]
Aug 09 16:41:07 user nova-compute[73091]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f, portal: 172.16.0.220,3260] successful.
Aug 09 16:41:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83185933-d7ab-4b1f-b505-38c4cdfe9a0f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4013c96-c30a-4c64-bf49-12260f54b4d0]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] <== disconnect_volume: return (318ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:41:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Deleting instance files /opt/stack/data/nova/instances/45447959-13b8-4cb4-aefd-8675ab284bb8_del
Aug 09 16:41:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Deletion of /opt/stack/data/nova/instances/45447959-13b8-4cb4-aefd-8675ab284bb8_del complete
Aug 09 16:41:07 user nova-compute[73091]: INFO nova.compute.manager [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:41:07 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Took 0.55 seconds to deallocate network for instance.
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-59c7afbe-0be4-4d5f-8a27-2433b2cffe96 req-3a63b1ab-0630-4d0f-8a1f-e16db1596cd9 service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Received event network-vif-deleted-610fa224-8ef6-425c-9f3c-65ea46ab984b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:41:07 user nova-compute[73091]: INFO nova.compute.manager [req-59c7afbe-0be4-4d5f-8a27-2433b2cffe96 req-3a63b1ab-0630-4d0f-8a1f-e16db1596cd9 service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Neutron deleted interface 610fa224-8ef6-425c-9f3c-65ea46ab984b; detaching it from the instance and deleting it from the info cache
Aug 09 16:41:07 user nova-compute[73091]: DEBUG nova.network.neutron [req-59c7afbe-0be4-4d5f-8a27-2433b2cffe96 req-3a63b1ab-0630-4d0f-8a1f-e16db1596cd9 service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:41:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-59c7afbe-0be4-4d5f-8a27-2433b2cffe96 req-3a63b1ab-0630-4d0f-8a1f-e16db1596cd9 service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Detach interface failed, port_id=610fa224-8ef6-425c-9f3c-65ea46ab984b, reason: Instance 45447959-13b8-4cb4-aefd-8675ab284bb8 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 16:41:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-13e2ee9f-e48d-44db-8dc0-f3b20f3fef63 req-8478516f-39b7-485e-87f6-853a82243c4b service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Received event network-vif-plugged-610fa224-8ef6-425c-9f3c-65ea46ab984b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:41:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-13e2ee9f-e48d-44db-8dc0-f3b20f3fef63 req-8478516f-39b7-485e-87f6-853a82243c4b service nova] Acquiring lock "45447959-13b8-4cb4-aefd-8675ab284bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-13e2ee9f-e48d-44db-8dc0-f3b20f3fef63 req-8478516f-39b7-485e-87f6-853a82243c4b service nova] Lock "45447959-13b8-4cb4-aefd-8675ab284bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-13e2ee9f-e48d-44db-8dc0-f3b20f3fef63 req-8478516f-39b7-485e-87f6-853a82243c4b service nova] Lock "45447959-13b8-4cb4-aefd-8675ab284bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-13e2ee9f-e48d-44db-8dc0-f3b20f3fef63 req-8478516f-39b7-485e-87f6-853a82243c4b service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] No waiting events found dispatching network-vif-plugged-610fa224-8ef6-425c-9f3c-65ea46ab984b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:41:08 user nova-compute[73091]: WARNING nova.compute.manager [req-13e2ee9f-e48d-44db-8dc0-f3b20f3fef63 req-8478516f-39b7-485e-87f6-853a82243c4b service nova] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Received unexpected event network-vif-plugged-610fa224-8ef6-425c-9f3c-65ea46ab984b for instance with vm_state active and task_state deleting.
Aug 09 16:41:08 user nova-compute[73091]: INFO nova.compute.manager [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Took 0.81 seconds to detach 1 volumes for instance.
Aug 09 16:41:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Deleting volume: 83185933-d7ab-4b1f-b505-38c4cdfe9a0f {{(pid=73091) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 16:41:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:09 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:41:09 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:41:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:09 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Deleted allocations for instance 45447959-13b8-4cb4-aefd-8675ab284bb8
Aug 09 16:41:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2032a282-c1c7-4adb-9bf7-8845592599a7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "45447959-13b8-4cb4-aefd-8675ab284bb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.242s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:41:10 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:41:11 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:41:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:11 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:41:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Acquiring lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Acquiring lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:12 user nova-compute[73091]: INFO nova.compute.manager [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Terminating instance
Aug 09 16:41:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-ce79985b-c63d-47d5-b8e9-ab04391808ed req-e8626b60-6d43-4f44-ae3e-4d3c8daf69bc service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Received event network-vif-unplugged-a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce79985b-c63d-47d5-b8e9-ab04391808ed req-e8626b60-6d43-4f44-ae3e-4d3c8daf69bc service nova] Acquiring lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce79985b-c63d-47d5-b8e9-ab04391808ed req-e8626b60-6d43-4f44-ae3e-4d3c8daf69bc service nova] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce79985b-c63d-47d5-b8e9-ab04391808ed req-e8626b60-6d43-4f44-ae3e-4d3c8daf69bc service nova] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-ce79985b-c63d-47d5-b8e9-ab04391808ed req-e8626b60-6d43-4f44-ae3e-4d3c8daf69bc service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] No waiting events found dispatching network-vif-unplugged-a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-ce79985b-c63d-47d5-b8e9-ab04391808ed req-e8626b60-6d43-4f44-ae3e-4d3c8daf69bc service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Received event network-vif-unplugged-a701119d-6f96-488f-ad0f-ea05c96e5268 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Instance destroyed successfully.
Aug 09 16:41:13 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lazy-loading 'resources' on Instance uuid b43afe67-19e9-42b5-ba1b-f00b4aa56fc7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T16:37:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1832276351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-795799594',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkZLgMs6m+7dg3Hs5GmhpEj7horlTD7kkT8Ur0MpazXAI51/Bo/IRROyxIbVDzm2mgAMl3z17iPI2mWhvCp8vxCgW/ifPXfNJE8PGmzhO69XbpdWA00iHhl3K8a22Tf2A==',key_name='tempest-keypair-1207467283',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:39:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb392d70735f4df8860e29e2ed4f114c',ramdisk_id='',reservation_id='r-ixolz5ob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-24876138',owner_user_name='tempest-ServerActionsV293TestJSON-24876138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:39:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8363e87670bc4cbe85d05285f4a29fc5',uuid=b43afe67-19e9-42b5-ba1b-f00b4aa56fc7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a701119d-6f96-488f-ad0f-ea05c96e5268", "address": "fa:16:3e:32:fc:e5", "network": {"id": "e72f54ab-788d-4574-bf12-9fa76ea48145", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-414514792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb392d70735f4df8860e29e2ed4f114c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa701119d-6f", "ovs_interfaceid": "a701119d-6f96-488f-ad0f-ea05c96e5268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Converting VIF {"id": "a701119d-6f96-488f-ad0f-ea05c96e5268", "address": "fa:16:3e:32:fc:e5", "network": {"id": "e72f54ab-788d-4574-bf12-9fa76ea48145", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-414514792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb392d70735f4df8860e29e2ed4f114c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa701119d-6f", "ovs_interfaceid": "a701119d-6f96-488f-ad0f-ea05c96e5268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=a701119d-6f96-488f-ad0f-ea05c96e5268,network=Network(e72f54ab-788d-4574-bf12-9fa76ea48145),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa701119d-6f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG os_vif [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=a701119d-6f96-488f-ad0f-ea05c96e5268,network=Network(e72f54ab-788d-4574-bf12-9fa76ea48145),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa701119d-6f') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa701119d-6f, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:41:13 user nova-compute[73091]: INFO os_vif [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=a701119d-6f96-488f-ad0f-ea05c96e5268,network=Network(e72f54ab-788d-4574-bf12-9fa76ea48145),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa701119d-6f')
Aug 09 16:41:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crBXfeax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:41:13 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:41:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[08041b8c-219b-4bff-976b-3e802bb7a6b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[45be13f9-bbdb-44b5-9d36-0db85ca376d5]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:41:13 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:41:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd (non-flash)
Aug 09 16:41:13 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:41:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff06039ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9de5ab6-a71d-4591-a7b2-e1d520a5ed08]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5827b41d-745e-4cc8-a0de-4502daa6760b]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14aef78-49a3-4933-b5f4-9fd546defff4]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.072s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[994199c2-ed7c-45e6-90fb-5e5839ada7ab]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b94f38-f828-499b-8c66-a5bb9d5a523f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f3aa51-0f27-42f7-95c2-f2e992f13fd2]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd, portal: 172.16.0.220,3260]
Aug 09 16:41:13 user nova-compute[73091]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd, portal: 172.16.0.220,3260] successful.
Aug 09 16:41:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac64d7de-a287-448e-8ae4-4c1de4b21a74]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.460s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] <== disconnect_volume: return (461ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:41:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Deleting instance files /opt/stack/data/nova/instances/b43afe67-19e9-42b5-ba1b-f00b4aa56fc7_del
Aug 09 16:41:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Deletion of /opt/stack/data/nova/instances/b43afe67-19e9-42b5-ba1b-f00b4aa56fc7_del complete
Aug 09 16:41:13 user nova-compute[73091]: INFO nova.compute.manager [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Took 1.39 seconds to destroy the instance on the hypervisor.
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:41:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-60e52110-20e9-4fa2-89ae-1626c2b1df3c req-17d02713-4418-45e7-99fe-f87a9f5c5c0f service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Received event network-vif-plugged-a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:41:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60e52110-20e9-4fa2-89ae-1626c2b1df3c req-17d02713-4418-45e7-99fe-f87a9f5c5c0f service nova] Acquiring lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60e52110-20e9-4fa2-89ae-1626c2b1df3c req-17d02713-4418-45e7-99fe-f87a9f5c5c0f service nova] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60e52110-20e9-4fa2-89ae-1626c2b1df3c req-17d02713-4418-45e7-99fe-f87a9f5c5c0f service nova] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-60e52110-20e9-4fa2-89ae-1626c2b1df3c req-17d02713-4418-45e7-99fe-f87a9f5c5c0f service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] No waiting events found dispatching network-vif-plugged-a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:41:14 user nova-compute[73091]: WARNING nova.compute.manager [req-60e52110-20e9-4fa2-89ae-1626c2b1df3c req-17d02713-4418-45e7-99fe-f87a9f5c5c0f service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Received unexpected event network-vif-plugged-a701119d-6f96-488f-ad0f-ea05c96e5268 for instance with vm_state active and task_state deleting.
Aug 09 16:41:14 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:41:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:14 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Took 1.03 seconds to deallocate network for instance.
Aug 09 16:41:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:16 user nova-compute[73091]: INFO nova.compute.manager [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Took 1.25 seconds to detach 1 volumes for instance.
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Deleting volume: af14f220-ffac-4b0c-b9fb-1a47ee0ab3dd {{(pid=73091) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:16 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:41:16 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7193MB free_disk=25.38669204711914GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance b43afe67-19e9-42b5-ba1b-f00b4aa56fc7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 68d63bc2-d726-49d8-91de-bc5cc66bb119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 93e10fd4-8841-4043-b4e2-7489c4dea3e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 38051bca-7190-4dff-91d1-3d99b4e4182b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f939fe27-017a-481e-babc-147bf98e0132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8fc884a8-24bb-488a-baeb-ef2b1faf239d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance e03ff609-e74d-427d-b6e6-109fbee09e40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f8f52e24-8ce5-4128-a2aa-afc68ceb7213 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance db00ba13-17f9-4441-a5f5-6e0eac6aa541 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.502s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-62da9f7f-79f7-4c60-b017-e3c63432a258 req-623f14b0-069d-4af4-aa1c-b1e633b8f775 service nova] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Received event network-vif-deleted-a701119d-6f96-488f-ad0f-ea05c96e5268 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:41:16 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:41:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.843s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:41:17 user nova-compute[73091]: INFO nova.compute.claims [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Claim successful on node user
Aug 09 16:41:17 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Deleted allocations for instance b43afe67-19e9-42b5-ba1b-f00b4aa56fc7
Aug 09 16:41:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ce0da00-98ac-4b26-aaa2-a6567fade0f1 tempest-ServerActionsV293TestJSON-24876138 tempest-ServerActionsV293TestJSON-24876138-project-member] Lock "b43afe67-19e9-42b5-ba1b-f00b4aa56fc7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.823s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:17 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:41:17 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:41:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:41:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:41:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:41:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:41:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:41:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:41:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:41:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Creating image(s)
Aug 09 16:41:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "/opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "/opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "/opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:17 user nova-compute[73091]: DEBUG nova.policy [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '992b965912454b79b9d70db85c232bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c72c5d15254ac2bf4348b99858f839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:41:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.150s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.146s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541/disk 1073741824" returned: 0 in 0.051s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.160s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:18 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:41:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:18 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Cannot resize image /opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:41:18 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lazy-loading 'migration_context' on Instance uuid db00ba13-17f9-4441-a5f5-6e0eac6aa541 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:41:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:41:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Ensure instance console log exists: /opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:41:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Successfully created port: ebe87016-1c22-4149-9b25-bd6230a4f703 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:41:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Successfully updated port: ebe87016-1c22-4149-9b25-bd6230a4f703 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:41:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "refresh_cache-db00ba13-17f9-4441-a5f5-6e0eac6aa541" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:41:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquired lock "refresh_cache-db00ba13-17f9-4441-a5f5-6e0eac6aa541" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:41:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:41:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-91f70294-50d4-499a-82d9-5f67292290d5 req-d377ca34-475e-4374-b131-5d2857e80e4d service nova] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Received event network-changed-ebe87016-1c22-4149-9b25-bd6230a4f703 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:41:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-91f70294-50d4-499a-82d9-5f67292290d5 req-d377ca34-475e-4374-b131-5d2857e80e4d service nova] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Refreshing instance network info cache due to event network-changed-ebe87016-1c22-4149-9b25-bd6230a4f703. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:41:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-91f70294-50d4-499a-82d9-5f67292290d5 req-d377ca34-475e-4374-b131-5d2857e80e4d service nova] Acquiring lock "refresh_cache-db00ba13-17f9-4441-a5f5-6e0eac6aa541" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:41:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:41:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Updating instance_info_cache with network_info: [{"id": "ebe87016-1c22-4149-9b25-bd6230a4f703", "address": "fa:16:3e:82:8f:39", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe87016-1c", "ovs_interfaceid": "ebe87016-1c22-4149-9b25-bd6230a4f703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:41:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Releasing lock "refresh_cache-db00ba13-17f9-4441-a5f5-6e0eac6aa541" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:41:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Instance network_info: |[{"id": "ebe87016-1c22-4149-9b25-bd6230a4f703", "address": "fa:16:3e:82:8f:39", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe87016-1c", "ovs_interfaceid": "ebe87016-1c22-4149-9b25-bd6230a4f703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:41:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-91f70294-50d4-499a-82d9-5f67292290d5 req-d377ca34-475e-4374-b131-5d2857e80e4d service nova] Acquired lock "refresh_cache-db00ba13-17f9-4441-a5f5-6e0eac6aa541" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:41:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-91f70294-50d4-499a-82d9-5f67292290d5 req-d377ca34-475e-4374-b131-5d2857e80e4d service nova] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Refreshing network info cache for port ebe87016-1c22-4149-9b25-bd6230a4f703 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:41:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Start _get_guest_xml network_info=[{"id": "ebe87016-1c22-4149-9b25-bd6230a4f703", "address": "fa:16:3e:82:8f:39", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe87016-1c", "ovs_interfaceid": "ebe87016-1c22-4149-9b25-bd6230a4f703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:41:19 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:41:19 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:41:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:41:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2050033934',display_name='tempest-VolumesAdminNegativeTest-server-2050033934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2050033934',id=24,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22c72c5d15254ac2bf4348b99858f839',ramdisk_id='',reservation_id='r-kvgrj25d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1174699978',owner_user_name='tempest-VolumesAdminNegativeTest-1174699978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:41:18Z,user_data=None,user_id='992b965912454b79b9d70db85c232bc0',uuid=db00ba13-17f9-4441-a5f5-6e0eac6aa541,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebe87016-1c22-4149-9b25-bd6230a4f703", "address": "fa:16:3e:82:8f:39", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe87016-1c", "ovs_interfaceid": "ebe87016-1c22-4149-9b25-bd6230a4f703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Converting VIF {"id": "ebe87016-1c22-4149-9b25-bd6230a4f703", "address": "fa:16:3e:82:8f:39", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe87016-1c", "ovs_interfaceid": "ebe87016-1c22-4149-9b25-bd6230a4f703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:8f:39,bridge_name='br-int',has_traffic_filtering=True,id=ebe87016-1c22-4149-9b25-bd6230a4f703,network=Network(4279c047-a328-4c4c-aff6-667871ec03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe87016-1c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lazy-loading 'pci_devices' on Instance uuid db00ba13-17f9-4441-a5f5-6e0eac6aa541 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:41:20 user nova-compute[73091]:   <uuid>db00ba13-17f9-4441-a5f5-6e0eac6aa541</uuid>
Aug 09 16:41:20 user nova-compute[73091]:   <name>instance-00000018</name>
Aug 09 16:41:20 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:41:20 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:41:20 user nova-compute[73091]:   <metadata>
Aug 09 16:41:20 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:41:20 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:41:20 user nova-compute[73091]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2050033934</nova:name>
Aug 09 16:41:20 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:41:19</nova:creationTime>
Aug 09 16:41:20 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:41:20 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:41:20 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:41:20 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:41:20 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:41:20 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:41:20 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:41:20 user nova-compute[73091]:       <nova:owner>
Aug 09 16:41:20 user nova-compute[73091]:         <nova:user uuid="992b965912454b79b9d70db85c232bc0">tempest-VolumesAdminNegativeTest-1174699978-project-member</nova:user>
Aug 09 16:41:20 user nova-compute[73091]:         <nova:project uuid="22c72c5d15254ac2bf4348b99858f839">tempest-VolumesAdminNegativeTest-1174699978</nova:project>
Aug 09 16:41:20 user nova-compute[73091]:       </nova:owner>
Aug 09 16:41:20 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:41:20 user nova-compute[73091]:       <nova:ports>
Aug 09 16:41:20 user nova-compute[73091]:         <nova:port uuid="ebe87016-1c22-4149-9b25-bd6230a4f703">
Aug 09 16:41:20 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 16:41:20 user nova-compute[73091]:         </nova:port>
Aug 09 16:41:20 user nova-compute[73091]:       </nova:ports>
Aug 09 16:41:20 user nova-compute[73091]:     </nova:instance>
Aug 09 16:41:20 user nova-compute[73091]:   </metadata>
Aug 09 16:41:20 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:41:20 user nova-compute[73091]:     <system>
Aug 09 16:41:20 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:41:20 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:41:20 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:41:20 user nova-compute[73091]:       <entry name="serial">db00ba13-17f9-4441-a5f5-6e0eac6aa541</entry>
Aug 09 16:41:20 user nova-compute[73091]:       <entry name="uuid">db00ba13-17f9-4441-a5f5-6e0eac6aa541</entry>
Aug 09 16:41:20 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:41:20 user nova-compute[73091]:     </system>
Aug 09 16:41:20 user nova-compute[73091]:   </sysinfo>
Aug 09 16:41:20 user nova-compute[73091]:   <os>
Aug 09 16:41:20 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:41:20 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:41:20 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:41:20 user nova-compute[73091]:   </os>
Aug 09 16:41:20 user nova-compute[73091]:   <features>
Aug 09 16:41:20 user nova-compute[73091]:     <acpi/>
Aug 09 16:41:20 user nova-compute[73091]:     <apic/>
Aug 09 16:41:20 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:41:20 user nova-compute[73091]:   </features>
Aug 09 16:41:20 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:41:20 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:41:20 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:41:20 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:41:20 user nova-compute[73091]:   </clock>
Aug 09 16:41:20 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:41:20 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:41:20 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:41:20 user nova-compute[73091]:   </cpu>
Aug 09 16:41:20 user nova-compute[73091]:   <devices>
Aug 09 16:41:20 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:41:20 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:41:20 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541/disk"/>
Aug 09 16:41:20 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:41:20 user nova-compute[73091]:     </disk>
Aug 09 16:41:20 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:41:20 user nova-compute[73091]:       <mac address="fa:16:3e:82:8f:39"/>
Aug 09 16:41:20 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:41:20 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:41:20 user nova-compute[73091]:       <target dev="tapebe87016-1c"/>
Aug 09 16:41:20 user nova-compute[73091]:     </interface>
Aug 09 16:41:20 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:41:20 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541/console.log" append="off"/>
Aug 09 16:41:20 user nova-compute[73091]:     </serial>
Aug 09 16:41:20 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:41:20 user nova-compute[73091]:     <video>
Aug 09 16:41:20 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:41:20 user nova-compute[73091]:     </video>
Aug 09 16:41:20 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:41:20 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:41:20 user nova-compute[73091]:     </rng>
Aug 09 16:41:20 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:41:20 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:41:20 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:41:20 user nova-compute[73091]:     </memballoon>
Aug 09 16:41:20 user nova-compute[73091]:   </devices>
Aug 09 16:41:20 user nova-compute[73091]: </domain>
Aug 09 16:41:20 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:41:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2050033934',display_name='tempest-VolumesAdminNegativeTest-server-2050033934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2050033934',id=24,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22c72c5d15254ac2bf4348b99858f839',ramdisk_id='',reservation_id='r-kvgrj25d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1174699978',owner_user_name='tempest-VolumesAdminNegativeTest-1174699978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:41:18Z,user_data=None,user_id='992b965912454b79b9d70db85c232bc0',uuid=db00ba13-17f9-4441-a5f5-6e0eac6aa541,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebe87016-1c22-4149-9b25-bd6230a4f703", "address": "fa:16:3e:82:8f:39", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe87016-1c", "ovs_interfaceid": "ebe87016-1c22-4149-9b25-bd6230a4f703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Converting VIF {"id": "ebe87016-1c22-4149-9b25-bd6230a4f703", "address": "fa:16:3e:82:8f:39", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe87016-1c", "ovs_interfaceid": "ebe87016-1c22-4149-9b25-bd6230a4f703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:8f:39,bridge_name='br-int',has_traffic_filtering=True,id=ebe87016-1c22-4149-9b25-bd6230a4f703,network=Network(4279c047-a328-4c4c-aff6-667871ec03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe87016-1c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG os_vif [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:8f:39,bridge_name='br-int',has_traffic_filtering=True,id=ebe87016-1c22-4149-9b25-bd6230a4f703,network=Network(4279c047-a328-4c4c-aff6-667871ec03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe87016-1c') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebe87016-1c, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapebe87016-1c, col_values=(('external_ids', {'iface-id': 'ebe87016-1c22-4149-9b25-bd6230a4f703', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:8f:39', 'vm-uuid': 'db00ba13-17f9-4441-a5f5-6e0eac6aa541'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:20 user nova-compute[73091]: INFO os_vif [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:8f:39,bridge_name='br-int',has_traffic_filtering=True,id=ebe87016-1c22-4149-9b25-bd6230a4f703,network=Network(4279c047-a328-4c4c-aff6-667871ec03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe87016-1c')
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] No VIF found with MAC fa:16:3e:82:8f:39, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.network.neutron [req-91f70294-50d4-499a-82d9-5f67292290d5 req-d377ca34-475e-4374-b131-5d2857e80e4d service nova] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Updated VIF entry in instance network info cache for port ebe87016-1c22-4149-9b25-bd6230a4f703. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG nova.network.neutron [req-91f70294-50d4-499a-82d9-5f67292290d5 req-d377ca34-475e-4374-b131-5d2857e80e4d service nova] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Updating instance_info_cache with network_info: [{"id": "ebe87016-1c22-4149-9b25-bd6230a4f703", "address": "fa:16:3e:82:8f:39", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe87016-1c", "ovs_interfaceid": "ebe87016-1c22-4149-9b25-bd6230a4f703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:41:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-91f70294-50d4-499a-82d9-5f67292290d5 req-d377ca34-475e-4374-b131-5d2857e80e4d service nova] Releasing lock "refresh_cache-db00ba13-17f9-4441-a5f5-6e0eac6aa541" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:41:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-6400faee-ea2f-4883-8db4-6476fba3c6e8 req-8de95993-976d-435b-a2a7-7a7007dc880d service nova] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Received event network-vif-plugged-ebe87016-1c22-4149-9b25-bd6230a4f703 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:41:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6400faee-ea2f-4883-8db4-6476fba3c6e8 req-8de95993-976d-435b-a2a7-7a7007dc880d service nova] Acquiring lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6400faee-ea2f-4883-8db4-6476fba3c6e8 req-8de95993-976d-435b-a2a7-7a7007dc880d service nova] Lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6400faee-ea2f-4883-8db4-6476fba3c6e8 req-8de95993-976d-435b-a2a7-7a7007dc880d service nova] Lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-6400faee-ea2f-4883-8db4-6476fba3c6e8 req-8de95993-976d-435b-a2a7-7a7007dc880d service nova] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] No waiting events found dispatching network-vif-plugged-ebe87016-1c22-4149-9b25-bd6230a4f703 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:41:21 user nova-compute[73091]: WARNING nova.compute.manager [req-6400faee-ea2f-4883-8db4-6476fba3c6e8 req-8de95993-976d-435b-a2a7-7a7007dc880d service nova] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Received unexpected event network-vif-plugged-ebe87016-1c22-4149-9b25-bd6230a4f703 for instance with vm_state building and task_state spawning.
Aug 09 16:41:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:21 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599266.888302, 45447959-13b8-4cb4-aefd-8675ab284bb8 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:41:21 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] VM Stopped (Lifecycle Event)
Aug 09 16:41:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-366d909d-d21f-4849-ba64-577edaf61da1 None None] [instance: 45447959-13b8-4cb4-aefd-8675ab284bb8] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:41:23 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599283.6063888, db00ba13-17f9-4441-a5f5-6e0eac6aa541 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:41:23 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] VM Resumed (Lifecycle Event)
Aug 09 16:41:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:41:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:41:23 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Instance spawned successfully.
Aug 09 16:41:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:41:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:41:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:41:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:41:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:41:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:41:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:41:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:41:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:41:23 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:41:23 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599283.6075912, db00ba13-17f9-4441-a5f5-6e0eac6aa541 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:41:23 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] VM Started (Lifecycle Event)
Aug 09 16:41:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:41:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:41:23 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:41:23 user nova-compute[73091]: INFO nova.compute.manager [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Took 6.06 seconds to spawn the instance on the hypervisor.
Aug 09 16:41:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:41:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-d576b774-c17a-4965-88f1-6b6b758084cc req-b1bd855c-454c-4058-9e2a-e12d014e01e4 service nova] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Received event network-vif-plugged-ebe87016-1c22-4149-9b25-bd6230a4f703 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:41:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d576b774-c17a-4965-88f1-6b6b758084cc req-b1bd855c-454c-4058-9e2a-e12d014e01e4 service nova] Acquiring lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d576b774-c17a-4965-88f1-6b6b758084cc req-b1bd855c-454c-4058-9e2a-e12d014e01e4 service nova] Lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d576b774-c17a-4965-88f1-6b6b758084cc req-b1bd855c-454c-4058-9e2a-e12d014e01e4 service nova] Lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-d576b774-c17a-4965-88f1-6b6b758084cc req-b1bd855c-454c-4058-9e2a-e12d014e01e4 service nova] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] No waiting events found dispatching network-vif-plugged-ebe87016-1c22-4149-9b25-bd6230a4f703 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:41:23 user nova-compute[73091]: WARNING nova.compute.manager [req-d576b774-c17a-4965-88f1-6b6b758084cc req-b1bd855c-454c-4058-9e2a-e12d014e01e4 service nova] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Received unexpected event network-vif-plugged-ebe87016-1c22-4149-9b25-bd6230a4f703 for instance with vm_state building and task_state spawning.
Aug 09 16:41:23 user nova-compute[73091]: INFO nova.compute.manager [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Took 7.72 seconds to build instance.
Aug 09 16:41:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fc22a471-75b1-47a5-a547-feccec95284d tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.827s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:28 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599273.1270387, b43afe67-19e9-42b5-ba1b-f00b4aa56fc7 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:41:28 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] VM Stopped (Lifecycle Event)
Aug 09 16:41:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-11de5830-d236-49be-82cb-1db8275cac37 None None] [instance: b43afe67-19e9-42b5-ba1b-f00b4aa56fc7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:41:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "68d63bc2-d726-49d8-91de-bc5cc66bb119" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lazy-loading 'flavor' on Instance uuid 68d63bc2-d726-49d8-91de-bc5cc66bb119 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "68d63bc2-d726-49d8-91de-bc5cc66bb119" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:41:57 user nova-compute[73091]: INFO nova.compute.manager [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Attaching volume 9c698f00-64a1-4d7f-bad5-2d74153a7012 to /dev/vdb
Aug 09 16:41:57 user nova-compute[73091]: DEBUG os_brick.utils [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0f17f0-fbc8-4af6-9826-968263a841a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3f7f62-0e27-4853-977e-bd492aea7ea9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d237b8-1151-4fdc-bfd5-8ed6c634b182]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c47802-8c78-491a-b068-38aa3b8e4e17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:41:57 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:41:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0059f8-7c4a-4a0c-8ec9-e3bddc10a706]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG os_brick.utils [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:41:57 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Updating existing volume attachment record: 3e89611f-3777-4950-acbb-5dfc4033b554 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:41:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquiring lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquiring lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:00 user nova-compute[73091]: INFO nova.compute.manager [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Terminating instance
Aug 09 16:42:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-bc0294d3-3829-4d1a-82a2-38006f56675f req-b51099e5-7195-4d13-8ccf-0b04c949694c service nova] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Received event network-vif-unplugged-795c9edc-7b1f-4c8b-aed6-f9f9e8192759 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bc0294d3-3829-4d1a-82a2-38006f56675f req-b51099e5-7195-4d13-8ccf-0b04c949694c service nova] Acquiring lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bc0294d3-3829-4d1a-82a2-38006f56675f req-b51099e5-7195-4d13-8ccf-0b04c949694c service nova] Lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bc0294d3-3829-4d1a-82a2-38006f56675f req-b51099e5-7195-4d13-8ccf-0b04c949694c service nova] Lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-bc0294d3-3829-4d1a-82a2-38006f56675f req-b51099e5-7195-4d13-8ccf-0b04c949694c service nova] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] No waiting events found dispatching network-vif-unplugged-795c9edc-7b1f-4c8b-aed6-f9f9e8192759 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-bc0294d3-3829-4d1a-82a2-38006f56675f req-b51099e5-7195-4d13-8ccf-0b04c949694c service nova] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Received event network-vif-unplugged-795c9edc-7b1f-4c8b-aed6-f9f9e8192759 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Instance destroyed successfully.
Aug 09 16:42:01 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lazy-loading 'resources' on Instance uuid fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1181497092',display_name='tempest-ServersNegativeTestJSON-server-1181497092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1181497092',id=1,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:33:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e547803499e4aa59f4ec4c4af9bd4da',ramdisk_id='',reservation_id='r-zkwqlwcr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-484230207',owner_user_name='tempest-ServersNegativeTestJSON-484230207-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:33:19Z,user_data=None,user_id='2bcb694325ff4b6ab46c3b26f625ef1f',uuid=fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "address": "fa:16:3e:c2:25:04", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795c9edc-7b", "ovs_interfaceid": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Converting VIF {"id": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "address": "fa:16:3e:c2:25:04", "network": {"id": "450122ab-0e98-4dd4-9f52-82aa1bfaa561", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2089063043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e547803499e4aa59f4ec4c4af9bd4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap795c9edc-7b", "ovs_interfaceid": "795c9edc-7b1f-4c8b-aed6-f9f9e8192759", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:25:04,bridge_name='br-int',has_traffic_filtering=True,id=795c9edc-7b1f-4c8b-aed6-f9f9e8192759,network=Network(450122ab-0e98-4dd4-9f52-82aa1bfaa561),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795c9edc-7b') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG os_vif [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:25:04,bridge_name='br-int',has_traffic_filtering=True,id=795c9edc-7b1f-4c8b-aed6-f9f9e8192759,network=Network(450122ab-0e98-4dd4-9f52-82aa1bfaa561),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795c9edc-7b') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap795c9edc-7b, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:42:01 user nova-compute[73091]: INFO os_vif [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:25:04,bridge_name='br-int',has_traffic_filtering=True,id=795c9edc-7b1f-4c8b-aed6-f9f9e8192759,network=Network(450122ab-0e98-4dd4-9f52-82aa1bfaa561),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap795c9edc-7b')
Aug 09 16:42:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Deleting instance files /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714_del
Aug 09 16:42:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Deletion of /opt/stack/data/nova/instances/fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714_del complete
Aug 09 16:42:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:01 user nova-compute[73091]: INFO nova.compute.manager [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 09 16:42:01 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:42:01 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:42:02 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:42:02 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Took 0.66 seconds to deallocate network for instance.
Aug 09 16:42:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-508142d7-6021-4a82-967c-9604e8d54f4b req-c0276ca4-f06f-458c-9d5a-b81964e6f87f service nova] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Received event network-vif-deleted-795c9edc-7b1f-4c8b-aed6-f9f9e8192759 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:02 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:42:02 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:42:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:03 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Deleted allocations for instance fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714
Aug 09 16:42:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7b94e5b4-58bf-435f-9d1d-ea99dc649399 tempest-ServersNegativeTestJSON-484230207 tempest-ServersNegativeTestJSON-484230207-project-member] Lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.334s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d8af831-5641-4cb7-8e42-8835e1eae741 req-f61e71e5-dc3d-4c18-ba49-0eba727ab442 service nova] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Received event network-vif-plugged-795c9edc-7b1f-4c8b-aed6-f9f9e8192759 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d8af831-5641-4cb7-8e42-8835e1eae741 req-f61e71e5-dc3d-4c18-ba49-0eba727ab442 service nova] Acquiring lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d8af831-5641-4cb7-8e42-8835e1eae741 req-f61e71e5-dc3d-4c18-ba49-0eba727ab442 service nova] Lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d8af831-5641-4cb7-8e42-8835e1eae741 req-f61e71e5-dc3d-4c18-ba49-0eba727ab442 service nova] Lock "fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d8af831-5641-4cb7-8e42-8835e1eae741 req-f61e71e5-dc3d-4c18-ba49-0eba727ab442 service nova] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] No waiting events found dispatching network-vif-plugged-795c9edc-7b1f-4c8b-aed6-f9f9e8192759 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:03 user nova-compute[73091]: WARNING nova.compute.manager [req-8d8af831-5641-4cb7-8e42-8835e1eae741 req-f61e71e5-dc3d-4c18-ba49-0eba727ab442 service nova] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Received unexpected event network-vif-plugged-795c9edc-7b1f-4c8b-aed6-f9f9e8192759 for instance with vm_state deleted and task_state None.
Aug 09 16:42:03 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:42:03 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:42:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:42:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "38051bca-7190-4dff-91d1-3d99b4e4182b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:04 user nova-compute[73091]: DEBUG nova.objects.instance [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lazy-loading 'flavor' on Instance uuid 38051bca-7190-4dff-91d1-3d99b4e4182b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "38051bca-7190-4dff-91d1-3d99b4e4182b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:04 user nova-compute[73091]: INFO nova.compute.manager [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Attaching volume 2983f6b5-0deb-4c7a-8be7-4126c3b4975c to /dev/vdb
Aug 09 16:42:05 user nova-compute[73091]: DEBUG os_brick.utils [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:42:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a27040-aad3-4075-9885-ee7d50ee3205]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfd77af-d25b-4cd0-8966-c51587121e29]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e70d7f-164f-456e-9b51-5c2959afada0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4ad682-7a37-4008-b128-1807dc6e4477]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:42:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:42:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:42:05 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:42:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ce198e-df19-49f7-a138-471cb6063ae1]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:42:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:42:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:42:05 user nova-compute[73091]: DEBUG os_brick.utils [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:42:05 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Updating existing volume attachment record: 3ea80f6d-6ddd-4b8c-b8b4-87e8ee58cf74 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:42:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:07 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:42:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:42:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 16:42:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-18d8e887-0f91-42e1-ba79-13db5aa9b84b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:42:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-18d8e887-0f91-42e1-ba79-13db5aa9b84b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:42:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:42:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid 18d8e887-0f91-42e1-ba79-13db5aa9b84b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Updating instance_info_cache with network_info: [{"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:42:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-18d8e887-0f91-42e1-ba79-13db5aa9b84b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:42:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:42:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:42:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:42:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:42:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:11 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:42:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wUVIiPtC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:42:13 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:42:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:42:13 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:42:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:42:13 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccaa541d-4dcc-477b-90c4-fc942d4b9eb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:42:13 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38b03d4-aa7c-428f-9cb8-552c2270095c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c] added
Aug 09 16:42:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89473e4-9f79-4055-ba2d-3dd7f77ed457]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2edfea-a22c-46e2-ba98-dd1bd76c8553]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wUVIiPtC {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wUVIiPtC" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c230992-b951-4c85-8190-275451a7a2d6]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wUVIiPtC'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3cd73e-caa8-4dc5-adeb-c34afa5594fb]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b47cb6-d92f-49a6-b43c-71835788d42d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:42:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:42:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[11351d10-675b-4ec3-852b-52ed86e2f12b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c, portal: 172.16.0.220,3260]
Aug 09 16:42:14 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c, portal: 172.16.0.220,3260] successful.
Aug 09 16:42:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9b0748-10d1-4938-a12a-43010008f9ff]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2e1a74-1054-456a-b6bc-be70ec4cf850]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:42:14 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:42:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:42:14 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:42:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4580eb-ae93-4ee9-af1d-08c2febb4b23]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wUVIiPtC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfUAobeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:42:14 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:42:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23437626163376161', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437626163376161', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.547s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:42:15 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:42:15 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG nova.objects.instance [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lazy-loading 'flavor' on Instance uuid 38051bca-7190-4dff-91d1-3d99b4e4182b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79ea683-8812-431f-b069-a22bbacbbbb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:42:15 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e493c3e5-298a-4d13-94ba-0742f5a09853]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012] added
Aug 09 16:42:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:42:15 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:42:15 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 16:42:15 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:42:15 user nova-compute[73091]:   <serial>2983f6b5-0deb-4c7a-8be7-4126c3b4975c</serial>
Aug 09 16:42:15 user nova-compute[73091]: </disk>
Aug 09 16:42:15 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[371f0271-c361-4e29-960d-8f9df7ea0d32]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaf7afc-6b73-45f6-8f5d-b03457824fa4]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfUAobeV {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfUAobeV" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf3dfcf-b5e2-4941-b2b9-af4404a22694]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HfUAobeV'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[59307625-a9a4-4490-8cdf-4aec29cc2a95]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4784f4-7cc9-4784-bad5-abf1b543172a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:42:15 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:42:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:42:15 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:42:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9368f122-d1a1-4a89-af5d-b53ebbef4957]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260]
Aug 09 16:42:15 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260] successful.
Aug 09 16:42:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.266s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[438d7c62-6b1d-4bba-ad18-2b1cfe4a3b7e]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[800db112-c6a3-46fb-a904-d06aee341fa9]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:42:15 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:42:15 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:42:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:42:15 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:42:15 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:42:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.623s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] No VIF found with MAC fa:16:3e:25:e0:ab, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6917a9-d47a-4e3f-ad91-526e9b4e34be]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfUAobeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90aae6dc-f1dd-479a-85b7-9c9635c73a09 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.106s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599321.7855656, fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:42:16 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] VM Stopped (Lifecycle Event)
Aug 09 16:42:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6859969f-c5df-4894-80ce-397ccbc1074d None None] [instance: fd8c51b1-48cf-4ea6-a1dc-6ba3651eb714] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.670s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] <== connect_volume: return (2217ms) {'type': 'block', 'scsi_wwn': '23334353635636464', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334353635636464', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lazy-loading 'flavor' on Instance uuid 68d63bc2-d726-49d8-91de-bc5cc66bb119 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:42:16 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:42:16 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 09 16:42:16 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:42:16 user nova-compute[73091]:   <serial>9c698f00-64a1-4d7f-bad5-2d74153a7012</serial>
Aug 09 16:42:16 user nova-compute[73091]: </disk>
Aug 09 16:42:16 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:42:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:17 user nova-compute[73091]: INFO nova.compute.manager [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Rescuing
Aug 09 16:42:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:42:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquired lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:42:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:42:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:42:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:42:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] No VIF found with MAC fa:16:3e:3c:81:07, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:42:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:18 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:42:18 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:42:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7286MB free_disk=25.317291259765625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b336465c-aeb7-47c6-9513-b9ff02182e5f tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.444s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 68d63bc2-d726-49d8-91de-bc5cc66bb119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 93e10fd4-8841-4043-b4e2-7489c4dea3e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 38051bca-7190-4dff-91d1-3d99b4e4182b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f939fe27-017a-481e-babc-147bf98e0132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8fc884a8-24bb-488a-baeb-ef2b1faf239d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance e03ff609-e74d-427d-b6e6-109fbee09e40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f8f52e24-8ce5-4128-a2aa-afc68ceb7213 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance db00ba13-17f9-4441-a5f5-6e0eac6aa541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Updating instance_info_cache with network_info: [{"id": "50f0d7f2-7e34-475a-9d69-145a0e321400", "address": "fa:16:3e:25:e0:ab", "network": {"id": "5868d9d5-2152-496d-93e2-8e1308b2ad18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d65ef533e7c145faae7d9af3815007ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0d7f2-7e", "ovs_interfaceid": "50f0d7f2-7e34-475a-9d69-145a0e321400", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Releasing lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-8eba8204-2af5-43a3-86a6-e4d979bbcdc8 req-6fd0727b-923c-4996-a4b3-f84de5f9ae3a service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received event network-vif-unplugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8eba8204-2af5-43a3-86a6-e4d979bbcdc8 req-6fd0727b-923c-4996-a4b3-f84de5f9ae3a service nova] Acquiring lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8eba8204-2af5-43a3-86a6-e4d979bbcdc8 req-6fd0727b-923c-4996-a4b3-f84de5f9ae3a service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8eba8204-2af5-43a3-86a6-e4d979bbcdc8 req-6fd0727b-923c-4996-a4b3-f84de5f9ae3a service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-8eba8204-2af5-43a3-86a6-e4d979bbcdc8 req-6fd0727b-923c-4996-a4b3-f84de5f9ae3a service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] No waiting events found dispatching network-vif-unplugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:19 user nova-compute[73091]: WARNING nova.compute.manager [req-8eba8204-2af5-43a3-86a6-e4d979bbcdc8 req-6fd0727b-923c-4996-a4b3-f84de5f9ae3a service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received unexpected event network-vif-unplugged-50f0d7f2-7e34-475a-9d69-145a0e321400 for instance with vm_state active and task_state rescuing.
Aug 09 16:42:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Instance destroyed successfully.
Aug 09 16:42:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Attempting a stable device rescue
Aug 09 16:42:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73091) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 16:42:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 16:42:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Creating image(s)
Aug 09 16:42:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "/opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "/opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "/opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:19 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lazy-loading 'trusted_certs' on Instance uuid 38051bca-7190-4dff-91d1-3d99b4e4182b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "917569f1dce69a44fc92d53b961ff96192840a3f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "917569f1dce69a44fc92d53b961ff96192840a3f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/917569f1dce69a44fc92d53b961ff96192840a3f.part --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/917569f1dce69a44fc92d53b961ff96192840a3f.part --force-share --output=json" returned: 0 in 0.130s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:20 user nova-compute[73091]: DEBUG nova.virt.images [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] 41e64886-935d-460f-9983-46d9e05002a8 was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 16:42:20 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 16:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/917569f1dce69a44fc92d53b961ff96192840a3f.part /opt/stack/data/nova/instances/_base/917569f1dce69a44fc92d53b961ff96192840a3f.converted {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Stashing vm_state: active {{(pid=73091) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 09 16:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/917569f1dce69a44fc92d53b961ff96192840a3f.part /opt/stack/data/nova/instances/_base/917569f1dce69a44fc92d53b961ff96192840a3f.converted" returned: 0 in 0.260s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/917569f1dce69a44fc92d53b961ff96192840a3f.converted --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lazy-loading 'pci_requests' on Instance uuid 68d63bc2-d726-49d8-91de-bc5cc66bb119 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:42:20 user nova-compute[73091]: INFO nova.compute.claims [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Claim successful on node user
Aug 09 16:42:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lazy-loading 'resources' on Instance uuid 68d63bc2-d726-49d8-91de-bc5cc66bb119 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/917569f1dce69a44fc92d53b961ff96192840a3f.converted --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "917569f1dce69a44fc92d53b961ff96192840a3f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.424s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lazy-loading 'pci_devices' on Instance uuid 68d63bc2-d726-49d8-91de-bc5cc66bb119 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "917569f1dce69a44fc92d53b961ff96192840a3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "917569f1dce69a44fc92d53b961ff96192840a3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/917569f1dce69a44fc92d53b961ff96192840a3f --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:20 user nova-compute[73091]: INFO nova.compute.resource_tracker [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Updating resource usage from migration 0c59254d-ea01-46db-919b-e65f5d788c1f
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/917569f1dce69a44fc92d53b961ff96192840a3f --force-share --output=json" returned: 0 in 0.149s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "148cb211-b2f6-4782-8f35-e66a55cc95bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "148cb211-b2f6-4782-8f35-e66a55cc95bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/917569f1dce69a44fc92d53b961ff96192840a3f,backing_fmt=raw /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk.rescue {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-63005e56-25a6-4b3b-803c-85ab73700271 req-f8335142-ed84-4518-b696-3036fb41f848 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received event network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-63005e56-25a6-4b3b-803c-85ab73700271 req-f8335142-ed84-4518-b696-3036fb41f848 service nova] Acquiring lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-63005e56-25a6-4b3b-803c-85ab73700271 req-f8335142-ed84-4518-b696-3036fb41f848 service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-63005e56-25a6-4b3b-803c-85ab73700271 req-f8335142-ed84-4518-b696-3036fb41f848 service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-63005e56-25a6-4b3b-803c-85ab73700271 req-f8335142-ed84-4518-b696-3036fb41f848 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] No waiting events found dispatching network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:21 user nova-compute[73091]: WARNING nova.compute.manager [req-63005e56-25a6-4b3b-803c-85ab73700271 req-f8335142-ed84-4518-b696-3036fb41f848 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received unexpected event network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 for instance with vm_state active and task_state rescuing.
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/917569f1dce69a44fc92d53b961ff96192840a3f,backing_fmt=raw /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk.rescue" returned: 0 in 0.070s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "917569f1dce69a44fc92d53b961ff96192840a3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lazy-loading 'migration_context' on Instance uuid 38051bca-7190-4dff-91d1-3d99b4e4182b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Start _get_guest_xml network_info=[{"id": "50f0d7f2-7e34-475a-9d69-145a0e321400", "address": "fa:16:3e:25:e0:ab", "network": {"id": "5868d9d5-2152-496d-93e2-8e1308b2ad18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "vif_mac": "fa:16:3e:25:e0:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d65ef533e7c145faae7d9af3815007ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0d7f2-7e", "ovs_interfaceid": "50f0d7f2-7e34-475a-9d69-145a0e321400", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '41e64886-935d-460f-9983-46d9e05002a8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '3ea80f6d-6ddd-4b8c-b8b4-87e8ee58cf74', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wUVIiPtC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '38051bca-7190-4dff-91d1-3d99b4e4182b', 'attached_at': '', 'detached_at': '', 'volume_id': '2983f6b5-0deb-4c7a-8be7-4126c3b4975c', 'serial': '2983f6b5-0deb-4c7a-8be7-4126c3b4975c'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lazy-loading 'resources' on Instance uuid 38051bca-7190-4dff-91d1-3d99b4e4182b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lazy-loading 'numa_topology' on Instance uuid 38051bca-7190-4dff-91d1-3d99b4e4182b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:21 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:42:21 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "4a39f479-265c-49c3-86c4-a65fff2f06c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "4a39f479-265c-49c3-86c4-a65fff2f06c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lazy-loading 'vcpu_model' on Instance uuid 38051bca-7190-4dff-91d1-3d99b4e4182b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wUVIiPtC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:42:21 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:42:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:42:21 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:42:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:42:21 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba168de6-878d-4924-87d8-11e9450601b5]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = wUVIiPtC\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 16:42:21 user nova-compute[73091]: node.name = iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c
Aug 09 16:42:21 user nova-compute[73091]: node.tpgt = -1
Aug 09 16:42:21 user nova-compute[73091]: node.startup = automatic
Aug 09 16:42:21 user nova-compute[73091]: node.leading_login = No
Aug 09 16:42:21 user nova-compute[73091]: iface.iscsi_ifacename = default
Aug 09 16:42:21 user nova-compute[73091]: iface.net_ifacename = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.ipaddress = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.prefix_len = 0
Aug 09 16:42:21 user nova-compute[73091]: iface.hwaddress = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.transport_name = tcp
Aug 09 16:42:21 user nova-compute[73091]: iface.initiatorname = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.state = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.vlan_id = 0
Aug 09 16:42:21 user nova-compute[73091]: iface.vlan_priority = 0
Aug 09 16:42:21 user nova-compute[73091]: iface.vlan_state = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.iface_num = 0
Aug 09 16:42:21 user nova-compute[73091]: iface.mtu = 0
Aug 09 16:42:21 user nova-compute[73091]: iface.port = 0
Aug 09 16:42:21 user nova-compute[73091]: iface.bootproto = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.subnet_mask = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.gateway = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.dhcp_alt_client_id = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.dhcp_dns = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.dhcp_learn_iqn = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.dhcp_vendor_id_state = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.dhcp_vendor_id = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.dhcp_slp_da = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.fragmentation = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.gratuitous_arp = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.incoming_forwarding = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.tos_state = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.tos = 0
Aug 09 16:42:21 user nova-compute[73091]: iface.ttl = 0
Aug 09 16:42:21 user nova-compute[73091]: iface.delayed_ack = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.tcp_nagle = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.tcp_wsf_state = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.tcp_wsf = 0
Aug 09 16:42:21 user nova-compute[73091]: iface.tcp_timer_scale = 0
Aug 09 16:42:21 user nova-compute[73091]: iface.tcp_timestamp = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.redirect = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.def_task_mgmt_timeout = 0
Aug 09 16:42:21 user nova-compute[73091]: iface.header_digest = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.data_digest = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.immediate_data = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.initial_r2t = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.data_seq_inorder = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.data_pdu_inorder = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.erl = 0
Aug 09 16:42:21 user nova-compute[73091]: iface.max_receive_data_len = 0
Aug 09 16:42:21 user nova-compute[73091]: iface.first_burst_len = 0
Aug 09 16:42:21 user nova-compute[73091]: iface.max_outstanding_r2t = 0
Aug 09 16:42:21 user nova-compute[73091]: iface.max_burst_len = 0
Aug 09 16:42:21 user nova-compute[73091]: iface.chap_auth = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.bidi_chap = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.strict_login_compliance = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.discovery_auth = <empty>
Aug 09 16:42:21 user nova-compute[73091]: iface.discovery_logout = <empty>
Aug 09 16:42:21 user nova-compute[73091]: node.discovery_address = <empty>
Aug 09 16:42:21 user nova-compute[73091]: node.discovery_port = 0
Aug 09 16:42:21 user nova-compute[73091]: node.discovery_type = static
Aug 09 16:42:21 user nova-compute[73091]: node.session.initial_cmdsn = 0
Aug 09 16:42:21 user nova-compute[73091]: node.session.initial_login_retry_max = 8
Aug 09 16:42:21 user nova-compute[73091]: node.session.xmit_thread_priority = -20
Aug 09 16:42:21 user nova-compute[73091]: node.session.cmds_max = 128
Aug 09 16:42:21 user nova-compute[73091]: node.session.queue_depth = 32
Aug 09 16:42:21 user nova-compute[73091]: node.session.nr_sessions = 1
Aug 09 16:42:21 user nova-compute[73091]: node.session.auth.authmethod = CHAP
Aug 09 16:42:21 user nova-compute[73091]: node.session.auth.username = wUVIiPtC
Aug 09 16:42:21 user nova-compute[73091]: node.session.auth.password = ***
Aug 09 16:42:21 user nova-compute[73091]: node.session.auth.username_in = <empty>
Aug 09 16:42:21 user nova-compute[73091]: node.session.auth.password_in = <empty>
Aug 09 16:42:21 user nova-compute[73091]: node.session.auth.chap_algs = MD5
Aug 09 16:42:21 user nova-compute[73091]: node.session.timeo.replacement_timeout = 120
Aug 09 16:42:21 user nova-compute[73091]: node.session.err_timeo.abort_timeout = 15
Aug 09 16:42:21 user nova-compute[73091]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 16:42:21 user nova-compute[73091]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 16:42:21 user nova-compute[73091]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 16:42:21 user nova-compute[73091]: node.session.iscsi.FastAbort = Yes
Aug 09 16:42:21 user nova-compute[73091]: node.session.iscsi.InitialR2T = No
Aug 09 16:42:21 user nova-compute[73091]: node.session.iscsi.ImmediateData = Yes
Aug 09 16:42:21 user nova-compute[73091]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 16:42:21 user nova-compute[73091]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 16:42:21 user nova-compute[73091]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 16:42:21 user nova-compute[73091]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 16:42:21 user nova-compute[73091]: node.session.iscsi.MaxConnections = 1
Aug 09 16:42:21 user nova-compute[73091]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 16:42:21 user nova-compute[73091]: node.session.iscsi.ERL = 0
Aug 09 16:42:21 user nova-compute[73091]: node.session.scan = manual
Aug 09 16:42:21 user nova-compute[73091]: node.session.reopen_max = 0
Aug 09 16:42:21 user nova-compute[73091]: node.conn[0].address = 172.16.0.220
Aug 09 16:42:21 user nova-compute[73091]: node.conn[0].port = 3260
Aug 09 16:42:21 user nova-compute[73091]: node.conn[0].startup = manual
Aug 09 16:42:21 user nova-compute[73091]: node.conn[0].tcp.window_size = 524288
Aug 09 16:42:21 user nova-compute[73091]: node.conn[0].tcp.type_of_service = 0
Aug 09 16:42:21 user nova-compute[73091]: node.conn[0].timeo.logout_timeout = 15
Aug 09 16:42:21 user nova-compute[73091]: node.conn[0].timeo.login_timeout = 15
Aug 09 16:42:21 user nova-compute[73091]: node.conn[0].timeo.auth_timeout = 45
Aug 09 16:42:21 user nova-compute[73091]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 16:42:21 user nova-compute[73091]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 16:42:21 user nova-compute[73091]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 16:42:21 user nova-compute[73091]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 16:42:21 user nova-compute[73091]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 16:42:21 user nova-compute[73091]: node.conn[0].iscsi.DataDigest = None
Aug 09 16:42:21 user nova-compute[73091]: node.conn[0].iscsi.IFMarker = No
Aug 09 16:42:21 user nova-compute[73091]: node.conn[0].iscsi.OFMarker = No
Aug 09 16:42:21 user nova-compute[73091]: # END RECORD
Aug 09 16:42:21 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e883828-cec3-4a60-b479-2a506cfac7e8]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2779a29f-4dbf-4368-8f54-4f6dc2d6d531]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wUVIiPtC {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wUVIiPtC" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a95cb9-2c99-43d4-a8f2-56bd83eb038a]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wUVIiPtC'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab916a0e-82ba-4ccf-822c-084e85d26510]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f34653-b89b-4cc6-8448-2e36825a7319]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:42:21 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:42:21 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:42:21 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:42:21 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:42:21 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:42:21 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.157s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] HCTL ('33', '0', '0', 0) found on session 24 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27398b6-ff21-4da4-8792-58953ef8ab54]: (4, ('0 0 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Searching for a device in session 24 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wUVIiPtC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.180s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] <== connect_volume: return (181ms) {'type': 'block', 'scsi_wwn': '23437626163376161', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437626163376161', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.649s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:21 user nova-compute[73091]: INFO nova.compute.manager [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Migrating
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.283s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:21 user nova-compute[73091]: INFO nova.compute.rpcapi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-261726215',display_name='tempest-ServerStableDeviceRescueTest-server-261726215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-261726215',id=17,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDt6bgWOl3OaJeJplczLpq3pEO+nQ0SnhcLURWVFOG9Ust3RYcVv/4I32bnc6u3NQSYIpFhMkkFOddkSUUubBFd//CxBbSxsh9Y6SvTjHrUjqSbV15wPCQRXhXN07VEozQ==',key_name='tempest-keypair-1192423936',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:38:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d65ef533e7c145faae7d9af3815007ac',ramdisk_id='',reservation_id='r-p601w4u8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-345363851',owner_user_name='tempest-ServerStableDeviceRescueTest-345363851-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:40:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fee448a86074a69ac5a45ac5b010069',uuid=38051bca-7190-4dff-91d1-3d99b4e4182b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50f0d7f2-7e34-475a-9d69-145a0e321400", "address": "fa:16:3e:25:e0:ab", "network": {"id": "5868d9d5-2152-496d-93e2-8e1308b2ad18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "vif_mac": "fa:16:3e:25:e0:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d65ef533e7c145faae7d9af3815007ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0d7f2-7e", "ovs_interfaceid": "50f0d7f2-7e34-475a-9d69-145a0e321400", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Converting VIF {"id": "50f0d7f2-7e34-475a-9d69-145a0e321400", "address": "fa:16:3e:25:e0:ab", "network": {"id": "5868d9d5-2152-496d-93e2-8e1308b2ad18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "vif_mac": "fa:16:3e:25:e0:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d65ef533e7c145faae7d9af3815007ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0d7f2-7e", "ovs_interfaceid": "50f0d7f2-7e34-475a-9d69-145a0e321400", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:e0:ab,bridge_name='br-int',has_traffic_filtering=True,id=50f0d7f2-7e34-475a-9d69-145a0e321400,network=Network(5868d9d5-2152-496d-93e2-8e1308b2ad18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f0d7f2-7e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lazy-loading 'pci_devices' on Instance uuid 38051bca-7190-4dff-91d1-3d99b4e4182b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:42:21 user nova-compute[73091]: INFO nova.compute.claims [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Claim successful on node user
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:42:21 user nova-compute[73091]:   <uuid>38051bca-7190-4dff-91d1-3d99b4e4182b</uuid>
Aug 09 16:42:21 user nova-compute[73091]:   <name>instance-00000011</name>
Aug 09 16:42:21 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:42:21 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:42:21 user nova-compute[73091]:   <metadata>
Aug 09 16:42:21 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:42:21 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:42:21 user nova-compute[73091]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-261726215</nova:name>
Aug 09 16:42:21 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:42:21</nova:creationTime>
Aug 09 16:42:21 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:42:21 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:42:21 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:42:21 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:42:21 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:42:21 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:42:21 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:42:21 user nova-compute[73091]:       <nova:owner>
Aug 09 16:42:21 user nova-compute[73091]:         <nova:user uuid="1fee448a86074a69ac5a45ac5b010069">tempest-ServerStableDeviceRescueTest-345363851-project-member</nova:user>
Aug 09 16:42:21 user nova-compute[73091]:         <nova:project uuid="d65ef533e7c145faae7d9af3815007ac">tempest-ServerStableDeviceRescueTest-345363851</nova:project>
Aug 09 16:42:21 user nova-compute[73091]:       </nova:owner>
Aug 09 16:42:21 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:42:21 user nova-compute[73091]:       <nova:ports>
Aug 09 16:42:21 user nova-compute[73091]:         <nova:port uuid="50f0d7f2-7e34-475a-9d69-145a0e321400">
Aug 09 16:42:21 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 16:42:21 user nova-compute[73091]:         </nova:port>
Aug 09 16:42:21 user nova-compute[73091]:       </nova:ports>
Aug 09 16:42:21 user nova-compute[73091]:     </nova:instance>
Aug 09 16:42:21 user nova-compute[73091]:   </metadata>
Aug 09 16:42:21 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:42:21 user nova-compute[73091]:     <system>
Aug 09 16:42:21 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:42:21 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:42:21 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:42:21 user nova-compute[73091]:       <entry name="serial">38051bca-7190-4dff-91d1-3d99b4e4182b</entry>
Aug 09 16:42:21 user nova-compute[73091]:       <entry name="uuid">38051bca-7190-4dff-91d1-3d99b4e4182b</entry>
Aug 09 16:42:21 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:42:21 user nova-compute[73091]:     </system>
Aug 09 16:42:21 user nova-compute[73091]:   </sysinfo>
Aug 09 16:42:21 user nova-compute[73091]:   <os>
Aug 09 16:42:21 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:42:21 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:42:21 user nova-compute[73091]:   </os>
Aug 09 16:42:21 user nova-compute[73091]:   <features>
Aug 09 16:42:21 user nova-compute[73091]:     <acpi/>
Aug 09 16:42:21 user nova-compute[73091]:     <apic/>
Aug 09 16:42:21 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:42:21 user nova-compute[73091]:   </features>
Aug 09 16:42:21 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:42:21 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:42:21 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:42:21 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:42:21 user nova-compute[73091]:   </clock>
Aug 09 16:42:21 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:42:21 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:42:21 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:42:21 user nova-compute[73091]:   </cpu>
Aug 09 16:42:21 user nova-compute[73091]:   <devices>
Aug 09 16:42:21 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:42:21 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:42:21 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk"/>
Aug 09 16:42:21 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:42:21 user nova-compute[73091]:     </disk>
Aug 09 16:42:21 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:42:21 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:42:21 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 09 16:42:21 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 09 16:42:21 user nova-compute[73091]:       <serial>2983f6b5-0deb-4c7a-8be7-4126c3b4975c</serial>
Aug 09 16:42:21 user nova-compute[73091]:     </disk>
Aug 09 16:42:21 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:42:21 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:42:21 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk.rescue"/>
Aug 09 16:42:21 user nova-compute[73091]:       <target dev="vdc" bus="virtio"/>
Aug 09 16:42:21 user nova-compute[73091]:       <boot order="1"/>
Aug 09 16:42:21 user nova-compute[73091]:     </disk>
Aug 09 16:42:21 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:42:21 user nova-compute[73091]:       <mac address="fa:16:3e:25:e0:ab"/>
Aug 09 16:42:21 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:42:21 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:42:21 user nova-compute[73091]:       <target dev="tap50f0d7f2-7e"/>
Aug 09 16:42:21 user nova-compute[73091]:     </interface>
Aug 09 16:42:21 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:42:21 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/console.log" append="off"/>
Aug 09 16:42:21 user nova-compute[73091]:     </serial>
Aug 09 16:42:21 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:42:21 user nova-compute[73091]:     <video>
Aug 09 16:42:21 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:42:21 user nova-compute[73091]:     </video>
Aug 09 16:42:21 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:42:21 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:42:21 user nova-compute[73091]:     </rng>
Aug 09 16:42:21 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:42:21 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:42:21 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:42:21 user nova-compute[73091]:     </memballoon>
Aug 09 16:42:21 user nova-compute[73091]:   </devices>
Aug 09 16:42:21 user nova-compute[73091]: </domain>
Aug 09 16:42:21 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquired lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:42:21 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Instance destroyed successfully.
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] No VIF found with MAC fa:16:3e:25:e0:ab, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:42:21 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.693s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:42:22 user nova-compute[73091]: INFO nova.compute.claims [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Claim successful on node user
Aug 09 16:42:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:42:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:42:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Updating instance_info_cache with network_info: [{"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Releasing lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG nova.policy [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69ccebf0e9d54502a2318c809ce11369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d3dfd232d54594808dad271baa5192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:42:22 user nova-compute[73091]: INFO nova.virt.block_device [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Booting with volume cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a at /dev/vda
Aug 09 16:42:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Starting migrate_disk_and_power_off {{(pid=73091) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG os_brick.utils [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bcf007-5f86-440d-9a9a-c8910f8c58df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2596a762-c1eb-4940-805b-1c4609d46a1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[116d7408-85e3-4018-8e37-3107039277cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b72c92-acda-4569-931b-3dacb33b6783]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:42:22 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6ce51e-c40c-42a6-aed9-4386b018defd]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG os_brick.utils [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Updating existing volume attachment record: e16db8dc-8431-4594-b748-0d6d41203646 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:42:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:42:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-b5328b3c-5b41-49dd-afd4-9c580f908fdd req-b17f2a09-04b6-46c0-92d8-6cc21c4132f1 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received event network-vif-unplugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b5328b3c-5b41-49dd-afd4-9c580f908fdd req-b17f2a09-04b6-46c0-92d8-6cc21c4132f1 service nova] Acquiring lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b5328b3c-5b41-49dd-afd4-9c580f908fdd req-b17f2a09-04b6-46c0-92d8-6cc21c4132f1 service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b5328b3c-5b41-49dd-afd4-9c580f908fdd req-b17f2a09-04b6-46c0-92d8-6cc21c4132f1 service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-b5328b3c-5b41-49dd-afd4-9c580f908fdd req-b17f2a09-04b6-46c0-92d8-6cc21c4132f1 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] No waiting events found dispatching network-vif-unplugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:22 user nova-compute[73091]: WARNING nova.compute.manager [req-b5328b3c-5b41-49dd-afd4-9c580f908fdd req-b17f2a09-04b6-46c0-92d8-6cc21c4132f1 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received unexpected event network-vif-unplugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 for instance with vm_state active and task_state resize_migrating.
Aug 09 16:42:22 user nova-compute[73091]: DEBUG nova.policy [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a5c393d644c4c3f8e9cbb0805ba7c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f2275630ce4d55bf02851df830b6bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:42:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Creating image(s)
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "/opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "/opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.158s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.217s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk 1073741824" returned: 0 in 0.067s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Successfully created port: 23754e3d-f575-4074-b60b-f1104372977b {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Cannot resize image /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'migration_context' on Instance uuid 4a39f479-265c-49c3-86c4-a65fff2f06c4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Ensure instance console log exists: /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:23 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Instance destroyed successfully.
Aug 09 16:42:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1756856509',display_name='tempest-ServerActionsTestOtherB-server-1756856509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1756856509',id=15,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX4A4WBbci8tvlyfsVn8RtvZ67v0qxFwI098O4ybt1xkpAJgwLMitJ+vOXZXn9ziILn0Dux9cadl75sAIWbob/GvRq9Jin537WzoAVu2MvbyterRxvGm1tqvtVxJqTjrw==',key_name='tempest-keypair-561558216',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:38:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='329738ae9226414383acb6dcbd09dea0',ramdisk_id='',reservation_id='r-r2gg9o0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1665559429',owner_user_name='tempest-ServerActionsTestOtherB-1665559429-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:42:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a90a17815b46b8a64be7510ac5ba49',uuid=68d63bc2-d726-49d8-91de-bc5cc66bb119,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-815237771-network", "vif_mac": "fa:16:3e:3c:81:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Converting VIF {"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-815237771-network", "vif_mac": "fa:16:3e:3c:81:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG os_vif [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93d41bee-7c, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:23 user nova-compute[73091]: INFO os_vif [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c')
Aug 09 16:42:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfUAobeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:42:23 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:42:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[909bb3b9-04fa-4e13-9081-c0ffe0d20e97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a83d93c-d424-4b3d-bdf6-ab70d1cef706]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:42:23 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:42:23 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:42:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:42:23 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:42:23 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:42:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff08012add0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[442b266d-a346-45ec-876c-e7f8b311c20b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4032a2-20cd-4871-a3be-95c86e4c33e4]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b58a20-18ee-4c7f-aea7-a6d0800deae5]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9297f276-84fe-4732-83b8-9665d4809249]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7841be-6304-40c6-a4b9-994405b5d814]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-400d235e-061a-4274-817e-cbe9bdd0c339 req-75d8689a-7b3a-4b60-8109-b164e69344cf service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received event network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-400d235e-061a-4274-817e-cbe9bdd0c339 req-75d8689a-7b3a-4b60-8109-b164e69344cf service nova] Acquiring lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-400d235e-061a-4274-817e-cbe9bdd0c339 req-75d8689a-7b3a-4b60-8109-b164e69344cf service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-400d235e-061a-4274-817e-cbe9bdd0c339 req-75d8689a-7b3a-4b60-8109-b164e69344cf service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-400d235e-061a-4274-817e-cbe9bdd0c339 req-75d8689a-7b3a-4b60-8109-b164e69344cf service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] No waiting events found dispatching network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:24 user nova-compute[73091]: WARNING nova.compute.manager [req-400d235e-061a-4274-817e-cbe9bdd0c339 req-75d8689a-7b3a-4b60-8109-b164e69344cf service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received unexpected event network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 for instance with vm_state active and task_state rescuing.
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bb1e91-8fb2-48ec-baf3-d09f415e195c]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260]
Aug 09 16:42:24 user nova-compute[73091]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260] successful.
Aug 09 16:42:24 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6817514-8917-4e86-899f-e7929a867c1b]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] <== disconnect_volume: return (366ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119_resize/disk /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Successfully created port: 7c149e7c-01fc-4bfc-a69d-8c1841f904e9 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Successfully updated port: 23754e3d-f575-4074-b60b-f1104372977b {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "refresh_cache-148cb211-b2f6-4782-8f35-e66a55cc95bc" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquired lock "refresh_cache-148cb211-b2f6-4782-8f35-e66a55cc95bc" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-b788d7e7-bc95-4250-92f1-bc8f4a8f8a8b req-ccb0da7a-98f0-45ef-a412-9c514466998f service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received event network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b788d7e7-bc95-4250-92f1-bc8f4a8f8a8b req-ccb0da7a-98f0-45ef-a412-9c514466998f service nova] Acquiring lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b788d7e7-bc95-4250-92f1-bc8f4a8f8a8b req-ccb0da7a-98f0-45ef-a412-9c514466998f service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b788d7e7-bc95-4250-92f1-bc8f4a8f8a8b req-ccb0da7a-98f0-45ef-a412-9c514466998f service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-b788d7e7-bc95-4250-92f1-bc8f4a8f8a8b req-ccb0da7a-98f0-45ef-a412-9c514466998f service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] No waiting events found dispatching network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:24 user nova-compute[73091]: WARNING nova.compute.manager [req-b788d7e7-bc95-4250-92f1-bc8f4a8f8a8b req-ccb0da7a-98f0-45ef-a412-9c514466998f service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received unexpected event network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 for instance with vm_state active and task_state resize_migrating.
Aug 09 16:42:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-b788d7e7-bc95-4250-92f1-bc8f4a8f8a8b req-ccb0da7a-98f0-45ef-a412-9c514466998f service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Received event network-changed-23754e3d-f575-4074-b60b-f1104372977b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-b788d7e7-bc95-4250-92f1-bc8f4a8f8a8b req-ccb0da7a-98f0-45ef-a412-9c514466998f service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Refreshing instance network info cache due to event network-changed-23754e3d-f575-4074-b60b-f1104372977b. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b788d7e7-bc95-4250-92f1-bc8f4a8f8a8b req-ccb0da7a-98f0-45ef-a412-9c514466998f service nova] Acquiring lock "refresh_cache-148cb211-b2f6-4782-8f35-e66a55cc95bc" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CMD "cp -r /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119_resize/disk /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk" returned: 0 in 0.472s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119_resize/disk.info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk.info {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CMD "cp -r /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119_resize/disk.info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk.info" returned: 0 in 0.042s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Updating instance_info_cache with network_info: [{"id": "23754e3d-f575-4074-b60b-f1104372977b", "address": "fa:16:3e:b8:14:7c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23754e3d-f5", "ovs_interfaceid": "23754e3d-f575-4074-b60b-f1104372977b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:42:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Releasing lock "refresh_cache-148cb211-b2f6-4782-8f35-e66a55cc95bc" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:42:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Instance network_info: |[{"id": "23754e3d-f575-4074-b60b-f1104372977b", "address": "fa:16:3e:b8:14:7c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23754e3d-f5", "ovs_interfaceid": "23754e3d-f575-4074-b60b-f1104372977b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:42:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b788d7e7-bc95-4250-92f1-bc8f4a8f8a8b req-ccb0da7a-98f0-45ef-a412-9c514466998f service nova] Acquired lock "refresh_cache-148cb211-b2f6-4782-8f35-e66a55cc95bc" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:42:25 user nova-compute[73091]: DEBUG nova.network.neutron [req-b788d7e7-bc95-4250-92f1-bc8f4a8f8a8b req-ccb0da7a-98f0-45ef-a412-9c514466998f service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Refreshing network info cache for port 23754e3d-f575-4074-b60b-f1104372977b {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:42:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Successfully updated port: 7c149e7c-01fc-4bfc-a69d-8c1841f904e9 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:42:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "refresh_cache-4a39f479-265c-49c3-86c4-a65fff2f06c4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:42:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquired lock "refresh_cache-4a39f479-265c-49c3-86c4-a65fff2f06c4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:42:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:42:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Removed pending event for 38051bca-7190-4dff-91d1-3d99b4e4182b due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599345.9999409, 38051bca-7190-4dff-91d1-3d99b4e4182b => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:42:26 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] VM Resumed (Lifecycle Event)
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8ac2f49f-130e-4a35-a133-31ed611063c6 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:42:26 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599346.006429, 38051bca-7190-4dff-91d1-3d99b4e4182b => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:42:26 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] VM Started (Lifecycle Event)
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-75000e48-693a-4c49-a1f5-b388bebd266f req-339b2a2b-df0a-40d7-89fb-543c714c4760 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received event network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-75000e48-693a-4c49-a1f5-b388bebd266f req-339b2a2b-df0a-40d7-89fb-543c714c4760 service nova] Acquiring lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-75000e48-693a-4c49-a1f5-b388bebd266f req-339b2a2b-df0a-40d7-89fb-543c714c4760 service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-75000e48-693a-4c49-a1f5-b388bebd266f req-339b2a2b-df0a-40d7-89fb-543c714c4760 service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-75000e48-693a-4c49-a1f5-b388bebd266f req-339b2a2b-df0a-40d7-89fb-543c714c4760 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] No waiting events found dispatching network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:26 user nova-compute[73091]: WARNING nova.compute.manager [req-75000e48-693a-4c49-a1f5-b388bebd266f req-339b2a2b-df0a-40d7-89fb-543c714c4760 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received unexpected event network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 for instance with vm_state rescued and task_state None.
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-75000e48-693a-4c49-a1f5-b388bebd266f req-339b2a2b-df0a-40d7-89fb-543c714c4760 service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Received event network-changed-7c149e7c-01fc-4bfc-a69d-8c1841f904e9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-75000e48-693a-4c49-a1f5-b388bebd266f req-339b2a2b-df0a-40d7-89fb-543c714c4760 service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Refreshing instance network info cache due to event network-changed-7c149e7c-01fc-4bfc-a69d-8c1841f904e9. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-75000e48-693a-4c49-a1f5-b388bebd266f req-339b2a2b-df0a-40d7-89fb-543c714c4760 service nova] Acquiring lock "refresh_cache-4a39f479-265c-49c3-86c4-a65fff2f06c4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.network.neutron [req-b788d7e7-bc95-4250-92f1-bc8f4a8f8a8b req-ccb0da7a-98f0-45ef-a412-9c514466998f service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Updated VIF entry in instance network info cache for port 23754e3d-f575-4074-b60b-f1104372977b. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.network.neutron [req-b788d7e7-bc95-4250-92f1-bc8f4a8f8a8b req-ccb0da7a-98f0-45ef-a412-9c514466998f service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Updating instance_info_cache with network_info: [{"id": "23754e3d-f575-4074-b60b-f1104372977b", "address": "fa:16:3e:b8:14:7c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23754e3d-f5", "ovs_interfaceid": "23754e3d-f575-4074-b60b-f1104372977b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Acquiring lock "91d979ce-00bf-4a15-841c-b6b66092c874" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Lock "91d979ce-00bf-4a15-841c-b6b66092c874" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b788d7e7-bc95-4250-92f1-bc8f4a8f8a8b req-ccb0da7a-98f0-45ef-a412-9c514466998f service nova] Releasing lock "refresh_cache-148cb211-b2f6-4782-8f35-e66a55cc95bc" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Port 93d41bee-7cab-45a7-b409-dd19fc3b88b6 binding to destination host user is already ACTIVE {{(pid=73091) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:42:26 user nova-compute[73091]: INFO nova.compute.claims [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Claim successful on node user
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Updating instance_info_cache with network_info: [{"id": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "address": "fa:16:3e:89:17:f3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c149e7c-01", "ovs_interfaceid": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Releasing lock "refresh_cache-4a39f479-265c-49c3-86c4-a65fff2f06c4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Instance network_info: |[{"id": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "address": "fa:16:3e:89:17:f3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c149e7c-01", "ovs_interfaceid": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-75000e48-693a-4c49-a1f5-b388bebd266f req-339b2a2b-df0a-40d7-89fb-543c714c4760 service nova] Acquired lock "refresh_cache-4a39f479-265c-49c3-86c4-a65fff2f06c4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.network.neutron [req-75000e48-693a-4c49-a1f5-b388bebd266f req-339b2a2b-df0a-40d7-89fb-543c714c4760 service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Refreshing network info cache for port 7c149e7c-01fc-4bfc-a69d-8c1841f904e9 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Start _get_guest_xml network_info=[{"id": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "address": "fa:16:3e:89:17:f3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c149e7c-01", "ovs_interfaceid": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:42:26 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:42:26 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1748631261',display_name='tempest-AttachVolumeNegativeTest-server-1748631261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1748631261',id=26,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLYGzKthf41kJWgs1eItgXBE4Y6m6IFtDLHIY7mbx+frJqx2Yp7ne3YHnedZDEYOqprhRc3EDjFjFBndAXrtclsHGulkjfmcIkZr/cpxMOlnt3LJfeqChutV9gD/NFJag==',key_name='tempest-keypair-1708049104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27f2275630ce4d55bf02851df830b6bd',ramdisk_id='',reservation_id='r-ycmzjawr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-604747333',owner_user_name='tempest-AttachVolumeNegativeTest-604747333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a5c393d644c4c3f8e9cbb0805ba7c08',uuid=4a39f479-265c-49c3-86c4-a65fff2f06c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "address": "fa:16:3e:89:17:f3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c149e7c-01", "ovs_interfaceid": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converting VIF {"id": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "address": "fa:16:3e:89:17:f3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c149e7c-01", "ovs_interfaceid": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:17:f3,bridge_name='br-int',has_traffic_filtering=True,id=7c149e7c-01fc-4bfc-a69d-8c1841f904e9,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c149e7c-01') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a39f479-265c-49c3-86c4-a65fff2f06c4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:42:26 user nova-compute[73091]:   <uuid>4a39f479-265c-49c3-86c4-a65fff2f06c4</uuid>
Aug 09 16:42:26 user nova-compute[73091]:   <name>instance-0000001a</name>
Aug 09 16:42:26 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:42:26 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:42:26 user nova-compute[73091]:   <metadata>
Aug 09 16:42:26 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:42:26 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:42:26 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1748631261</nova:name>
Aug 09 16:42:26 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:42:26</nova:creationTime>
Aug 09 16:42:26 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:42:26 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:42:26 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:42:26 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:42:26 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:42:26 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:42:26 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:42:26 user nova-compute[73091]:       <nova:owner>
Aug 09 16:42:26 user nova-compute[73091]:         <nova:user uuid="8a5c393d644c4c3f8e9cbb0805ba7c08">tempest-AttachVolumeNegativeTest-604747333-project-member</nova:user>
Aug 09 16:42:26 user nova-compute[73091]:         <nova:project uuid="27f2275630ce4d55bf02851df830b6bd">tempest-AttachVolumeNegativeTest-604747333</nova:project>
Aug 09 16:42:26 user nova-compute[73091]:       </nova:owner>
Aug 09 16:42:26 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:42:26 user nova-compute[73091]:       <nova:ports>
Aug 09 16:42:26 user nova-compute[73091]:         <nova:port uuid="7c149e7c-01fc-4bfc-a69d-8c1841f904e9">
Aug 09 16:42:26 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 16:42:26 user nova-compute[73091]:         </nova:port>
Aug 09 16:42:26 user nova-compute[73091]:       </nova:ports>
Aug 09 16:42:26 user nova-compute[73091]:     </nova:instance>
Aug 09 16:42:26 user nova-compute[73091]:   </metadata>
Aug 09 16:42:26 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:42:26 user nova-compute[73091]:     <system>
Aug 09 16:42:26 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:42:26 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:42:26 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:42:26 user nova-compute[73091]:       <entry name="serial">4a39f479-265c-49c3-86c4-a65fff2f06c4</entry>
Aug 09 16:42:26 user nova-compute[73091]:       <entry name="uuid">4a39f479-265c-49c3-86c4-a65fff2f06c4</entry>
Aug 09 16:42:26 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:42:26 user nova-compute[73091]:     </system>
Aug 09 16:42:26 user nova-compute[73091]:   </sysinfo>
Aug 09 16:42:26 user nova-compute[73091]:   <os>
Aug 09 16:42:26 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:42:26 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:42:26 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:42:26 user nova-compute[73091]:   </os>
Aug 09 16:42:26 user nova-compute[73091]:   <features>
Aug 09 16:42:26 user nova-compute[73091]:     <acpi/>
Aug 09 16:42:26 user nova-compute[73091]:     <apic/>
Aug 09 16:42:26 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:42:26 user nova-compute[73091]:   </features>
Aug 09 16:42:26 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:42:26 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:42:26 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:42:26 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:42:26 user nova-compute[73091]:   </clock>
Aug 09 16:42:26 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:42:26 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:42:26 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:42:26 user nova-compute[73091]:   </cpu>
Aug 09 16:42:26 user nova-compute[73091]:   <devices>
Aug 09 16:42:26 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:42:26 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:42:26 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk"/>
Aug 09 16:42:26 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:42:26 user nova-compute[73091]:     </disk>
Aug 09 16:42:26 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:42:26 user nova-compute[73091]:       <mac address="fa:16:3e:89:17:f3"/>
Aug 09 16:42:26 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:42:26 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:42:26 user nova-compute[73091]:       <target dev="tap7c149e7c-01"/>
Aug 09 16:42:26 user nova-compute[73091]:     </interface>
Aug 09 16:42:26 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:42:26 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/console.log" append="off"/>
Aug 09 16:42:26 user nova-compute[73091]:     </serial>
Aug 09 16:42:26 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:42:26 user nova-compute[73091]:     <video>
Aug 09 16:42:26 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:42:26 user nova-compute[73091]:     </video>
Aug 09 16:42:26 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:42:26 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:42:26 user nova-compute[73091]:     </rng>
Aug 09 16:42:26 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:42:26 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:42:26 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:42:26 user nova-compute[73091]:     </memballoon>
Aug 09 16:42:26 user nova-compute[73091]:   </devices>
Aug 09 16:42:26 user nova-compute[73091]: </domain>
Aug 09 16:42:26 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1748631261',display_name='tempest-AttachVolumeNegativeTest-server-1748631261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1748631261',id=26,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLYGzKthf41kJWgs1eItgXBE4Y6m6IFtDLHIY7mbx+frJqx2Yp7ne3YHnedZDEYOqprhRc3EDjFjFBndAXrtclsHGulkjfmcIkZr/cpxMOlnt3LJfeqChutV9gD/NFJag==',key_name='tempest-keypair-1708049104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27f2275630ce4d55bf02851df830b6bd',ramdisk_id='',reservation_id='r-ycmzjawr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-604747333',owner_user_name='tempest-AttachVolumeNegativeTest-604747333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a5c393d644c4c3f8e9cbb0805ba7c08',uuid=4a39f479-265c-49c3-86c4-a65fff2f06c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "address": "fa:16:3e:89:17:f3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c149e7c-01", "ovs_interfaceid": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converting VIF {"id": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "address": "fa:16:3e:89:17:f3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c149e7c-01", "ovs_interfaceid": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:17:f3,bridge_name='br-int',has_traffic_filtering=True,id=7c149e7c-01fc-4bfc-a69d-8c1841f904e9,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c149e7c-01') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG os_vif [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:17:f3,bridge_name='br-int',has_traffic_filtering=True,id=7c149e7c-01fc-4bfc-a69d-8c1841f904e9,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c149e7c-01') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c149e7c-01, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c149e7c-01, col_values=(('external_ids', {'iface-id': '7c149e7c-01fc-4bfc-a69d-8c1841f904e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:17:f3', 'vm-uuid': '4a39f479-265c-49c3-86c4-a65fff2f06c4'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:26 user nova-compute[73091]: INFO os_vif [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:17:f3,bridge_name='br-int',has_traffic_filtering=True,id=7c149e7c-01fc-4bfc-a69d-8c1841f904e9,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c149e7c-01')
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] No VIF found with MAC fa:16:3e:89:17:f3, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquired lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:42:27 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:42:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG nova.policy [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b58b3a3f4e5e4aaf94417efd50e4ff1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bab6b1220048119001e80532700cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:42:27 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Creating image(s)
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Acquiring lock "/opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Lock "/opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Lock "/opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-75000e48-693a-4c49-a1f5-b388bebd266f req-339b2a2b-df0a-40d7-89fb-543c714c4760 service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Updated VIF entry in instance network info cache for port 7c149e7c-01fc-4bfc-a69d-8c1841f904e9. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-75000e48-693a-4c49-a1f5-b388bebd266f req-339b2a2b-df0a-40d7-89fb-543c714c4760 service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Updating instance_info_cache with network_info: [{"id": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "address": "fa:16:3e:89:17:f3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c149e7c-01", "ovs_interfaceid": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-75000e48-693a-4c49-a1f5-b388bebd266f req-339b2a2b-df0a-40d7-89fb-543c714c4760 service nova] Releasing lock "refresh_cache-4a39f479-265c-49c3-86c4-a65fff2f06c4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.169s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Updating instance_info_cache with network_info: [{"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Releasing lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.148s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874/disk 1073741824" returned: 0 in 0.063s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG os_brick.utils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eba3262-1b72-4141-9f61-8323a773f232]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc105993-f6e9-4594-93fd-24a5b93145dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d686f10c-216a-4074-9ad0-4a530ead43a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[444c66c4-6e3b-49de-9469-a6e25b5c5d01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.161s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:42:27 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4189e5f4-9cd6-4848-aa0b-93985c4dc5f7]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG os_brick.utils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Cannot resize image /opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Lazy-loading 'migration_context' on Instance uuid 91d979ce-00bf-4a15-841c-b6b66092c874 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Ensure instance console log exists: /opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Successfully created port: fe85552d-8cb5-4175-998e-08410f9d3e46 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:42:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-526bfbd8-6a97-43e0-a51b-056b8fec4fb9 req-ebae2aa6-be91-48cb-b84e-3a68670fdbab service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Received event network-vif-plugged-7c149e7c-01fc-4bfc-a69d-8c1841f904e9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526bfbd8-6a97-43e0-a51b-056b8fec4fb9 req-ebae2aa6-be91-48cb-b84e-3a68670fdbab service nova] Acquiring lock "4a39f479-265c-49c3-86c4-a65fff2f06c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526bfbd8-6a97-43e0-a51b-056b8fec4fb9 req-ebae2aa6-be91-48cb-b84e-3a68670fdbab service nova] Lock "4a39f479-265c-49c3-86c4-a65fff2f06c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526bfbd8-6a97-43e0-a51b-056b8fec4fb9 req-ebae2aa6-be91-48cb-b84e-3a68670fdbab service nova] Lock "4a39f479-265c-49c3-86c4-a65fff2f06c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-526bfbd8-6a97-43e0-a51b-056b8fec4fb9 req-ebae2aa6-be91-48cb-b84e-3a68670fdbab service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] No waiting events found dispatching network-vif-plugged-7c149e7c-01fc-4bfc-a69d-8c1841f904e9 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:28 user nova-compute[73091]: WARNING nova.compute.manager [req-526bfbd8-6a97-43e0-a51b-056b8fec4fb9 req-ebae2aa6-be91-48cb-b84e-3a68670fdbab service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Received unexpected event network-vif-plugged-7c149e7c-01fc-4bfc-a69d-8c1841f904e9 for instance with vm_state building and task_state spawning.
Aug 09 16:42:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Successfully updated port: fe85552d-8cb5-4175-998e-08410f9d3e46 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Acquiring lock "refresh_cache-91d979ce-00bf-4a15-841c-b6b66092c874" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Acquired lock "refresh_cache-91d979ce-00bf-4a15-841c-b6b66092c874" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Updating instance_info_cache with network_info: [{"id": "fe85552d-8cb5-4175-998e-08410f9d3e46", "address": "fa:16:3e:27:42:ba", "network": {"id": "00fbf9c7-31b8-44b1-aa74-4cde83cf6e43", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60dfd79245eb479985ac7f4dd5ed5356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe85552d-8c", "ovs_interfaceid": "fe85552d-8cb5-4175-998e-08410f9d3e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Releasing lock "refresh_cache-91d979ce-00bf-4a15-841c-b6b66092c874" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Instance network_info: |[{"id": "fe85552d-8cb5-4175-998e-08410f9d3e46", "address": "fa:16:3e:27:42:ba", "network": {"id": "00fbf9c7-31b8-44b1-aa74-4cde83cf6e43", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60dfd79245eb479985ac7f4dd5ed5356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe85552d-8c", "ovs_interfaceid": "fe85552d-8cb5-4175-998e-08410f9d3e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Start _get_guest_xml network_info=[{"id": "fe85552d-8cb5-4175-998e-08410f9d3e46", "address": "fa:16:3e:27:42:ba", "network": {"id": "00fbf9c7-31b8-44b1-aa74-4cde83cf6e43", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60dfd79245eb479985ac7f4dd5ed5356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe85552d-8c", "ovs_interfaceid": "fe85552d-8cb5-4175-998e-08410f9d3e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:42:29 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:42:29 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:42:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2122026904',display_name='tempest-VolumesNegativeTest-instance-2122026904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2122026904',id=27,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74bab6b1220048119001e80532700cf4',ramdisk_id='',reservation_id='r-b3bwqo8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1280249766',owner_user_name='tempest-VolumesNegativeTest-1280249766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:42:27Z,user_data=None,user_id='b58b3a3f4e5e4aaf94417efd50e4ff1e',uuid=91d979ce-00bf-4a15-841c-b6b66092c874,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe85552d-8cb5-4175-998e-08410f9d3e46", "address": "fa:16:3e:27:42:ba", "network": {"id": "00fbf9c7-31b8-44b1-aa74-4cde83cf6e43", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60dfd79245eb479985ac7f4dd5ed5356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe85552d-8c", "ovs_interfaceid": "fe85552d-8cb5-4175-998e-08410f9d3e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Converting VIF {"id": "fe85552d-8cb5-4175-998e-08410f9d3e46", "address": "fa:16:3e:27:42:ba", "network": {"id": "00fbf9c7-31b8-44b1-aa74-4cde83cf6e43", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60dfd79245eb479985ac7f4dd5ed5356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe85552d-8c", "ovs_interfaceid": "fe85552d-8cb5-4175-998e-08410f9d3e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:42:ba,bridge_name='br-int',has_traffic_filtering=True,id=fe85552d-8cb5-4175-998e-08410f9d3e46,network=Network(00fbf9c7-31b8-44b1-aa74-4cde83cf6e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe85552d-8c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Lazy-loading 'pci_devices' on Instance uuid 91d979ce-00bf-4a15-841c-b6b66092c874 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:42:29 user nova-compute[73091]:   <uuid>91d979ce-00bf-4a15-841c-b6b66092c874</uuid>
Aug 09 16:42:29 user nova-compute[73091]:   <name>instance-0000001b</name>
Aug 09 16:42:29 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:42:29 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:42:29 user nova-compute[73091]:   <metadata>
Aug 09 16:42:29 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:42:29 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:42:29 user nova-compute[73091]:       <nova:name>tempest-VolumesNegativeTest-instance-2122026904</nova:name>
Aug 09 16:42:29 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:42:29</nova:creationTime>
Aug 09 16:42:29 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:42:29 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:42:29 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:42:29 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:42:29 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:42:29 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:42:29 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:42:29 user nova-compute[73091]:       <nova:owner>
Aug 09 16:42:29 user nova-compute[73091]:         <nova:user uuid="b58b3a3f4e5e4aaf94417efd50e4ff1e">tempest-VolumesNegativeTest-1280249766-project-member</nova:user>
Aug 09 16:42:29 user nova-compute[73091]:         <nova:project uuid="74bab6b1220048119001e80532700cf4">tempest-VolumesNegativeTest-1280249766</nova:project>
Aug 09 16:42:29 user nova-compute[73091]:       </nova:owner>
Aug 09 16:42:29 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:42:29 user nova-compute[73091]:       <nova:ports>
Aug 09 16:42:29 user nova-compute[73091]:         <nova:port uuid="fe85552d-8cb5-4175-998e-08410f9d3e46">
Aug 09 16:42:29 user nova-compute[73091]:           <nova:ip type="fixed" address="192.168.233.14" ipVersion="4"/>
Aug 09 16:42:29 user nova-compute[73091]:         </nova:port>
Aug 09 16:42:29 user nova-compute[73091]:       </nova:ports>
Aug 09 16:42:29 user nova-compute[73091]:     </nova:instance>
Aug 09 16:42:29 user nova-compute[73091]:   </metadata>
Aug 09 16:42:29 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:42:29 user nova-compute[73091]:     <system>
Aug 09 16:42:29 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:42:29 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:42:29 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:42:29 user nova-compute[73091]:       <entry name="serial">91d979ce-00bf-4a15-841c-b6b66092c874</entry>
Aug 09 16:42:29 user nova-compute[73091]:       <entry name="uuid">91d979ce-00bf-4a15-841c-b6b66092c874</entry>
Aug 09 16:42:29 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:42:29 user nova-compute[73091]:     </system>
Aug 09 16:42:29 user nova-compute[73091]:   </sysinfo>
Aug 09 16:42:29 user nova-compute[73091]:   <os>
Aug 09 16:42:29 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:42:29 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:42:29 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:42:29 user nova-compute[73091]:   </os>
Aug 09 16:42:29 user nova-compute[73091]:   <features>
Aug 09 16:42:29 user nova-compute[73091]:     <acpi/>
Aug 09 16:42:29 user nova-compute[73091]:     <apic/>
Aug 09 16:42:29 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:42:29 user nova-compute[73091]:   </features>
Aug 09 16:42:29 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:42:29 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:42:29 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:42:29 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:42:29 user nova-compute[73091]:   </clock>
Aug 09 16:42:29 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:42:29 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:42:29 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:42:29 user nova-compute[73091]:   </cpu>
Aug 09 16:42:29 user nova-compute[73091]:   <devices>
Aug 09 16:42:29 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:42:29 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:42:29 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874/disk"/>
Aug 09 16:42:29 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:42:29 user nova-compute[73091]:     </disk>
Aug 09 16:42:29 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:42:29 user nova-compute[73091]:       <mac address="fa:16:3e:27:42:ba"/>
Aug 09 16:42:29 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:42:29 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:42:29 user nova-compute[73091]:       <target dev="tapfe85552d-8c"/>
Aug 09 16:42:29 user nova-compute[73091]:     </interface>
Aug 09 16:42:29 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:42:29 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874/console.log" append="off"/>
Aug 09 16:42:29 user nova-compute[73091]:     </serial>
Aug 09 16:42:29 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:42:29 user nova-compute[73091]:     <video>
Aug 09 16:42:29 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:42:29 user nova-compute[73091]:     </video>
Aug 09 16:42:29 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:42:29 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:42:29 user nova-compute[73091]:     </rng>
Aug 09 16:42:29 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:42:29 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:42:29 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:42:29 user nova-compute[73091]:     </memballoon>
Aug 09 16:42:29 user nova-compute[73091]:   </devices>
Aug 09 16:42:29 user nova-compute[73091]: </domain>
Aug 09 16:42:29 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:42:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2122026904',display_name='tempest-VolumesNegativeTest-instance-2122026904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2122026904',id=27,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74bab6b1220048119001e80532700cf4',ramdisk_id='',reservation_id='r-b3bwqo8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1280249766',owner_user_name='tempest-VolumesNegativeTest-1280249766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:42:27Z,user_data=None,user_id='b58b3a3f4e5e4aaf94417efd50e4ff1e',uuid=91d979ce-00bf-4a15-841c-b6b66092c874,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe85552d-8cb5-4175-998e-08410f9d3e46", "address": "fa:16:3e:27:42:ba", "network": {"id": "00fbf9c7-31b8-44b1-aa74-4cde83cf6e43", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60dfd79245eb479985ac7f4dd5ed5356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe85552d-8c", "ovs_interfaceid": "fe85552d-8cb5-4175-998e-08410f9d3e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Converting VIF {"id": "fe85552d-8cb5-4175-998e-08410f9d3e46", "address": "fa:16:3e:27:42:ba", "network": {"id": "00fbf9c7-31b8-44b1-aa74-4cde83cf6e43", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60dfd79245eb479985ac7f4dd5ed5356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe85552d-8c", "ovs_interfaceid": "fe85552d-8cb5-4175-998e-08410f9d3e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:42:ba,bridge_name='br-int',has_traffic_filtering=True,id=fe85552d-8cb5-4175-998e-08410f9d3e46,network=Network(00fbf9c7-31b8-44b1-aa74-4cde83cf6e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe85552d-8c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG os_vif [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:42:ba,bridge_name='br-int',has_traffic_filtering=True,id=fe85552d-8cb5-4175-998e-08410f9d3e46,network=Network(00fbf9c7-31b8-44b1-aa74-4cde83cf6e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe85552d-8c') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe85552d-8c, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe85552d-8c, col_values=(('external_ids', {'iface-id': 'fe85552d-8cb5-4175-998e-08410f9d3e46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:42:ba', 'vm-uuid': '91d979ce-00bf-4a15-841c-b6b66092c874'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:29 user nova-compute[73091]: INFO os_vif [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:42:ba,bridge_name='br-int',has_traffic_filtering=True,id=fe85552d-8cb5-4175-998e-08410f9d3e46,network=Network(00fbf9c7-31b8-44b1-aa74-4cde83cf6e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe85552d-8c')
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:42:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] No VIF found with MAC fa:16:3e:27:42:ba, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599350.4899285, 4a39f479-265c-49c3-86c4-a65fff2f06c4 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:42:30 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] VM Resumed (Lifecycle Event)
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:42:30 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Instance spawned successfully.
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:42:30 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599350.4918523, 4a39f479-265c-49c3-86c4-a65fff2f06c4 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:42:30 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] VM Started (Lifecycle Event)
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-2926d824-300c-4925-b89e-cad2529a5002 req-21e2a57c-3059-4c18-b9d6-ca9a5dba0831 service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Received event network-vif-plugged-7c149e7c-01fc-4bfc-a69d-8c1841f904e9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2926d824-300c-4925-b89e-cad2529a5002 req-21e2a57c-3059-4c18-b9d6-ca9a5dba0831 service nova] Acquiring lock "4a39f479-265c-49c3-86c4-a65fff2f06c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2926d824-300c-4925-b89e-cad2529a5002 req-21e2a57c-3059-4c18-b9d6-ca9a5dba0831 service nova] Lock "4a39f479-265c-49c3-86c4-a65fff2f06c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2926d824-300c-4925-b89e-cad2529a5002 req-21e2a57c-3059-4c18-b9d6-ca9a5dba0831 service nova] Lock "4a39f479-265c-49c3-86c4-a65fff2f06c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-2926d824-300c-4925-b89e-cad2529a5002 req-21e2a57c-3059-4c18-b9d6-ca9a5dba0831 service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] No waiting events found dispatching network-vif-plugged-7c149e7c-01fc-4bfc-a69d-8c1841f904e9 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:30 user nova-compute[73091]: WARNING nova.compute.manager [req-2926d824-300c-4925-b89e-cad2529a5002 req-21e2a57c-3059-4c18-b9d6-ca9a5dba0831 service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Received unexpected event network-vif-plugged-7c149e7c-01fc-4bfc-a69d-8c1841f904e9 for instance with vm_state building and task_state spawning.
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-2926d824-300c-4925-b89e-cad2529a5002 req-21e2a57c-3059-4c18-b9d6-ca9a5dba0831 service nova] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Received event network-changed-fe85552d-8cb5-4175-998e-08410f9d3e46 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-2926d824-300c-4925-b89e-cad2529a5002 req-21e2a57c-3059-4c18-b9d6-ca9a5dba0831 service nova] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Refreshing instance network info cache due to event network-changed-fe85552d-8cb5-4175-998e-08410f9d3e46. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:42:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2926d824-300c-4925-b89e-cad2529a5002 req-21e2a57c-3059-4c18-b9d6-ca9a5dba0831 service nova] Acquiring lock "refresh_cache-91d979ce-00bf-4a15-841c-b6b66092c874" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:42:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2926d824-300c-4925-b89e-cad2529a5002 req-21e2a57c-3059-4c18-b9d6-ca9a5dba0831 service nova] Acquired lock "refresh_cache-91d979ce-00bf-4a15-841c-b6b66092c874" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.network.neutron [req-2926d824-300c-4925-b89e-cad2529a5002 req-21e2a57c-3059-4c18-b9d6-ca9a5dba0831 service nova] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Refreshing network info cache for port fe85552d-8cb5-4175-998e-08410f9d3e46 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:42:30 user nova-compute[73091]: INFO nova.compute.manager [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Took 7.81 seconds to spawn the instance on the hypervisor.
Aug 09 16:42:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:42:30 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:42:30 user nova-compute[73091]: INFO nova.compute.manager [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Took 9.46 seconds to build instance.
Aug 09 16:42:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c78d7cdb-47ad-487c-912c-44c9abf34fe6 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "4a39f479-265c-49c3-86c4-a65fff2f06c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.596s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-2926d824-300c-4925-b89e-cad2529a5002 req-21e2a57c-3059-4c18-b9d6-ca9a5dba0831 service nova] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Updated VIF entry in instance network info cache for port fe85552d-8cb5-4175-998e-08410f9d3e46. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:42:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-2926d824-300c-4925-b89e-cad2529a5002 req-21e2a57c-3059-4c18-b9d6-ca9a5dba0831 service nova] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Updating instance_info_cache with network_info: [{"id": "fe85552d-8cb5-4175-998e-08410f9d3e46", "address": "fa:16:3e:27:42:ba", "network": {"id": "00fbf9c7-31b8-44b1-aa74-4cde83cf6e43", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60dfd79245eb479985ac7f4dd5ed5356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe85552d-8c", "ovs_interfaceid": "fe85552d-8cb5-4175-998e-08410f9d3e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:42:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2926d824-300c-4925-b89e-cad2529a5002 req-21e2a57c-3059-4c18-b9d6-ca9a5dba0831 service nova] Releasing lock "refresh_cache-91d979ce-00bf-4a15-841c-b6b66092c874" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:42:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-e64958d5-65cf-46ae-9865-072225a29d1c req-cbc2bf9d-bf25-46d7-84e6-a54ed1d4f2b5 service nova] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Received event network-vif-plugged-fe85552d-8cb5-4175-998e-08410f9d3e46 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e64958d5-65cf-46ae-9865-072225a29d1c req-cbc2bf9d-bf25-46d7-84e6-a54ed1d4f2b5 service nova] Acquiring lock "91d979ce-00bf-4a15-841c-b6b66092c874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e64958d5-65cf-46ae-9865-072225a29d1c req-cbc2bf9d-bf25-46d7-84e6-a54ed1d4f2b5 service nova] Lock "91d979ce-00bf-4a15-841c-b6b66092c874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e64958d5-65cf-46ae-9865-072225a29d1c req-cbc2bf9d-bf25-46d7-84e6-a54ed1d4f2b5 service nova] Lock "91d979ce-00bf-4a15-841c-b6b66092c874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-e64958d5-65cf-46ae-9865-072225a29d1c req-cbc2bf9d-bf25-46d7-84e6-a54ed1d4f2b5 service nova] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] No waiting events found dispatching network-vif-plugged-fe85552d-8cb5-4175-998e-08410f9d3e46 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:31 user nova-compute[73091]: WARNING nova.compute.manager [req-e64958d5-65cf-46ae-9865-072225a29d1c req-cbc2bf9d-bf25-46d7-84e6-a54ed1d4f2b5 service nova] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Received unexpected event network-vif-plugged-fe85552d-8cb5-4175-998e-08410f9d3e46 for instance with vm_state building and task_state spawning.
Aug 09 16:42:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:42:32 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Creating image(s)
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Ensure instance console log exists: /opt/stack/data/nova/instances/148cb211-b2f6-4782-8f35-e66a55cc95bc/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Start _get_guest_xml network_info=[{"id": "23754e3d-f575-4074-b60b-f1104372977b", "address": "fa:16:3e:b8:14:7c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23754e3d-f5", "ovs_interfaceid": "23754e3d-f575-4074-b60b-f1104372977b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'e16db8dc-8431-4594-b748-0d6d41203646', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqpaiyLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '148cb211-b2f6-4782-8f35-e66a55cc95bc', 'attached_at': '', 'detached_at': '', 'volume_id': 'cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a', 'serial': 'cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:42:32 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:42:32 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqpaiyLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:42:32 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:42:32 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:42:32 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[679dfc7e-299b-427a-af6d-80d02201fece]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:42:32 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6dcc8a-e96d-4b36-8fb1-838428bd7dfb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a] added
Aug 09 16:42:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9c2ac2-5f53-4829-bddb-c004ed895a04]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b3e821-8d0c-4746-8630-986786cbddb2]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqpaiyLS {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqpaiyLS" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f6ecfe-add8-4d0c-8331-dd100c4b7936]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kqpaiyLS'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[94601d6f-f0b5-4bd1-85ce-2806d96c433b]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3c8501-99ea-4ecc-9afb-025dc4d05458]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:42:32 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:42:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:42:32 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:42:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[67683fec-63c7-4770-8b3e-222827d4701a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a, portal: 172.16.0.220,3260]
Aug 09 16:42:32 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a, portal: 172.16.0.220,3260] successful.
Aug 09 16:42:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d259f48d-320c-43bf-a0dc-12f517f04dfa]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b7664e-4f1a-448d-bacb-a8ad2b58787f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:42:32 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:42:32 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:42:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:42:32 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:42:32 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:42:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.030s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[91650d3d-33ba-4227-9838-a764ac9a69fc]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:42:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqpaiyLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599353.7157152, 91d979ce-00bf-4a15-841c-b6b66092c874 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:42:33 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] VM Resumed (Lifecycle Event)
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-6bf2f3b7-0804-4269-9365-05b186a5c53e req-7e3bf5d9-de09-46d6-a520-428bdb76420a service nova] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Received event network-vif-plugged-fe85552d-8cb5-4175-998e-08410f9d3e46 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6bf2f3b7-0804-4269-9365-05b186a5c53e req-7e3bf5d9-de09-46d6-a520-428bdb76420a service nova] Acquiring lock "91d979ce-00bf-4a15-841c-b6b66092c874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6bf2f3b7-0804-4269-9365-05b186a5c53e req-7e3bf5d9-de09-46d6-a520-428bdb76420a service nova] Lock "91d979ce-00bf-4a15-841c-b6b66092c874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6bf2f3b7-0804-4269-9365-05b186a5c53e req-7e3bf5d9-de09-46d6-a520-428bdb76420a service nova] Lock "91d979ce-00bf-4a15-841c-b6b66092c874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-6bf2f3b7-0804-4269-9365-05b186a5c53e req-7e3bf5d9-de09-46d6-a520-428bdb76420a service nova] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] No waiting events found dispatching network-vif-plugged-fe85552d-8cb5-4175-998e-08410f9d3e46 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:33 user nova-compute[73091]: WARNING nova.compute.manager [req-6bf2f3b7-0804-4269-9365-05b186a5c53e req-7e3bf5d9-de09-46d6-a520-428bdb76420a service nova] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Received unexpected event network-vif-plugged-fe85552d-8cb5-4175-998e-08410f9d3e46 for instance with vm_state building and task_state spawning.
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23030333434646434', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030333434646434', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:42:33 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Instance spawned successfully.
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:42:33 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599353.718665, 91d979ce-00bf-4a15-841c-b6b66092c874 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:42:33 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] VM Started (Lifecycle Event)
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-113439707',display_name='tempest-TestVolumeBootPattern-volume-backed-server-113439707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-113439707',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJIY/FfZB1Ybu6RyZ7w348VpSHuKTiZ86bLXsmiRzH1gQaOVDAaumaBDjHUKUqC00ts7LeKpEj5bDvz3yoN2UTprtXMvXtpLFP/mMlVqluITuI0pZQMGp0RVtBplJIGEQ==',key_name='tempest-keypair-1624103908',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d3dfd232d54594808dad271baa5192',ramdisk_id='',reservation_id='r-e6v02939',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1605875873',owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:42:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69ccebf0e9d54502a2318c809ce11369',uuid=148cb211-b2f6-4782-8f35-e66a55cc95bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23754e3d-f575-4074-b60b-f1104372977b", "address": "fa:16:3e:b8:14:7c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23754e3d-f5", "ovs_interfaceid": "23754e3d-f575-4074-b60b-f1104372977b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converting VIF {"id": "23754e3d-f575-4074-b60b-f1104372977b", "address": "fa:16:3e:b8:14:7c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23754e3d-f5", "ovs_interfaceid": "23754e3d-f575-4074-b60b-f1104372977b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:14:7c,bridge_name='br-int',has_traffic_filtering=True,id=23754e3d-f575-4074-b60b-f1104372977b,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23754e3d-f5') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lazy-loading 'pci_devices' on Instance uuid 148cb211-b2f6-4782-8f35-e66a55cc95bc {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:42:33 user nova-compute[73091]:   <uuid>148cb211-b2f6-4782-8f35-e66a55cc95bc</uuid>
Aug 09 16:42:33 user nova-compute[73091]:   <name>instance-00000019</name>
Aug 09 16:42:33 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:42:33 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:42:33 user nova-compute[73091]:   <metadata>
Aug 09 16:42:33 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:42:33 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:42:33 user nova-compute[73091]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-113439707</nova:name>
Aug 09 16:42:33 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:42:32</nova:creationTime>
Aug 09 16:42:33 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:42:33 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:42:33 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:42:33 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:42:33 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:42:33 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:42:33 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:42:33 user nova-compute[73091]:       <nova:owner>
Aug 09 16:42:33 user nova-compute[73091]:         <nova:user uuid="69ccebf0e9d54502a2318c809ce11369">tempest-TestVolumeBootPattern-1605875873-project-member</nova:user>
Aug 09 16:42:33 user nova-compute[73091]:         <nova:project uuid="64d3dfd232d54594808dad271baa5192">tempest-TestVolumeBootPattern-1605875873</nova:project>
Aug 09 16:42:33 user nova-compute[73091]:       </nova:owner>
Aug 09 16:42:33 user nova-compute[73091]:       <nova:ports>
Aug 09 16:42:33 user nova-compute[73091]:         <nova:port uuid="23754e3d-f575-4074-b60b-f1104372977b">
Aug 09 16:42:33 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 16:42:33 user nova-compute[73091]:         </nova:port>
Aug 09 16:42:33 user nova-compute[73091]:       </nova:ports>
Aug 09 16:42:33 user nova-compute[73091]:     </nova:instance>
Aug 09 16:42:33 user nova-compute[73091]:   </metadata>
Aug 09 16:42:33 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:42:33 user nova-compute[73091]:     <system>
Aug 09 16:42:33 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:42:33 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:42:33 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:42:33 user nova-compute[73091]:       <entry name="serial">148cb211-b2f6-4782-8f35-e66a55cc95bc</entry>
Aug 09 16:42:33 user nova-compute[73091]:       <entry name="uuid">148cb211-b2f6-4782-8f35-e66a55cc95bc</entry>
Aug 09 16:42:33 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:42:33 user nova-compute[73091]:     </system>
Aug 09 16:42:33 user nova-compute[73091]:   </sysinfo>
Aug 09 16:42:33 user nova-compute[73091]:   <os>
Aug 09 16:42:33 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:42:33 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:42:33 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:42:33 user nova-compute[73091]:   </os>
Aug 09 16:42:33 user nova-compute[73091]:   <features>
Aug 09 16:42:33 user nova-compute[73091]:     <acpi/>
Aug 09 16:42:33 user nova-compute[73091]:     <apic/>
Aug 09 16:42:33 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:42:33 user nova-compute[73091]:   </features>
Aug 09 16:42:33 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:42:33 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:42:33 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:42:33 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:42:33 user nova-compute[73091]:   </clock>
Aug 09 16:42:33 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:42:33 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:42:33 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:42:33 user nova-compute[73091]:   </cpu>
Aug 09 16:42:33 user nova-compute[73091]:   <devices>
Aug 09 16:42:33 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:42:33 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:42:33 user nova-compute[73091]:       <source dev="/dev/sdc"/>
Aug 09 16:42:33 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:42:33 user nova-compute[73091]:       <serial>cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a</serial>
Aug 09 16:42:33 user nova-compute[73091]:     </disk>
Aug 09 16:42:33 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:42:33 user nova-compute[73091]:       <mac address="fa:16:3e:b8:14:7c"/>
Aug 09 16:42:33 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:42:33 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:42:33 user nova-compute[73091]:       <target dev="tap23754e3d-f5"/>
Aug 09 16:42:33 user nova-compute[73091]:     </interface>
Aug 09 16:42:33 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:42:33 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/148cb211-b2f6-4782-8f35-e66a55cc95bc/console.log" append="off"/>
Aug 09 16:42:33 user nova-compute[73091]:     </serial>
Aug 09 16:42:33 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:42:33 user nova-compute[73091]:     <video>
Aug 09 16:42:33 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:42:33 user nova-compute[73091]:     </video>
Aug 09 16:42:33 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:42:33 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:42:33 user nova-compute[73091]:     </rng>
Aug 09 16:42:33 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:42:33 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:42:33 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:42:33 user nova-compute[73091]:     </memballoon>
Aug 09 16:42:33 user nova-compute[73091]:   </devices>
Aug 09 16:42:33 user nova-compute[73091]: </domain>
Aug 09 16:42:33 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-113439707',display_name='tempest-TestVolumeBootPattern-volume-backed-server-113439707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-113439707',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJIY/FfZB1Ybu6RyZ7w348VpSHuKTiZ86bLXsmiRzH1gQaOVDAaumaBDjHUKUqC00ts7LeKpEj5bDvz3yoN2UTprtXMvXtpLFP/mMlVqluITuI0pZQMGp0RVtBplJIGEQ==',key_name='tempest-keypair-1624103908',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d3dfd232d54594808dad271baa5192',ramdisk_id='',reservation_id='r-e6v02939',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1605875873',owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:42:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69ccebf0e9d54502a2318c809ce11369',uuid=148cb211-b2f6-4782-8f35-e66a55cc95bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23754e3d-f575-4074-b60b-f1104372977b", "address": "fa:16:3e:b8:14:7c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23754e3d-f5", "ovs_interfaceid": "23754e3d-f575-4074-b60b-f1104372977b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converting VIF {"id": "23754e3d-f575-4074-b60b-f1104372977b", "address": "fa:16:3e:b8:14:7c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23754e3d-f5", "ovs_interfaceid": "23754e3d-f575-4074-b60b-f1104372977b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:14:7c,bridge_name='br-int',has_traffic_filtering=True,id=23754e3d-f575-4074-b60b-f1104372977b,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23754e3d-f5') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG os_vif [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:14:7c,bridge_name='br-int',has_traffic_filtering=True,id=23754e3d-f575-4074-b60b-f1104372977b,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23754e3d-f5') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23754e3d-f5, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap23754e3d-f5, col_values=(('external_ids', {'iface-id': '23754e3d-f575-4074-b60b-f1104372977b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:14:7c', 'vm-uuid': '148cb211-b2f6-4782-8f35-e66a55cc95bc'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:33 user nova-compute[73091]: INFO os_vif [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:14:7c,bridge_name='br-int',has_traffic_filtering=True,id=23754e3d-f575-4074-b60b-f1104372977b,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23754e3d-f5')
Aug 09 16:42:33 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:42:33 user nova-compute[73091]: INFO nova.compute.manager [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Took 6.67 seconds to spawn the instance on the hypervisor.
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:42:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] No VIF found with MAC fa:16:3e:b8:14:7c, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:42:33 user nova-compute[73091]: INFO nova.compute.manager [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Took 7.72 seconds to build instance.
Aug 09 16:42:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fbb9f7d-c1a3-4752-b16e-8474f31fb774 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Lock "91d979ce-00bf-4a15-841c-b6b66092c874" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.839s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-9a3eb53c-2b3b-49a2-ba3d-d12891223a7f req-b983f02e-a1d4-40ed-957b-0b6660a4f56a service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received event network-changed-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-9a3eb53c-2b3b-49a2-ba3d-d12891223a7f req-b983f02e-a1d4-40ed-957b-0b6660a4f56a service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Refreshing instance network info cache due to event network-changed-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:42:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9a3eb53c-2b3b-49a2-ba3d-d12891223a7f req-b983f02e-a1d4-40ed-957b-0b6660a4f56a service nova] Acquiring lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:42:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9a3eb53c-2b3b-49a2-ba3d-d12891223a7f req-b983f02e-a1d4-40ed-957b-0b6660a4f56a service nova] Acquired lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:42:35 user nova-compute[73091]: DEBUG nova.network.neutron [req-9a3eb53c-2b3b-49a2-ba3d-d12891223a7f req-b983f02e-a1d4-40ed-957b-0b6660a4f56a service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Refreshing network info cache for port 78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:42:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-7391b871-d83c-464b-90e4-b619ea9e0794 req-6406bebb-7391-4c8e-aedf-2377d9f5d1be service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Received event network-vif-plugged-23754e3d-f575-4074-b60b-f1104372977b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7391b871-d83c-464b-90e4-b619ea9e0794 req-6406bebb-7391-4c8e-aedf-2377d9f5d1be service nova] Acquiring lock "148cb211-b2f6-4782-8f35-e66a55cc95bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7391b871-d83c-464b-90e4-b619ea9e0794 req-6406bebb-7391-4c8e-aedf-2377d9f5d1be service nova] Lock "148cb211-b2f6-4782-8f35-e66a55cc95bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7391b871-d83c-464b-90e4-b619ea9e0794 req-6406bebb-7391-4c8e-aedf-2377d9f5d1be service nova] Lock "148cb211-b2f6-4782-8f35-e66a55cc95bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-7391b871-d83c-464b-90e4-b619ea9e0794 req-6406bebb-7391-4c8e-aedf-2377d9f5d1be service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] No waiting events found dispatching network-vif-plugged-23754e3d-f575-4074-b60b-f1104372977b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:35 user nova-compute[73091]: WARNING nova.compute.manager [req-7391b871-d83c-464b-90e4-b619ea9e0794 req-6406bebb-7391-4c8e-aedf-2377d9f5d1be service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Received unexpected event network-vif-plugged-23754e3d-f575-4074-b60b-f1104372977b for instance with vm_state building and task_state spawning.
Aug 09 16:42:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-9a3eb53c-2b3b-49a2-ba3d-d12891223a7f req-b983f02e-a1d4-40ed-957b-0b6660a4f56a service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Updated VIF entry in instance network info cache for port 78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:42:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-9a3eb53c-2b3b-49a2-ba3d-d12891223a7f req-b983f02e-a1d4-40ed-957b-0b6660a4f56a service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Updating instance_info_cache with network_info: [{"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:42:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9a3eb53c-2b3b-49a2-ba3d-d12891223a7f req-b983f02e-a1d4-40ed-957b-0b6660a4f56a service nova] Releasing lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:42:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Starting finish_migration {{(pid=73091) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 09 16:42:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 16:42:37 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Creating image(s)
Aug 09 16:42:37 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lazy-loading 'trusted_certs' on Instance uuid 68d63bc2-d726-49d8-91de-bc5cc66bb119 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:37 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599357.8979828, 148cb211-b2f6-4782-8f35-e66a55cc95bc => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:42:37 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] VM Resumed (Lifecycle Event)
Aug 09 16:42:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:42:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:42:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.211s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:42:37 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk. size=21474836480 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:42:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-5458012e-ce08-4a34-b537-d938e49e801d req-b2eb59ea-2daf-4ea8-b038-cf4b4f6dd4bb service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Received event network-vif-plugged-23754e3d-f575-4074-b60b-f1104372977b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5458012e-ce08-4a34-b537-d938e49e801d req-b2eb59ea-2daf-4ea8-b038-cf4b4f6dd4bb service nova] Acquiring lock "148cb211-b2f6-4782-8f35-e66a55cc95bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5458012e-ce08-4a34-b537-d938e49e801d req-b2eb59ea-2daf-4ea8-b038-cf4b4f6dd4bb service nova] Lock "148cb211-b2f6-4782-8f35-e66a55cc95bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5458012e-ce08-4a34-b537-d938e49e801d req-b2eb59ea-2daf-4ea8-b038-cf4b4f6dd4bb service nova] Lock "148cb211-b2f6-4782-8f35-e66a55cc95bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-5458012e-ce08-4a34-b537-d938e49e801d req-b2eb59ea-2daf-4ea8-b038-cf4b4f6dd4bb service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] No waiting events found dispatching network-vif-plugged-23754e3d-f575-4074-b60b-f1104372977b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:38 user nova-compute[73091]: WARNING nova.compute.manager [req-5458012e-ce08-4a34-b537-d938e49e801d req-b2eb59ea-2daf-4ea8-b038-cf4b4f6dd4bb service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Received unexpected event network-vif-plugged-23754e3d-f575-4074-b60b-f1104372977b for instance with vm_state building and task_state spawning.
Aug 09 16:42:38 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Instance spawned successfully.
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk 21474836480 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:38 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599357.9020894, 148cb211-b2f6-4782-8f35-e66a55cc95bc => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:42:38 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] VM Started (Lifecycle Event)
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:42:38 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk 21474836480" returned: 0 in 0.348s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Ensure instance console log exists: /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Start _get_guest_xml network_info=[{"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-815237771-network", "vif_mac": "fa:16:3e:3c:81:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '7ec13511-797b-407d-ada4-84cb907cc3b1', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfUAobeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '68d63bc2-d726-49d8-91de-bc5cc66bb119', 'attached_at': '2023-08-09T16:42:38.000000', 'detached_at': '', 'volume_id': '9c698f00-64a1-4d7f-bad5-2d74153a7012', 'serial': '9c698f00-64a1-4d7f-bad5-2d74153a7012'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:42:38 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:42:38 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lazy-loading 'vcpu_model' on Instance uuid 68d63bc2-d726-49d8-91de-bc5cc66bb119 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:38 user nova-compute[73091]: INFO nova.compute.manager [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Took 6.28 seconds to spawn the instance on the hypervisor.
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfUAobeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:42:38 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:42:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:42:38 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:42:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:42:38 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96d4f6f-5100-4ea9-96d4-a3bcb32c4b07]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:42:38 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[032540cc-2aa3-4825-8e77-b94c01798cc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012] added
Aug 09 16:42:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599343.7227566, 68d63bc2-d726-49d8-91de-bc5cc66bb119 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:42:38 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] VM Stopped (Lifecycle Event)
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5643650-711c-4858-9f40-d8f473545418]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-da95ebb4-ff43-46bf-ae24-9f632dc8cfc8 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-da95ebb4-ff43-46bf-ae24-9f632dc8cfc8 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:42:38 user nova-compute[73091]: INFO nova.compute.manager [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Took 17.61 seconds to build instance.
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6bf08d-e2c9-46be-beef-e49fa39a1e65]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfUAobeV {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f7c1c18d-de2a-4402-a0f2-452327ba1477 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "148cb211-b2f6-4782-8f35-e66a55cc95bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.751s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:38 user nova-compute[73091]: INFO nova.compute.manager [None req-da95ebb4-ff43-46bf-ae24-9f632dc8cfc8 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfUAobeV" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6590dc4f-5c06-42a1-b760-00b6c9b6a7a2]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HfUAobeV'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd441ba2-74fc-4592-bbfa-655c2f6e5461]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6aaed3b-9c69-40ac-962d-e93ea9929f22]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:42:38 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:42:38 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:42:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:42:38 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:42:38 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:42:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[337879e6-a314-4edf-bf7c-7bf7800608ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260]
Aug 09 16:42:38 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260] successful.
Aug 09 16:42:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e3f4d6-1acf-4097-b289-0d4a5bf0e58c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:42:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e10160-847d-400d-9599-a8b4c4b06727]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:42:39 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:42:39 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:42:39 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:42:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:42:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:42:39 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:42:39 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:42:39 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:42:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:42:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.408s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:42:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:42:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:42:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:42:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[61847cdb-8068-4f5b-982f-a4b572e13abd]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:42:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfUAobeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:42:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.466s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] <== connect_volume: return (1469ms) {'type': 'block', 'scsi_wwn': '23334353635636464', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334353635636464', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1756856509',display_name='tempest-ServerActionsTestOtherB-server-1756856509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1756856509',id=15,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX4A4WBbci8tvlyfsVn8RtvZ67v0qxFwI098O4ybt1xkpAJgwLMitJ+vOXZXn9ziILn0Dux9cadl75sAIWbob/GvRq9Jin537WzoAVu2MvbyterRxvGm1tqvtVxJqTjrw==',key_name='tempest-keypair-561558216',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:38:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='329738ae9226414383acb6dcbd09dea0',ramdisk_id='',reservation_id='r-r2gg9o0o',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1665559429',owner_user_name='tempest-ServerActionsTestOtherB-1665559429-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a90a17815b46b8a64be7510ac5ba49',uuid=68d63bc2-d726-49d8-91de-bc5cc66bb119,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-815237771-network", "vif_mac": "fa:16:3e:3c:81:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Converting VIF {"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-815237771-network", "vif_mac": "fa:16:3e:3c:81:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:42:40 user nova-compute[73091]:   <uuid>68d63bc2-d726-49d8-91de-bc5cc66bb119</uuid>
Aug 09 16:42:40 user nova-compute[73091]:   <name>instance-0000000f</name>
Aug 09 16:42:40 user nova-compute[73091]:   <memory>2097152</memory>
Aug 09 16:42:40 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:42:40 user nova-compute[73091]:   <metadata>
Aug 09 16:42:40 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:42:40 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:42:40 user nova-compute[73091]:       <nova:name>tempest-ServerActionsTestOtherB-server-1756856509</nova:name>
Aug 09 16:42:40 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:42:38</nova:creationTime>
Aug 09 16:42:40 user nova-compute[73091]:       <nova:flavor name="m1.small">
Aug 09 16:42:40 user nova-compute[73091]:         <nova:memory>2048</nova:memory>
Aug 09 16:42:40 user nova-compute[73091]:         <nova:disk>20</nova:disk>
Aug 09 16:42:40 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:42:40 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:42:40 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:42:40 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:42:40 user nova-compute[73091]:       <nova:owner>
Aug 09 16:42:40 user nova-compute[73091]:         <nova:user uuid="77a90a17815b46b8a64be7510ac5ba49">tempest-ServerActionsTestOtherB-1665559429-project-member</nova:user>
Aug 09 16:42:40 user nova-compute[73091]:         <nova:project uuid="329738ae9226414383acb6dcbd09dea0">tempest-ServerActionsTestOtherB-1665559429</nova:project>
Aug 09 16:42:40 user nova-compute[73091]:       </nova:owner>
Aug 09 16:42:40 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:42:40 user nova-compute[73091]:       <nova:ports>
Aug 09 16:42:40 user nova-compute[73091]:         <nova:port uuid="93d41bee-7cab-45a7-b409-dd19fc3b88b6">
Aug 09 16:42:40 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 16:42:40 user nova-compute[73091]:         </nova:port>
Aug 09 16:42:40 user nova-compute[73091]:       </nova:ports>
Aug 09 16:42:40 user nova-compute[73091]:     </nova:instance>
Aug 09 16:42:40 user nova-compute[73091]:   </metadata>
Aug 09 16:42:40 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:42:40 user nova-compute[73091]:     <system>
Aug 09 16:42:40 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:42:40 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:42:40 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:42:40 user nova-compute[73091]:       <entry name="serial">68d63bc2-d726-49d8-91de-bc5cc66bb119</entry>
Aug 09 16:42:40 user nova-compute[73091]:       <entry name="uuid">68d63bc2-d726-49d8-91de-bc5cc66bb119</entry>
Aug 09 16:42:40 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:42:40 user nova-compute[73091]:     </system>
Aug 09 16:42:40 user nova-compute[73091]:   </sysinfo>
Aug 09 16:42:40 user nova-compute[73091]:   <os>
Aug 09 16:42:40 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:42:40 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:42:40 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:42:40 user nova-compute[73091]:   </os>
Aug 09 16:42:40 user nova-compute[73091]:   <features>
Aug 09 16:42:40 user nova-compute[73091]:     <acpi/>
Aug 09 16:42:40 user nova-compute[73091]:     <apic/>
Aug 09 16:42:40 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:42:40 user nova-compute[73091]:   </features>
Aug 09 16:42:40 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:42:40 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:42:40 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:42:40 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:42:40 user nova-compute[73091]:   </clock>
Aug 09 16:42:40 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:42:40 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:42:40 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:42:40 user nova-compute[73091]:   </cpu>
Aug 09 16:42:40 user nova-compute[73091]:   <devices>
Aug 09 16:42:40 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:42:40 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:42:40 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk"/>
Aug 09 16:42:40 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:42:40 user nova-compute[73091]:     </disk>
Aug 09 16:42:40 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:42:40 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:42:40 user nova-compute[73091]:       <source dev="/dev/sde"/>
Aug 09 16:42:40 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 09 16:42:40 user nova-compute[73091]:       <serial>9c698f00-64a1-4d7f-bad5-2d74153a7012</serial>
Aug 09 16:42:40 user nova-compute[73091]:     </disk>
Aug 09 16:42:40 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:42:40 user nova-compute[73091]:       <mac address="fa:16:3e:3c:81:07"/>
Aug 09 16:42:40 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:42:40 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:42:40 user nova-compute[73091]:       <target dev="tap93d41bee-7c"/>
Aug 09 16:42:40 user nova-compute[73091]:     </interface>
Aug 09 16:42:40 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:42:40 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/console.log" append="off"/>
Aug 09 16:42:40 user nova-compute[73091]:     </serial>
Aug 09 16:42:40 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:42:40 user nova-compute[73091]:     <video>
Aug 09 16:42:40 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:42:40 user nova-compute[73091]:     </video>
Aug 09 16:42:40 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:42:40 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:42:40 user nova-compute[73091]:     </rng>
Aug 09 16:42:40 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:42:40 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:42:40 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:42:40 user nova-compute[73091]:     </memballoon>
Aug 09 16:42:40 user nova-compute[73091]:   </devices>
Aug 09 16:42:40 user nova-compute[73091]: </domain>
Aug 09 16:42:40 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1756856509',display_name='tempest-ServerActionsTestOtherB-server-1756856509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1756856509',id=15,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX4A4WBbci8tvlyfsVn8RtvZ67v0qxFwI098O4ybt1xkpAJgwLMitJ+vOXZXn9ziILn0Dux9cadl75sAIWbob/GvRq9Jin537WzoAVu2MvbyterRxvGm1tqvtVxJqTjrw==',key_name='tempest-keypair-561558216',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:38:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='329738ae9226414383acb6dcbd09dea0',ramdisk_id='',reservation_id='r-r2gg9o0o',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1665559429',owner_user_name='tempest-ServerActionsTestOtherB-1665559429-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a90a17815b46b8a64be7510ac5ba49',uuid=68d63bc2-d726-49d8-91de-bc5cc66bb119,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-815237771-network", "vif_mac": "fa:16:3e:3c:81:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Converting VIF {"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-815237771-network", "vif_mac": "fa:16:3e:3c:81:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG os_vif [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93d41bee-7c, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap93d41bee-7c, col_values=(('external_ids', {'iface-id': '93d41bee-7cab-45a7-b409-dd19fc3b88b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:81:07', 'vm-uuid': '68d63bc2-d726-49d8-91de-bc5cc66bb119'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:40 user nova-compute[73091]: INFO os_vif [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c')
Aug 09 16:42:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:42:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] No VIF found with MAC fa:16:3e:3c:81:07, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:42:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "e03ff609-e74d-427d-b6e6-109fbee09e40" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:41 user nova-compute[73091]: INFO nova.compute.manager [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Shelving
Aug 09 16:42:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-905ff1cc-2d7d-448a-9c3e-f1541bf93531 req-654fc800-61ad-4165-86ba-67336536b58e service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received event network-vif-unplugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-905ff1cc-2d7d-448a-9c3e-f1541bf93531 req-654fc800-61ad-4165-86ba-67336536b58e service nova] Acquiring lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-905ff1cc-2d7d-448a-9c3e-f1541bf93531 req-654fc800-61ad-4165-86ba-67336536b58e service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-905ff1cc-2d7d-448a-9c3e-f1541bf93531 req-654fc800-61ad-4165-86ba-67336536b58e service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-905ff1cc-2d7d-448a-9c3e-f1541bf93531 req-654fc800-61ad-4165-86ba-67336536b58e service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] No waiting events found dispatching network-vif-unplugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:42 user nova-compute[73091]: WARNING nova.compute.manager [req-905ff1cc-2d7d-448a-9c3e-f1541bf93531 req-654fc800-61ad-4165-86ba-67336536b58e service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received unexpected event network-vif-unplugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 for instance with vm_state active and task_state shelving.
Aug 09 16:42:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-bec334a7-febb-4546-a3da-8d6b2ba606b8 req-96e2aec9-2133-42da-82c8-c1d142890527 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received event network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bec334a7-febb-4546-a3da-8d6b2ba606b8 req-96e2aec9-2133-42da-82c8-c1d142890527 service nova] Acquiring lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bec334a7-febb-4546-a3da-8d6b2ba606b8 req-96e2aec9-2133-42da-82c8-c1d142890527 service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bec334a7-febb-4546-a3da-8d6b2ba606b8 req-96e2aec9-2133-42da-82c8-c1d142890527 service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-bec334a7-febb-4546-a3da-8d6b2ba606b8 req-96e2aec9-2133-42da-82c8-c1d142890527 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] No waiting events found dispatching network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:42 user nova-compute[73091]: WARNING nova.compute.manager [req-bec334a7-febb-4546-a3da-8d6b2ba606b8 req-96e2aec9-2133-42da-82c8-c1d142890527 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received unexpected event network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 for instance with vm_state active and task_state resize_finish.
Aug 09 16:42:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:43 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Instance destroyed successfully.
Aug 09 16:42:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:43 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Beginning cold snapshot process
Aug 09 16:42:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:43 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 16:42:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk /opt/stack/data/nova/instances/snapshots/tmpp2vpcvnz/40ef11921dec445497df921d2d2aa965 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk /opt/stack/data/nova/instances/snapshots/tmpp2vpcvnz/40ef11921dec445497df921d2d2aa965" returned: 0 in 0.973s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:44 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Snapshot extracted, beginning image upload
Aug 09 16:42:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received event network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] Acquiring lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] No waiting events found dispatching network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:44 user nova-compute[73091]: WARNING nova.compute.manager [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received unexpected event network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 16:42:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received event network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] Acquiring lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] No waiting events found dispatching network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:44 user nova-compute[73091]: WARNING nova.compute.manager [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received unexpected event network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 16:42:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received event network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] Acquiring lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] No waiting events found dispatching network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:44 user nova-compute[73091]: WARNING nova.compute.manager [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received unexpected event network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 16:42:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received event network-vif-unplugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] Acquiring lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] No waiting events found dispatching network-vif-unplugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:44 user nova-compute[73091]: WARNING nova.compute.manager [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received unexpected event network-vif-unplugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 16:42:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received event network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] Acquiring lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] No waiting events found dispatching network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:44 user nova-compute[73091]: WARNING nova.compute.manager [req-9b156f66-bef9-41df-ae12-8eb098571054 req-c8653444-2756-4cbe-885c-4db53bda6540 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received unexpected event network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 16:42:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-a76332da-1ce1-40c6-9a59-c1f2da852d13 req-0a03928d-2e4c-4b51-9ec7-d4e5e424a263 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received event network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a76332da-1ce1-40c6-9a59-c1f2da852d13 req-0a03928d-2e4c-4b51-9ec7-d4e5e424a263 service nova] Acquiring lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a76332da-1ce1-40c6-9a59-c1f2da852d13 req-0a03928d-2e4c-4b51-9ec7-d4e5e424a263 service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a76332da-1ce1-40c6-9a59-c1f2da852d13 req-0a03928d-2e4c-4b51-9ec7-d4e5e424a263 service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-a76332da-1ce1-40c6-9a59-c1f2da852d13 req-0a03928d-2e4c-4b51-9ec7-d4e5e424a263 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] No waiting events found dispatching network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:42:44 user nova-compute[73091]: WARNING nova.compute.manager [req-a76332da-1ce1-40c6-9a59-c1f2da852d13 req-0a03928d-2e4c-4b51-9ec7-d4e5e424a263 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received unexpected event network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 for instance with vm_state active and task_state resize_finish.
Aug 09 16:42:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:45 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599365.2080126, 68d63bc2-d726-49d8-91de-bc5cc66bb119 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:42:45 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] VM Resumed (Lifecycle Event)
Aug 09 16:42:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:42:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Instance running successfully.
Aug 09 16:42:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Failed to set time: agent not configured {{(pid=73091) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 09 16:42:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a13bbdeb-90c8-48d4-bbe3-7c82adc13c84 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] finish_migration finished successfully. {{(pid=73091) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 09 16:42:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:42:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:42:45 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 16:42:45 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599365.2165556, 68d63bc2-d726-49d8-91de-bc5cc66bb119 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:42:45 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] VM Started (Lifecycle Event)
Aug 09 16:42:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:42:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:42:45 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 16:42:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Snapshot image upload complete
Aug 09 16:42:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:42:46 user nova-compute[73091]: INFO nova.compute.manager [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Shelve offloading
Aug 09 16:42:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Instance destroyed successfully.
Aug 09 16:42:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:42:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:42:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquired lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:42:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:42:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Updating instance_info_cache with network_info: [{"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:42:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Releasing lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:42:48 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Instance destroyed successfully.
Aug 09 16:42:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'resources' on Instance uuid e03ff609-e74d-427d-b6e6-109fbee09e40 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-631186991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-631186991',id=22,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNf3A+5Z7pIEBlhzfnQHoxgivCxTPlvm/huyNXliMpXw073U0iPJQNiNLgMagYal2KPG1QBF641Llp0BRSjbgXgq3B8bIM/yGSRax/YnqZ6VB4oH6+6U8bfE9BQdhXTbjQ==',key_name='tempest-keypair-767621827',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b8000a47d82748ce8d43d306682d62c6',ramdisk_id='',reservation_id='r-kkx3fv25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1451982310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1451982310-project-member',shelved_at='2023-08-09T16:42:46.907469',shelved_host='user',shelved_image_id='e5cd35ca-72cb-4006-b1f0-36e1c553f01d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343ec5734ef547f292ee631dbb272359',uuid=e03ff609-e74d-427d-b6e6-109fbee09e40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:42:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converting VIF {"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:42:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ea:23,bridge_name='br-int',has_traffic_filtering=True,id=78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ad4923-b2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:42:48 user nova-compute[73091]: DEBUG os_vif [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ea:23,bridge_name='br-int',has_traffic_filtering=True,id=78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ad4923-b2') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:42:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78ad4923-b2, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:42:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-08ec3226-70c8-4abb-b019-bd975dcb3ef6 req-7e8fd47a-0601-40b4-be85-04319e554e48 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received event network-changed-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:42:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-08ec3226-70c8-4abb-b019-bd975dcb3ef6 req-7e8fd47a-0601-40b4-be85-04319e554e48 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Refreshing instance network info cache due to event network-changed-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:42:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-08ec3226-70c8-4abb-b019-bd975dcb3ef6 req-7e8fd47a-0601-40b4-be85-04319e554e48 service nova] Acquiring lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:42:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-08ec3226-70c8-4abb-b019-bd975dcb3ef6 req-7e8fd47a-0601-40b4-be85-04319e554e48 service nova] Acquired lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:42:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-08ec3226-70c8-4abb-b019-bd975dcb3ef6 req-7e8fd47a-0601-40b4-be85-04319e554e48 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Refreshing network info cache for port 78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:42:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:42:48 user nova-compute[73091]: INFO os_vif [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ea:23,bridge_name='br-int',has_traffic_filtering=True,id=78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ad4923-b2')
Aug 09 16:42:48 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Deleting instance files /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40_del
Aug 09 16:42:48 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Deletion of /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40_del complete
Aug 09 16:42:48 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Deleted allocations for instance e03ff609-e74d-427d-b6e6-109fbee09e40
Aug 09 16:42:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'numa_topology' on Instance uuid e03ff609-e74d-427d-b6e6-109fbee09e40 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-08ec3226-70c8-4abb-b019-bd975dcb3ef6 req-7e8fd47a-0601-40b4-be85-04319e554e48 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Updated VIF entry in instance network info cache for port 78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:42:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-08ec3226-70c8-4abb-b019-bd975dcb3ef6 req-7e8fd47a-0601-40b4-be85-04319e554e48 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Updating instance_info_cache with network_info: [{"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap78ad4923-b2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:42:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-08ec3226-70c8-4abb-b019-bd975dcb3ef6 req-7e8fd47a-0601-40b4-be85-04319e554e48 service nova] Releasing lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:42:48 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:42:48 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:42:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.515s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ecaded0e-7d1a-458c-a834-f4ed8b09a281 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.168s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lazy-loading 'flavor' on Instance uuid f8f52e24-8ce5-4128-a2aa-afc68ceb7213 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:42:55 user nova-compute[73091]: INFO nova.compute.manager [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Attaching volume e93752e2-313e-4a13-81bb-203e56bad5b0 to /dev/vdb
Aug 09 16:42:55 user nova-compute[73091]: DEBUG os_brick.utils [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b56c708-7267-4083-b3b4-312303e1a01e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[268cf46a-e6db-4ae3-805d-c687840522cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c078cf-c738-474a-8da4-423fd84f1e36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e74628-4451-4d53-a7ab-3d147ecfdbd7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:42:55 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:42:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca224553-8b95-401e-bfc5-1f7800b72cde]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG os_brick.utils [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:42:55 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Updating existing volume attachment record: 8e3456e5-9bed-4413-9d57-3bcc8152f70e {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:42:58 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599362.9820504, e03ff609-e74d-427d-b6e6-109fbee09e40 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:42:58 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] VM Stopped (Lifecycle Event)
Aug 09 16:42:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f0d9ba91-740a-4e01-b9bd-25a50c282fea None None] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:42:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:42:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNidHjKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:43:04 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:43:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:43:04 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:43:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:43:04 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[987942e8-cba2-4a7d-8a5f-b0c08243481d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:43:04 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efe7f49-7190-480c-835a-b0128324cf5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0] added
Aug 09 16:43:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[383c5287-0b80-4baa-b808-86fa089f1c8b]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f52a5b8-13a4-41b1-94bb-932adb782847]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PNidHjKv {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PNidHjKv" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed539cf-ec64-4704-b6d7-334edcf49e0f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PNidHjKv'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1c23de-ed52-42f2-b2bc-bd7799b91b28]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eadb289-9a9d-43e0-84e6-90333a2992df]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:43:04 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:43:04 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:43:04 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:43:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:43:04 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:43:04 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:43:04 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:43:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:43:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7379b261-eb2c-42ca-b0cf-e0dfcde435eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0, portal: 172.16.0.220,3260]
Aug 09 16:43:05 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0, portal: 172.16.0.220,3260] successful.
Aug 09 16:43:05 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb86d5bc-9d42-454e-af2f-4aa4071b82d6]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f49a71-b7ec-4322-aeca-5f2daff5e66d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:43:05 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:43:05 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:43:05 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:43:05 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:43:05 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:43:05 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:43:05 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:43:05 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:43:05 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:43:05 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9861d398-d875-4732-9e08-6933f7d57799]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNidHjKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:43:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:43:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:43:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23265633363653963', 'path': '/dev/sdf'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:43:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265633363653963', 'path': '/dev/sdf'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:43:06 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lazy-loading 'flavor' on Instance uuid f8f52e24-8ce5-4128-a2aa-afc68ceb7213 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:43:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:43:06 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:43:06 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 09 16:43:06 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:43:06 user nova-compute[73091]:   <serial>e93752e2-313e-4a13-81bb-203e56bad5b0</serial>
Aug 09 16:43:06 user nova-compute[73091]: </disk>
Aug 09 16:43:06 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:43:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:43:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:43:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] No VIF found with MAC fa:16:3e:c8:8c:6d, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:43:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e7e46788-1e30-441d-94c9-e18a46b6ed06 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.960s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:43:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:08 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:43:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:43:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:43:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:43:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:43:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:43:10 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Updating instance_info_cache with network_info: [{"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:43:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:43:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:43:10 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:43:10 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:43:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:43:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:43:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:14 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:43:14 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:43:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:43:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:43:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:43:14 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:43:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-fe3d922d-4efa-45aa-99be-90cdd0a84188 req-2ab3cd27-2057-4359-a09e-014cd69e8ee0 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received event network-changed-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:43:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-fe3d922d-4efa-45aa-99be-90cdd0a84188 req-2ab3cd27-2057-4359-a09e-014cd69e8ee0 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Refreshing instance network info cache due to event network-changed-2d1a984c-9df8-49a7-9460-bee934ea307f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:43:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fe3d922d-4efa-45aa-99be-90cdd0a84188 req-2ab3cd27-2057-4359-a09e-014cd69e8ee0 service nova] Acquiring lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:43:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fe3d922d-4efa-45aa-99be-90cdd0a84188 req-2ab3cd27-2057-4359-a09e-014cd69e8ee0 service nova] Acquired lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:43:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-fe3d922d-4efa-45aa-99be-90cdd0a84188 req-2ab3cd27-2057-4359-a09e-014cd69e8ee0 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Refreshing network info cache for port 2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:43:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:43:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:43:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:43:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:43:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:18 user nova-compute[73091]: DEBUG nova.network.neutron [req-fe3d922d-4efa-45aa-99be-90cdd0a84188 req-2ab3cd27-2057-4359-a09e-014cd69e8ee0 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Updated VIF entry in instance network info cache for port 2d1a984c-9df8-49a7-9460-bee934ea307f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:43:18 user nova-compute[73091]: DEBUG nova.network.neutron [req-fe3d922d-4efa-45aa-99be-90cdd0a84188 req-2ab3cd27-2057-4359-a09e-014cd69e8ee0 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Updating instance_info_cache with network_info: [{"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:43:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fe3d922d-4efa-45aa-99be-90cdd0a84188 req-2ab3cd27-2057-4359-a09e-014cd69e8ee0 service nova] Releasing lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:43:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:43:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-88732112-ff58-4e68-a816-63d7769b93b2 req-4ac33122-a4dc-4c9b-b6e4-0bcdd04ed425 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received event network-changed-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-88732112-ff58-4e68-a816-63d7769b93b2 req-4ac33122-a4dc-4c9b-b6e4-0bcdd04ed425 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Refreshing instance network info cache due to event network-changed-2d1a984c-9df8-49a7-9460-bee934ea307f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-88732112-ff58-4e68-a816-63d7769b93b2 req-4ac33122-a4dc-4c9b-b6e4-0bcdd04ed425 service nova] Acquiring lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-88732112-ff58-4e68-a816-63d7769b93b2 req-4ac33122-a4dc-4c9b-b6e4-0bcdd04ed425 service nova] Acquired lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-88732112-ff58-4e68-a816-63d7769b93b2 req-4ac33122-a4dc-4c9b-b6e4-0bcdd04ed425 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Refreshing network info cache for port 2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:43:19 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:43:19 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:43:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=6827MB free_disk=25.10000228881836GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Applying migration context for instance 68d63bc2-d726-49d8-91de-bc5cc66bb119 as it has an incoming, in-progress migration 0c59254d-ea01-46db-919b-e65f5d788c1f. Migration status is finished {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 16:43:19 user nova-compute[73091]: INFO nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Updating resource usage from migration 0c59254d-ea01-46db-919b-e65f5d788c1f
Aug 09 16:43:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 93e10fd4-8841-4043-b4e2-7489c4dea3e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 38051bca-7190-4dff-91d1-3d99b4e4182b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f939fe27-017a-481e-babc-147bf98e0132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8fc884a8-24bb-488a-baeb-ef2b1faf239d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f8f52e24-8ce5-4128-a2aa-afc68ceb7213 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance db00ba13-17f9-4441-a5f5-6e0eac6aa541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Migration 0c59254d-ea01-46db-919b-e65f5d788c1f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 68d63bc2-d726-49d8-91de-bc5cc66bb119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 148cb211-b2f6-4782-8f35-e66a55cc95bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 4a39f479-265c-49c3-86c4-a65fff2f06c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 91d979ce-00bf-4a15-841c-b6b66092c874 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:43:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:43:20 user nova-compute[73091]: INFO nova.compute.manager [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Terminating instance
Aug 09 16:43:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Instance destroyed successfully.
Aug 09 16:43:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lazy-loading 'resources' on Instance uuid db00ba13-17f9-4441-a5f5-6e0eac6aa541 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:41:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2050033934',display_name='tempest-VolumesAdminNegativeTest-server-2050033934',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2050033934',id=24,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:41:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='22c72c5d15254ac2bf4348b99858f839',ramdisk_id='',reservation_id='r-kvgrj25d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1174699978',owner_user_name='tempest-VolumesAdminNegativeTest-1174699978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:41:24Z,user_data=None,user_id='992b965912454b79b9d70db85c232bc0',uuid=db00ba13-17f9-4441-a5f5-6e0eac6aa541,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebe87016-1c22-4149-9b25-bd6230a4f703", "address": "fa:16:3e:82:8f:39", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe87016-1c", "ovs_interfaceid": "ebe87016-1c22-4149-9b25-bd6230a4f703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Converting VIF {"id": "ebe87016-1c22-4149-9b25-bd6230a4f703", "address": "fa:16:3e:82:8f:39", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe87016-1c", "ovs_interfaceid": "ebe87016-1c22-4149-9b25-bd6230a4f703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:8f:39,bridge_name='br-int',has_traffic_filtering=True,id=ebe87016-1c22-4149-9b25-bd6230a4f703,network=Network(4279c047-a328-4c4c-aff6-667871ec03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe87016-1c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG os_vif [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:8f:39,bridge_name='br-int',has_traffic_filtering=True,id=ebe87016-1c22-4149-9b25-bd6230a4f703,network=Network(4279c047-a328-4c4c-aff6-667871ec03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe87016-1c') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebe87016-1c, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:43:20 user nova-compute[73091]: INFO os_vif [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:8f:39,bridge_name='br-int',has_traffic_filtering=True,id=ebe87016-1c22-4149-9b25-bd6230a4f703,network=Network(4279c047-a328-4c4c-aff6-667871ec03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe87016-1c')
Aug 09 16:43:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Deleting instance files /opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541_del
Aug 09 16:43:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Deletion of /opt/stack/data/nova/instances/db00ba13-17f9-4441-a5f5-6e0eac6aa541_del complete
Aug 09 16:43:20 user nova-compute[73091]: DEBUG nova.network.neutron [req-88732112-ff58-4e68-a816-63d7769b93b2 req-4ac33122-a4dc-4c9b-b6e4-0bcdd04ed425 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Updated VIF entry in instance network info cache for port 2d1a984c-9df8-49a7-9460-bee934ea307f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG nova.network.neutron [req-88732112-ff58-4e68-a816-63d7769b93b2 req-4ac33122-a4dc-4c9b-b6e4-0bcdd04ed425 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Updating instance_info_cache with network_info: [{"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:43:20 user nova-compute[73091]: INFO nova.compute.manager [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 09 16:43:20 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:43:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-88732112-ff58-4e68-a816-63d7769b93b2 req-4ac33122-a4dc-4c9b-b6e4-0bcdd04ed425 service nova] Releasing lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:43:21 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:43:21 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Took 0.73 seconds to deallocate network for instance.
Aug 09 16:43:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:43:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:43:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-24f80ed0-cd6f-49c7-b642-d7d2262a4539 req-c88fec0f-4297-417a-a236-739416ec54cc service nova] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Received event network-vif-unplugged-ebe87016-1c22-4149-9b25-bd6230a4f703 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:43:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-24f80ed0-cd6f-49c7-b642-d7d2262a4539 req-c88fec0f-4297-417a-a236-739416ec54cc service nova] Acquiring lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:43:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-24f80ed0-cd6f-49c7-b642-d7d2262a4539 req-c88fec0f-4297-417a-a236-739416ec54cc service nova] Lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:43:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-24f80ed0-cd6f-49c7-b642-d7d2262a4539 req-c88fec0f-4297-417a-a236-739416ec54cc service nova] Lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:43:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-24f80ed0-cd6f-49c7-b642-d7d2262a4539 req-c88fec0f-4297-417a-a236-739416ec54cc service nova] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] No waiting events found dispatching network-vif-unplugged-ebe87016-1c22-4149-9b25-bd6230a4f703 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:43:21 user nova-compute[73091]: WARNING nova.compute.manager [req-24f80ed0-cd6f-49c7-b642-d7d2262a4539 req-c88fec0f-4297-417a-a236-739416ec54cc service nova] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Received unexpected event network-vif-unplugged-ebe87016-1c22-4149-9b25-bd6230a4f703 for instance with vm_state deleted and task_state None.
Aug 09 16:43:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-24f80ed0-cd6f-49c7-b642-d7d2262a4539 req-c88fec0f-4297-417a-a236-739416ec54cc service nova] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Received event network-vif-plugged-ebe87016-1c22-4149-9b25-bd6230a4f703 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:43:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-24f80ed0-cd6f-49c7-b642-d7d2262a4539 req-c88fec0f-4297-417a-a236-739416ec54cc service nova] Acquiring lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:43:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-24f80ed0-cd6f-49c7-b642-d7d2262a4539 req-c88fec0f-4297-417a-a236-739416ec54cc service nova] Lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:43:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-24f80ed0-cd6f-49c7-b642-d7d2262a4539 req-c88fec0f-4297-417a-a236-739416ec54cc service nova] Lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:43:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-24f80ed0-cd6f-49c7-b642-d7d2262a4539 req-c88fec0f-4297-417a-a236-739416ec54cc service nova] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] No waiting events found dispatching network-vif-plugged-ebe87016-1c22-4149-9b25-bd6230a4f703 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:43:21 user nova-compute[73091]: WARNING nova.compute.manager [req-24f80ed0-cd6f-49c7-b642-d7d2262a4539 req-c88fec0f-4297-417a-a236-739416ec54cc service nova] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Received unexpected event network-vif-plugged-ebe87016-1c22-4149-9b25-bd6230a4f703 for instance with vm_state deleted and task_state None.
Aug 09 16:43:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-24f80ed0-cd6f-49c7-b642-d7d2262a4539 req-c88fec0f-4297-417a-a236-739416ec54cc service nova] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Received event network-vif-deleted-ebe87016-1c22-4149-9b25-bd6230a4f703 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:43:21 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:43:21 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:43:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:43:21 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Deleted allocations for instance db00ba13-17f9-4441-a5f5-6e0eac6aa541
Aug 09 16:43:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a4879fdd-8b90-431f-b05c-1b8853a5cb21 tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "db00ba13-17f9-4441-a5f5-6e0eac6aa541" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.987s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:43:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:43:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:43:25 user nova-compute[73091]: INFO nova.compute.manager [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Rebooting instance
Aug 09 16:43:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:43:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquired lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:43:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:43:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Updating instance_info_cache with network_info: [{"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:43:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Releasing lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:43:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:43:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-934aaa26-9a78-4f22-955b-1911c9b7e397 req-4e03a7c8-e703-4264-884a-59a50b2b5a64 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received event network-vif-unplugged-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-934aaa26-9a78-4f22-955b-1911c9b7e397 req-4e03a7c8-e703-4264-884a-59a50b2b5a64 service nova] Acquiring lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-934aaa26-9a78-4f22-955b-1911c9b7e397 req-4e03a7c8-e703-4264-884a-59a50b2b5a64 service nova] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-934aaa26-9a78-4f22-955b-1911c9b7e397 req-4e03a7c8-e703-4264-884a-59a50b2b5a64 service nova] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-934aaa26-9a78-4f22-955b-1911c9b7e397 req-4e03a7c8-e703-4264-884a-59a50b2b5a64 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] No waiting events found dispatching network-vif-unplugged-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:43:26 user nova-compute[73091]: WARNING nova.compute.manager [req-934aaa26-9a78-4f22-955b-1911c9b7e397 req-4e03a7c8-e703-4264-884a-59a50b2b5a64 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received unexpected event network-vif-unplugged-2d1a984c-9df8-49a7-9460-bee934ea307f for instance with vm_state active and task_state reboot_started_hard.
Aug 09 16:43:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Instance destroyed successfully.
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.objects.instance [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lazy-loading 'resources' on Instance uuid f8f52e24-8ce5-4128-a2aa-afc68ceb7213 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2111103488',display_name='tempest-TestMinimumBasicScenario-server-2111103488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2111103488',id=23,image_ref='7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4fcOiauymPg1Mn6EtQBUS6MQJ73JOzdMcX2vEpkzNb6cuhSFoEA59T/46bifiCrBZbHeOerT/inFpaPvwCybY3FALz6D+iNcGrn55JR/YB/RfNu/DBpwIJEcdSqkNNXQ==',key_name='tempest-TestMinimumBasicScenario-488048769',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:41:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e1ecfa8609840b1950ed8563bd427d1',ramdisk_id='',reservation_id='r-e4yztxi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-51921820',owner_user_name='tempest-TestMinimumBasicScenario-51921820-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:43:26Z,user_data=None,user_id='d6652e0ef40d4e26b67628d261f2848e',uuid=f8f52e24-8ce5-4128-a2aa-afc68ceb7213,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Converting VIF {"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:8c:6d,bridge_name='br-int',has_traffic_filtering=True,id=2d1a984c-9df8-49a7-9460-bee934ea307f,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d1a984c-9d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG os_vif [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:8c:6d,bridge_name='br-int',has_traffic_filtering=True,id=2d1a984c-9df8-49a7-9460-bee934ea307f,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d1a984c-9d') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d1a984c-9d, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:26 user nova-compute[73091]: INFO os_vif [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:8c:6d,bridge_name='br-int',has_traffic_filtering=True,id=2d1a984c-9df8-49a7-9460-bee934ea307f,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d1a984c-9d')
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNidHjKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:43:26 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:43:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a3eaf6-a35d-4bb9-a73b-7a8d93b8ca66]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6471b596-384f-49b4-844a-6b103174f453]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:43:26 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:43:26 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:43:26 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:43:26 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:43:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:43:26 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:43:26 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:43:26 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:43:26 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:43:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff06074b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0'): ({'sdf'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Removing single pathed devices sdf {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0376552d-8ca8-4211-9b6b-78033adc0ebf]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30f3cc6-17e7-46ce-8638-9feb70f697ea]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Flushing IO for device /dev/sdf {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc8a490-b689-4b9d-bd84-5c0491018096]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[788b9bce-8ee9-44fa-84c3-25be07a1070c]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea3950b-0881-45d7-a1ae-45c112c2b8a0]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7172f84-11a2-4677-811f-d91763ed0a09]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0, portal: 172.16.0.220,3260]
Aug 09 16:43:26 user nova-compute[73091]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0, portal: 172.16.0.220,3260] successful.
Aug 09 16:43:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd30d75-4092-4788-90bd-3c2090ec075c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] <== disconnect_volume: return (316ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Start _get_guest_xml network_info=[{"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': '7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '8e3456e5-9bed-4413-9d57-3bcc8152f70e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNidHjKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'f8f52e24-8ce5-4128-a2aa-afc68ceb7213', 'attached_at': '', 'detached_at': '', 'volume_id': 'e93752e2-313e-4a13-81bb-203e56bad5b0', 'serial': 'e93752e2-313e-4a13-81bb-203e56bad5b0'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:43:26 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:43:26 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:43:26 user nova-compute[73091]: DEBUG nova.objects.instance [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lazy-loading 'vcpu_model' on Instance uuid f8f52e24-8ce5-4128-a2aa-afc68ceb7213 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNidHjKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:43:27 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:43:27 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:43:27 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260" returned: 21 in 0.039s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c2cabe-74a8-45d2-9c32-946eb13d6fd5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:43:27 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d7839f-cb58-4a11-9221-293acd1df2a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0] added
Aug 09 16:43:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[34194f5b-2992-4ac1-b526-cc2add19f896]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5461d110-92c2-4d3e-a714-6fd19dfad8ad]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PNidHjKv {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PNidHjKv" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4e6032-f8ff-4df1-b7f7-b8154ea2fadf]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PNidHjKv'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e346416-d9ba-4489-a727-99e9ab46c5c6]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f2762b-d035-4ee1-b30d-0482f28fe0e0]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:43:27 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:43:27 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:43:27 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:43:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:43:27 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:43:27 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:43:27 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:43:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2324b432-3d2f-44f4-9e71-adf5a9aa6772]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0, portal: 172.16.0.220,3260]
Aug 09 16:43:27 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0, portal: 172.16.0.220,3260] successful.
Aug 09 16:43:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[114f99bf-bd62-454e-bbec-3a6c9545f37d]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[477097fa-2ec3-466a-bdc5-db2a3dcdbc8e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:43:27 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:43:27 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:43:27 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:43:27 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:43:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:43:27 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:43:27 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:43:27 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:43:27 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:43:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[707ef5b6-5dd3-44ed-9d4a-ba01b0508dfc]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-bbe67151-a4e0-4f51-a140-ad21afe47194 req-fa0146ca-e891-4eae-bcf2-e84b7751ab92 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received event network-vif-plugged-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bbe67151-a4e0-4f51-a140-ad21afe47194 req-fa0146ca-e891-4eae-bcf2-e84b7751ab92 service nova] Acquiring lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bbe67151-a4e0-4f51-a140-ad21afe47194 req-fa0146ca-e891-4eae-bcf2-e84b7751ab92 service nova] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bbe67151-a4e0-4f51-a140-ad21afe47194 req-fa0146ca-e891-4eae-bcf2-e84b7751ab92 service nova] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-bbe67151-a4e0-4f51-a140-ad21afe47194 req-fa0146ca-e891-4eae-bcf2-e84b7751ab92 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] No waiting events found dispatching network-vif-plugged-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:43:28 user nova-compute[73091]: WARNING nova.compute.manager [req-bbe67151-a4e0-4f51-a140-ad21afe47194 req-fa0146ca-e891-4eae-bcf2-e84b7751ab92 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received unexpected event network-vif-plugged-2d1a984c-9df8-49a7-9460-bee934ea307f for instance with vm_state active and task_state reboot_started_hard.
Aug 09 16:43:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNidHjKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23265633363653963', 'path': '/dev/sdf'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265633363653963', 'path': '/dev/sdf'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2111103488',display_name='tempest-TestMinimumBasicScenario-server-2111103488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2111103488',id=23,image_ref='7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4fcOiauymPg1Mn6EtQBUS6MQJ73JOzdMcX2vEpkzNb6cuhSFoEA59T/46bifiCrBZbHeOerT/inFpaPvwCybY3FALz6D+iNcGrn55JR/YB/RfNu/DBpwIJEcdSqkNNXQ==',key_name='tempest-TestMinimumBasicScenario-488048769',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:41:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e1ecfa8609840b1950ed8563bd427d1',ramdisk_id='',reservation_id='r-e4yztxi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-51921820',owner_user_name='tempest-TestMinimumBasicScenario-51921820-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:43:26Z,user_data=None,user_id='d6652e0ef40d4e26b67628d261f2848e',uuid=f8f52e24-8ce5-4128-a2aa-afc68ceb7213,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Converting VIF {"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:8c:6d,bridge_name='br-int',has_traffic_filtering=True,id=2d1a984c-9df8-49a7-9460-bee934ea307f,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d1a984c-9d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG nova.objects.instance [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lazy-loading 'pci_devices' on Instance uuid f8f52e24-8ce5-4128-a2aa-afc68ceb7213 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:43:28 user nova-compute[73091]:   <uuid>f8f52e24-8ce5-4128-a2aa-afc68ceb7213</uuid>
Aug 09 16:43:28 user nova-compute[73091]:   <name>instance-00000017</name>
Aug 09 16:43:28 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:43:28 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:43:28 user nova-compute[73091]:   <metadata>
Aug 09 16:43:28 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:43:28 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:43:28 user nova-compute[73091]:       <nova:name>tempest-TestMinimumBasicScenario-server-2111103488</nova:name>
Aug 09 16:43:28 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:43:26</nova:creationTime>
Aug 09 16:43:28 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:43:28 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:43:28 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:43:28 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:43:28 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:43:28 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:43:28 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:43:28 user nova-compute[73091]:       <nova:owner>
Aug 09 16:43:28 user nova-compute[73091]:         <nova:user uuid="d6652e0ef40d4e26b67628d261f2848e">tempest-TestMinimumBasicScenario-51921820-project-member</nova:user>
Aug 09 16:43:28 user nova-compute[73091]:         <nova:project uuid="2e1ecfa8609840b1950ed8563bd427d1">tempest-TestMinimumBasicScenario-51921820</nova:project>
Aug 09 16:43:28 user nova-compute[73091]:       </nova:owner>
Aug 09 16:43:28 user nova-compute[73091]:       <nova:root type="image" uuid="7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1"/>
Aug 09 16:43:28 user nova-compute[73091]:       <nova:ports>
Aug 09 16:43:28 user nova-compute[73091]:         <nova:port uuid="2d1a984c-9df8-49a7-9460-bee934ea307f">
Aug 09 16:43:28 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 16:43:28 user nova-compute[73091]:         </nova:port>
Aug 09 16:43:28 user nova-compute[73091]:       </nova:ports>
Aug 09 16:43:28 user nova-compute[73091]:     </nova:instance>
Aug 09 16:43:28 user nova-compute[73091]:   </metadata>
Aug 09 16:43:28 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:43:28 user nova-compute[73091]:     <system>
Aug 09 16:43:28 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:43:28 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:43:28 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:43:28 user nova-compute[73091]:       <entry name="serial">f8f52e24-8ce5-4128-a2aa-afc68ceb7213</entry>
Aug 09 16:43:28 user nova-compute[73091]:       <entry name="uuid">f8f52e24-8ce5-4128-a2aa-afc68ceb7213</entry>
Aug 09 16:43:28 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:43:28 user nova-compute[73091]:     </system>
Aug 09 16:43:28 user nova-compute[73091]:   </sysinfo>
Aug 09 16:43:28 user nova-compute[73091]:   <os>
Aug 09 16:43:28 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:43:28 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:43:28 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:43:28 user nova-compute[73091]:   </os>
Aug 09 16:43:28 user nova-compute[73091]:   <features>
Aug 09 16:43:28 user nova-compute[73091]:     <acpi/>
Aug 09 16:43:28 user nova-compute[73091]:     <apic/>
Aug 09 16:43:28 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:43:28 user nova-compute[73091]:   </features>
Aug 09 16:43:28 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:43:28 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:43:28 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:43:28 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:43:28 user nova-compute[73091]:   </clock>
Aug 09 16:43:28 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:43:28 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:43:28 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:43:28 user nova-compute[73091]:   </cpu>
Aug 09 16:43:28 user nova-compute[73091]:   <devices>
Aug 09 16:43:28 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:43:28 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:43:28 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk"/>
Aug 09 16:43:28 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:43:28 user nova-compute[73091]:     </disk>
Aug 09 16:43:28 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:43:28 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:43:28 user nova-compute[73091]:       <source dev="/dev/sdf"/>
Aug 09 16:43:28 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 09 16:43:28 user nova-compute[73091]:       <serial>e93752e2-313e-4a13-81bb-203e56bad5b0</serial>
Aug 09 16:43:28 user nova-compute[73091]:     </disk>
Aug 09 16:43:28 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:43:28 user nova-compute[73091]:       <mac address="fa:16:3e:c8:8c:6d"/>
Aug 09 16:43:28 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:43:28 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:43:28 user nova-compute[73091]:       <target dev="tap2d1a984c-9d"/>
Aug 09 16:43:28 user nova-compute[73091]:     </interface>
Aug 09 16:43:28 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:43:28 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/console.log" append="off"/>
Aug 09 16:43:28 user nova-compute[73091]:     </serial>
Aug 09 16:43:28 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:43:28 user nova-compute[73091]:     <video>
Aug 09 16:43:28 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:43:28 user nova-compute[73091]:     </video>
Aug 09 16:43:28 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:43:28 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:43:28 user nova-compute[73091]:     </rng>
Aug 09 16:43:28 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:43:28 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:43:28 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:43:28 user nova-compute[73091]:     </memballoon>
Aug 09 16:43:28 user nova-compute[73091]:   </devices>
Aug 09 16:43:28 user nova-compute[73091]: </domain>
Aug 09 16:43:28 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG nova.objects.instance [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lazy-loading 'trusted_certs' on Instance uuid f8f52e24-8ce5-4128-a2aa-afc68ceb7213 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216 --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216 --force-share --output=json" returned: 0 in 0.135s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:43:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:29 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Cannot resize image /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:43:29 user nova-compute[73091]: DEBUG nova.objects.instance [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lazy-loading 'migration_context' on Instance uuid f8f52e24-8ce5-4128-a2aa-afc68ceb7213 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:43:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2111103488',display_name='tempest-TestMinimumBasicScenario-server-2111103488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2111103488',id=23,image_ref='7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4fcOiauymPg1Mn6EtQBUS6MQJ73JOzdMcX2vEpkzNb6cuhSFoEA59T/46bifiCrBZbHeOerT/inFpaPvwCybY3FALz6D+iNcGrn55JR/YB/RfNu/DBpwIJEcdSqkNNXQ==',key_name='tempest-TestMinimumBasicScenario-488048769',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:41:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='2e1ecfa8609840b1950ed8563bd427d1',ramdisk_id='',reservation_id='r-e4yztxi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-51921820',owner_user_name='tempest-TestMinimumBasicScenario-51921820-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:43:26Z,user_data=None,user_id='d6652e0ef40d4e26b67628d261f2848e',uuid=f8f52e24-8ce5-4128-a2aa-afc68ceb7213,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:43:29 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Converting VIF {"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:43:29 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:8c:6d,bridge_name='br-int',has_traffic_filtering=True,id=2d1a984c-9df8-49a7-9460-bee934ea307f,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d1a984c-9d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:43:29 user nova-compute[73091]: DEBUG os_vif [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:8c:6d,bridge_name='br-int',has_traffic_filtering=True,id=2d1a984c-9df8-49a7-9460-bee934ea307f,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d1a984c-9d') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:43:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:43:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:43:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d1a984c-9d, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:43:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2d1a984c-9d, col_values=(('external_ids', {'iface-id': '2d1a984c-9df8-49a7-9460-bee934ea307f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:8c:6d', 'vm-uuid': 'f8f52e24-8ce5-4128-a2aa-afc68ceb7213'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:43:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:43:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:29 user nova-compute[73091]: INFO os_vif [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:8c:6d,bridge_name='br-int',has_traffic_filtering=True,id=2d1a984c-9df8-49a7-9460-bee934ea307f,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d1a984c-9d')
Aug 09 16:43:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-b9a14a7e-9f41-4dc7-b184-eb335fd2eab9 req-339da05e-316a-4ef8-92b9-ea90c49ee750 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received event network-vif-plugged-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:43:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b9a14a7e-9f41-4dc7-b184-eb335fd2eab9 req-339da05e-316a-4ef8-92b9-ea90c49ee750 service nova] Acquiring lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:43:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b9a14a7e-9f41-4dc7-b184-eb335fd2eab9 req-339da05e-316a-4ef8-92b9-ea90c49ee750 service nova] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:43:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b9a14a7e-9f41-4dc7-b184-eb335fd2eab9 req-339da05e-316a-4ef8-92b9-ea90c49ee750 service nova] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:43:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-b9a14a7e-9f41-4dc7-b184-eb335fd2eab9 req-339da05e-316a-4ef8-92b9-ea90c49ee750 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] No waiting events found dispatching network-vif-plugged-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:43:30 user nova-compute[73091]: WARNING nova.compute.manager [req-b9a14a7e-9f41-4dc7-b184-eb335fd2eab9 req-339da05e-316a-4ef8-92b9-ea90c49ee750 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received unexpected event network-vif-plugged-2d1a984c-9df8-49a7-9460-bee934ea307f for instance with vm_state active and task_state reboot_started_hard.
Aug 09 16:43:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:43:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:43:31 user nova-compute[73091]: INFO nova.compute.manager [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Detaching volume 236f66cb-c459-4991-8bd4-04b9f070e374
Aug 09 16:43:31 user nova-compute[73091]: INFO nova.virt.block_device [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Attempting to driver detach volume 236f66cb-c459-4991-8bd4-04b9f070e374 from mountpoint /dev/vdb
Aug 09 16:43:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Attempting to detach device vdb from instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:43:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:43:31 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:43:31 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 09 16:43:31 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:43:31 user nova-compute[73091]:   <serial>236f66cb-c459-4991-8bd4-04b9f070e374</serial>
Aug 09 16:43:31 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 16:43:31 user nova-compute[73091]: </disk>
Aug 09 16:43:31 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:43:31 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Successfully detached device vdb from instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b from the persistent domain config.
Aug 09 16:43:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:43:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:43:31 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:43:31 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 09 16:43:31 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:43:31 user nova-compute[73091]:   <serial>236f66cb-c459-4991-8bd4-04b9f070e374</serial>
Aug 09 16:43:31 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 16:43:31 user nova-compute[73091]: </disk>
Aug 09 16:43:31 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:43:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691599411.975903, 18d8e887-0f91-42e1-ba79-13db5aa9b84b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:43:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:43:31 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Successfully detached device vdb from instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b from the live domain config.
Aug 09 16:43:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:43:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfwOMhCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:43:31 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:43:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:43:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:43:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:43:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccf7b0f-67ad-4a20-8edc-27bc1a3ee26e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[842d7a30-ace6-482d-9fb9-e79e2f43085f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:43:32 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:43:32 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:43:32 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:43:32 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:43:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 (non-flash)
Aug 09 16:43:32 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:43:32 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:43:32 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:43:32 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:43:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0603d6f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374'): ({'sdd'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Removing single pathed devices sdd {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[405d2a12-8178-4554-912d-62495cc080d8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1f062a-f82a-4be6-9d80-fa8666d9d05c]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Flushing IO for device /dev/sdd {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06408a7-218d-4bdb-a2e0-7695308e5b10]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eb0897-0337-4636-b3d1-ba43a1946126]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[246b7a73-70a9-4c37-8771-46469f66a66e]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c70117-5653-4772-b554-3319e38af7ce]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374, portal: 172.16.0.220,3260]
Aug 09 16:43:32 user nova-compute[73091]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374, portal: 172.16.0.220,3260] successful.
Aug 09 16:43:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236f66cb-c459-4991-8bd4-04b9f070e374 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[52206ffb-7c12-46ae-8ba4-8a36b553ec87]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] <== disconnect_volume: return (316ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Removed pending event for f8f52e24-8ce5-4128-a2aa-afc68ceb7213 due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599412.6346865, f8f52e24-8ce5-4128-a2aa-afc68ceb7213 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:43:32 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] VM Resumed (Lifecycle Event)
Aug 09 16:43:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-512b9cee-ada0-4859-9443-62eaa696c9e4 req-551faa4c-957a-464d-bcd9-bdfd133b7f20 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received event network-vif-plugged-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-512b9cee-ada0-4859-9443-62eaa696c9e4 req-551faa4c-957a-464d-bcd9-bdfd133b7f20 service nova] Acquiring lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-512b9cee-ada0-4859-9443-62eaa696c9e4 req-551faa4c-957a-464d-bcd9-bdfd133b7f20 service nova] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-512b9cee-ada0-4859-9443-62eaa696c9e4 req-551faa4c-957a-464d-bcd9-bdfd133b7f20 service nova] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-512b9cee-ada0-4859-9443-62eaa696c9e4 req-551faa4c-957a-464d-bcd9-bdfd133b7f20 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] No waiting events found dispatching network-vif-plugged-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:43:32 user nova-compute[73091]: WARNING nova.compute.manager [req-512b9cee-ada0-4859-9443-62eaa696c9e4 req-551faa4c-957a-464d-bcd9-bdfd133b7f20 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received unexpected event network-vif-plugged-2d1a984c-9df8-49a7-9460-bee934ea307f for instance with vm_state active and task_state reboot_started_hard.
Aug 09 16:43:32 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Instance rebooted successfully.
Aug 09 16:43:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:43:32 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 09 16:43:32 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599412.6369493, f8f52e24-8ce5-4128-a2aa-afc68ceb7213 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:43:32 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] VM Started (Lifecycle Event)
Aug 09 16:43:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-33c93631-6e20-4c50-a180-b170d6d9c914 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.560s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:43:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:43:33 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lazy-loading 'flavor' on Instance uuid 18d8e887-0f91-42e1-ba79-13db5aa9b84b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:43:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6372eb0d-adc1-41f3-b8f4-96aa0f59fa7d tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.791s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:43:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:35 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599400.5755029, db00ba13-17f9-4441-a5f5-6e0eac6aa541 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:43:35 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] VM Stopped (Lifecycle Event)
Aug 09 16:43:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0cf40aba-cd96-415c-a3e6-af709e700f71 None None] [instance: db00ba13-17f9-4441-a5f5-6e0eac6aa541] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:43:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:43 user nova-compute[73091]: INFO nova.compute.manager [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Rescuing
Aug 09 16:43:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "refresh_cache-f939fe27-017a-481e-babc-147bf98e0132" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:43:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquired lock "refresh_cache-f939fe27-017a-481e-babc-147bf98e0132" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:43:43 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:43:43 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Updating instance_info_cache with network_info: [{"id": "c830ef2e-da54-4321-905f-845e0440a759", "address": "fa:16:3e:b5:68:3c", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc830ef2e-da", "ovs_interfaceid": "c830ef2e-da54-4321-905f-845e0440a759", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:43:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Releasing lock "refresh_cache-f939fe27-017a-481e-babc-147bf98e0132" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:43:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-c69c72e2-3f94-4400-b33d-dfe617e78ed3 req-7f0fd8fd-eccf-4293-9878-a34ed42ebdbf service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received event network-vif-unplugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c69c72e2-3f94-4400-b33d-dfe617e78ed3 req-7f0fd8fd-eccf-4293-9878-a34ed42ebdbf service nova] Acquiring lock "f939fe27-017a-481e-babc-147bf98e0132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c69c72e2-3f94-4400-b33d-dfe617e78ed3 req-7f0fd8fd-eccf-4293-9878-a34ed42ebdbf service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c69c72e2-3f94-4400-b33d-dfe617e78ed3 req-7f0fd8fd-eccf-4293-9878-a34ed42ebdbf service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-c69c72e2-3f94-4400-b33d-dfe617e78ed3 req-7f0fd8fd-eccf-4293-9878-a34ed42ebdbf service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] No waiting events found dispatching network-vif-unplugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:43:44 user nova-compute[73091]: WARNING nova.compute.manager [req-c69c72e2-3f94-4400-b33d-dfe617e78ed3 req-7f0fd8fd-eccf-4293-9878-a34ed42ebdbf service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received unexpected event network-vif-unplugged-c830ef2e-da54-4321-905f-845e0440a759 for instance with vm_state active and task_state rescuing.
Aug 09 16:43:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:44 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: f939fe27-017a-481e-babc-147bf98e0132] Instance destroyed successfully.
Aug 09 16:43:44 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Attempting rescue
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73091) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 16:43:44 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Creating image(s)
Aug 09 16:43:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "/opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "/opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "/opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'trusted_certs' on Instance uuid f939fe27-017a-481e-babc-147bf98e0132 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.151s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk.rescue {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk.rescue" returned: 0 in 0.054s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'migration_context' on Instance uuid f939fe27-017a-481e-babc-147bf98e0132 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Start _get_guest_xml network_info=[{"id": "c830ef2e-da54-4321-905f-845e0440a759", "address": "fa:16:3e:b5:68:3c", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "vif_mac": "fa:16:3e:b5:68:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc830ef2e-da", "ovs_interfaceid": "c830ef2e-da54-4321-905f-845e0440a759", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'resources' on Instance uuid f939fe27-017a-481e-babc-147bf98e0132 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'numa_topology' on Instance uuid f939fe27-017a-481e-babc-147bf98e0132 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:43:44 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:43:44 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'vcpu_model' on Instance uuid f939fe27-017a-481e-babc-147bf98e0132 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1580969082',display_name='tempest-ServerRescueNegativeTestJSON-server-1580969082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1580969082',id=19,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:39:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a03dd6b23c840c7b4a07f0235c1051b',ramdisk_id='',reservation_id='r-5cttsoe9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-596687024',owner_user_name='tempest-ServerRescueNegativeTestJSON-596687024-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:39:02Z,user_data=None,user_id='ef7727ab5d1b46d383bfc02750d29ec7',uuid=f939fe27-017a-481e-babc-147bf98e0132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c830ef2e-da54-4321-905f-845e0440a759", "address": "fa:16:3e:b5:68:3c", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "vif_mac": "fa:16:3e:b5:68:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc830ef2e-da", "ovs_interfaceid": "c830ef2e-da54-4321-905f-845e0440a759", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converting VIF {"id": "c830ef2e-da54-4321-905f-845e0440a759", "address": "fa:16:3e:b5:68:3c", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "vif_mac": "fa:16:3e:b5:68:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc830ef2e-da", "ovs_interfaceid": "c830ef2e-da54-4321-905f-845e0440a759", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:68:3c,bridge_name='br-int',has_traffic_filtering=True,id=c830ef2e-da54-4321-905f-845e0440a759,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc830ef2e-da') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'pci_devices' on Instance uuid f939fe27-017a-481e-babc-147bf98e0132 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:43:44 user nova-compute[73091]:   <uuid>f939fe27-017a-481e-babc-147bf98e0132</uuid>
Aug 09 16:43:44 user nova-compute[73091]:   <name>instance-00000013</name>
Aug 09 16:43:44 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:43:44 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:43:44 user nova-compute[73091]:   <metadata>
Aug 09 16:43:44 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:43:44 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:43:44 user nova-compute[73091]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1580969082</nova:name>
Aug 09 16:43:44 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:43:44</nova:creationTime>
Aug 09 16:43:44 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:43:44 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:43:44 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:43:44 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:43:44 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:43:44 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:43:44 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:43:44 user nova-compute[73091]:       <nova:owner>
Aug 09 16:43:44 user nova-compute[73091]:         <nova:user uuid="ef7727ab5d1b46d383bfc02750d29ec7">tempest-ServerRescueNegativeTestJSON-596687024-project-member</nova:user>
Aug 09 16:43:44 user nova-compute[73091]:         <nova:project uuid="1a03dd6b23c840c7b4a07f0235c1051b">tempest-ServerRescueNegativeTestJSON-596687024</nova:project>
Aug 09 16:43:44 user nova-compute[73091]:       </nova:owner>
Aug 09 16:43:44 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:43:44 user nova-compute[73091]:       <nova:ports>
Aug 09 16:43:44 user nova-compute[73091]:         <nova:port uuid="c830ef2e-da54-4321-905f-845e0440a759">
Aug 09 16:43:44 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 16:43:44 user nova-compute[73091]:         </nova:port>
Aug 09 16:43:44 user nova-compute[73091]:       </nova:ports>
Aug 09 16:43:44 user nova-compute[73091]:     </nova:instance>
Aug 09 16:43:44 user nova-compute[73091]:   </metadata>
Aug 09 16:43:44 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:43:44 user nova-compute[73091]:     <system>
Aug 09 16:43:44 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:43:44 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:43:44 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:43:44 user nova-compute[73091]:       <entry name="serial">f939fe27-017a-481e-babc-147bf98e0132</entry>
Aug 09 16:43:44 user nova-compute[73091]:       <entry name="uuid">f939fe27-017a-481e-babc-147bf98e0132</entry>
Aug 09 16:43:44 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:43:44 user nova-compute[73091]:     </system>
Aug 09 16:43:44 user nova-compute[73091]:   </sysinfo>
Aug 09 16:43:44 user nova-compute[73091]:   <os>
Aug 09 16:43:44 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:43:44 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:43:44 user nova-compute[73091]:   </os>
Aug 09 16:43:44 user nova-compute[73091]:   <features>
Aug 09 16:43:44 user nova-compute[73091]:     <acpi/>
Aug 09 16:43:44 user nova-compute[73091]:     <apic/>
Aug 09 16:43:44 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:43:44 user nova-compute[73091]:   </features>
Aug 09 16:43:44 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:43:44 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:43:44 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:43:44 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:43:44 user nova-compute[73091]:   </clock>
Aug 09 16:43:44 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:43:44 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:43:44 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:43:44 user nova-compute[73091]:   </cpu>
Aug 09 16:43:44 user nova-compute[73091]:   <devices>
Aug 09 16:43:44 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:43:44 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:43:44 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk.rescue"/>
Aug 09 16:43:44 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:43:44 user nova-compute[73091]:     </disk>
Aug 09 16:43:44 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:43:44 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:43:44 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk"/>
Aug 09 16:43:44 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 09 16:43:44 user nova-compute[73091]:     </disk>
Aug 09 16:43:44 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:43:44 user nova-compute[73091]:       <mac address="fa:16:3e:b5:68:3c"/>
Aug 09 16:43:44 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:43:44 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:43:44 user nova-compute[73091]:       <target dev="tapc830ef2e-da"/>
Aug 09 16:43:44 user nova-compute[73091]:     </interface>
Aug 09 16:43:44 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:43:44 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/console.log" append="off"/>
Aug 09 16:43:44 user nova-compute[73091]:     </serial>
Aug 09 16:43:44 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:43:44 user nova-compute[73091]:     <video>
Aug 09 16:43:44 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:43:44 user nova-compute[73091]:     </video>
Aug 09 16:43:44 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:43:44 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:43:44 user nova-compute[73091]:     </rng>
Aug 09 16:43:44 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:43:44 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:43:44 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:43:44 user nova-compute[73091]:     </memballoon>
Aug 09 16:43:44 user nova-compute[73091]:   </devices>
Aug 09 16:43:44 user nova-compute[73091]: </domain>
Aug 09 16:43:44 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:43:44 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: f939fe27-017a-481e-babc-147bf98e0132] Instance destroyed successfully.
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:43:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] No VIF found with MAC fa:16:3e:b5:68:3c, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:43:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-9ebbde41-773f-440d-8393-1cb6005f2236 req-1fdfcd41-fd62-4ba8-a3e6-155d48b73138 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received event network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:43:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9ebbde41-773f-440d-8393-1cb6005f2236 req-1fdfcd41-fd62-4ba8-a3e6-155d48b73138 service nova] Acquiring lock "f939fe27-017a-481e-babc-147bf98e0132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:43:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9ebbde41-773f-440d-8393-1cb6005f2236 req-1fdfcd41-fd62-4ba8-a3e6-155d48b73138 service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:43:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9ebbde41-773f-440d-8393-1cb6005f2236 req-1fdfcd41-fd62-4ba8-a3e6-155d48b73138 service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:43:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-9ebbde41-773f-440d-8393-1cb6005f2236 req-1fdfcd41-fd62-4ba8-a3e6-155d48b73138 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] No waiting events found dispatching network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:43:46 user nova-compute[73091]: WARNING nova.compute.manager [req-9ebbde41-773f-440d-8393-1cb6005f2236 req-1fdfcd41-fd62-4ba8-a3e6-155d48b73138 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received unexpected event network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 for instance with vm_state active and task_state rescuing.
Aug 09 16:43:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-54550c74-f1e2-4a68-b01c-2dfb4c934b73 req-a2b91d98-e3e1-4d08-b3fa-fc928e4825da service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received event network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:43:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-54550c74-f1e2-4a68-b01c-2dfb4c934b73 req-a2b91d98-e3e1-4d08-b3fa-fc928e4825da service nova] Acquiring lock "f939fe27-017a-481e-babc-147bf98e0132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:43:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-54550c74-f1e2-4a68-b01c-2dfb4c934b73 req-a2b91d98-e3e1-4d08-b3fa-fc928e4825da service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:43:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-54550c74-f1e2-4a68-b01c-2dfb4c934b73 req-a2b91d98-e3e1-4d08-b3fa-fc928e4825da service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:43:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-54550c74-f1e2-4a68-b01c-2dfb4c934b73 req-a2b91d98-e3e1-4d08-b3fa-fc928e4825da service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] No waiting events found dispatching network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:43:48 user nova-compute[73091]: WARNING nova.compute.manager [req-54550c74-f1e2-4a68-b01c-2dfb4c934b73 req-a2b91d98-e3e1-4d08-b3fa-fc928e4825da service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received unexpected event network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 for instance with vm_state active and task_state rescuing.
Aug 09 16:43:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-54550c74-f1e2-4a68-b01c-2dfb4c934b73 req-a2b91d98-e3e1-4d08-b3fa-fc928e4825da service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received event network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:43:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-54550c74-f1e2-4a68-b01c-2dfb4c934b73 req-a2b91d98-e3e1-4d08-b3fa-fc928e4825da service nova] Acquiring lock "f939fe27-017a-481e-babc-147bf98e0132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:43:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-54550c74-f1e2-4a68-b01c-2dfb4c934b73 req-a2b91d98-e3e1-4d08-b3fa-fc928e4825da service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:43:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-54550c74-f1e2-4a68-b01c-2dfb4c934b73 req-a2b91d98-e3e1-4d08-b3fa-fc928e4825da service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:43:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-54550c74-f1e2-4a68-b01c-2dfb4c934b73 req-a2b91d98-e3e1-4d08-b3fa-fc928e4825da service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] No waiting events found dispatching network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:43:48 user nova-compute[73091]: WARNING nova.compute.manager [req-54550c74-f1e2-4a68-b01c-2dfb4c934b73 req-a2b91d98-e3e1-4d08-b3fa-fc928e4825da service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received unexpected event network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 for instance with vm_state active and task_state rescuing.
Aug 09 16:43:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Removed pending event for f939fe27-017a-481e-babc-147bf98e0132 due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 16:43:48 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599428.4238446, f939fe27-017a-481e-babc-147bf98e0132 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:43:48 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] VM Resumed (Lifecycle Event)
Aug 09 16:43:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4e4fea97-8aa1-4028-ad1f-75064e38bf46 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:43:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:43:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:43:48 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 16:43:48 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599428.4277065, f939fe27-017a-481e-babc-147bf98e0132 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:43:48 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] VM Started (Lifecycle Event)
Aug 09 16:43:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:43:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:43:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:43:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:44:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:44:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:44:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:44:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 16:44:07 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:44:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 16:44:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 16:44:08 user nova-compute[73091]: INFO nova.compute.manager [None req-97c21488-105f-49a8-9cf7-fea5babbbb28 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Unrescuing
Aug 09 16:44:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-97c21488-105f-49a8-9cf7-fea5babbbb28 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:44:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-97c21488-105f-49a8-9cf7-fea5babbbb28 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquired lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:44:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-97c21488-105f-49a8-9cf7-fea5babbbb28 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:44:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-97c21488-105f-49a8-9cf7-fea5babbbb28 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Updating instance_info_cache with network_info: [{"id": "50f0d7f2-7e34-475a-9d69-145a0e321400", "address": "fa:16:3e:25:e0:ab", "network": {"id": "5868d9d5-2152-496d-93e2-8e1308b2ad18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d65ef533e7c145faae7d9af3815007ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0d7f2-7e", "ovs_interfaceid": "50f0d7f2-7e34-475a-9d69-145a0e321400", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:44:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-97c21488-105f-49a8-9cf7-fea5babbbb28 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Releasing lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:44:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-97c21488-105f-49a8-9cf7-fea5babbbb28 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lazy-loading 'flavor' on Instance uuid 38051bca-7190-4dff-91d1-3d99b4e4182b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:44:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-6ad917b1-1181-4ab2-baa2-4057d78bd407 req-447211ce-3f23-4924-bd26-d4e438abd807 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received event network-vif-unplugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6ad917b1-1181-4ab2-baa2-4057d78bd407 req-447211ce-3f23-4924-bd26-d4e438abd807 service nova] Acquiring lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6ad917b1-1181-4ab2-baa2-4057d78bd407 req-447211ce-3f23-4924-bd26-d4e438abd807 service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6ad917b1-1181-4ab2-baa2-4057d78bd407 req-447211ce-3f23-4924-bd26-d4e438abd807 service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-6ad917b1-1181-4ab2-baa2-4057d78bd407 req-447211ce-3f23-4924-bd26-d4e438abd807 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] No waiting events found dispatching network-vif-unplugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:44:09 user nova-compute[73091]: WARNING nova.compute.manager [req-6ad917b1-1181-4ab2-baa2-4057d78bd407 req-447211ce-3f23-4924-bd26-d4e438abd807 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received unexpected event network-vif-unplugged-50f0d7f2-7e34-475a-9d69-145a0e321400 for instance with vm_state rescued and task_state unrescuing.
Aug 09 16:44:09 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Instance destroyed successfully.
Aug 09 16:44:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-964a69f9-a3fd-41a2-85cb-acfdba3ac44d req-7301b57b-3903-486c-ab6b-f2a01508f995 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received event network-changed-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-964a69f9-a3fd-41a2-85cb-acfdba3ac44d req-7301b57b-3903-486c-ab6b-f2a01508f995 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Refreshing instance network info cache due to event network-changed-50f0d7f2-7e34-475a-9d69-145a0e321400. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:44:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-964a69f9-a3fd-41a2-85cb-acfdba3ac44d req-7301b57b-3903-486c-ab6b-f2a01508f995 service nova] Acquiring lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:44:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-964a69f9-a3fd-41a2-85cb-acfdba3ac44d req-7301b57b-3903-486c-ab6b-f2a01508f995 service nova] Acquired lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:44:10 user nova-compute[73091]: DEBUG nova.network.neutron [req-964a69f9-a3fd-41a2-85cb-acfdba3ac44d req-7301b57b-3903-486c-ab6b-f2a01508f995 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Refreshing network info cache for port 50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:44:10 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Port 93d41bee-7cab-45a7-b409-dd19fc3b88b6 binding to destination host user is already ACTIVE {{(pid=73091) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 16:44:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:44:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquired lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:44:10 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:44:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:10 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:44:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:44:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-93e10fd4-8841-4043-b4e2-7489c4dea3e6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-93e10fd4-8841-4043-b4e2-7489c4dea3e6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG nova.network.neutron [req-964a69f9-a3fd-41a2-85cb-acfdba3ac44d req-7301b57b-3903-486c-ab6b-f2a01508f995 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Updated VIF entry in instance network info cache for port 50f0d7f2-7e34-475a-9d69-145a0e321400. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG nova.network.neutron [req-964a69f9-a3fd-41a2-85cb-acfdba3ac44d req-7301b57b-3903-486c-ab6b-f2a01508f995 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Updating instance_info_cache with network_info: [{"id": "50f0d7f2-7e34-475a-9d69-145a0e321400", "address": "fa:16:3e:25:e0:ab", "network": {"id": "5868d9d5-2152-496d-93e2-8e1308b2ad18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d65ef533e7c145faae7d9af3815007ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0d7f2-7e", "ovs_interfaceid": "50f0d7f2-7e34-475a-9d69-145a0e321400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-964a69f9-a3fd-41a2-85cb-acfdba3ac44d req-7301b57b-3903-486c-ab6b-f2a01508f995 service nova] Releasing lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-21a73798-53d0-42c0-afee-6212cca66f17 req-48f3470a-4192-4af2-9932-3075dbcec20b service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received event network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-21a73798-53d0-42c0-afee-6212cca66f17 req-48f3470a-4192-4af2-9932-3075dbcec20b service nova] Acquiring lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-21a73798-53d0-42c0-afee-6212cca66f17 req-48f3470a-4192-4af2-9932-3075dbcec20b service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-21a73798-53d0-42c0-afee-6212cca66f17 req-48f3470a-4192-4af2-9932-3075dbcec20b service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-21a73798-53d0-42c0-afee-6212cca66f17 req-48f3470a-4192-4af2-9932-3075dbcec20b service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] No waiting events found dispatching network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:44:11 user nova-compute[73091]: WARNING nova.compute.manager [req-21a73798-53d0-42c0-afee-6212cca66f17 req-48f3470a-4192-4af2-9932-3075dbcec20b service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received unexpected event network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 for instance with vm_state rescued and task_state unrescuing.
Aug 09 16:44:11 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Updating instance_info_cache with network_info: [{"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Releasing lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Creating tmpfile /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/tmp0tomvxta to verify with other compute node that the instance is on the same shared storage. {{(pid=73091) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-636d4741-f784-4488-905e-adfd53827681 req-29dbdbe9-d073-46e8-958c-5dcefd95208b service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received event network-vif-unplugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-636d4741-f784-4488-905e-adfd53827681 req-29dbdbe9-d073-46e8-958c-5dcefd95208b service nova] Acquiring lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-636d4741-f784-4488-905e-adfd53827681 req-29dbdbe9-d073-46e8-958c-5dcefd95208b service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-636d4741-f784-4488-905e-adfd53827681 req-29dbdbe9-d073-46e8-958c-5dcefd95208b service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-636d4741-f784-4488-905e-adfd53827681 req-29dbdbe9-d073-46e8-958c-5dcefd95208b service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] No waiting events found dispatching network-vif-unplugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:44:11 user nova-compute[73091]: WARNING nova.compute.manager [req-636d4741-f784-4488-905e-adfd53827681 req-29dbdbe9-d073-46e8-958c-5dcefd95208b service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received unexpected event network-vif-unplugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 for instance with vm_state resized and task_state resize_reverting.
Aug 09 16:44:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-39cf4080-9ff4-4a84-be62-b42f01e674d5 req-7ea5107c-00df-459f-ba67-fc6649deb1e4 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received event network-changed-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-39cf4080-9ff4-4a84-be62-b42f01e674d5 req-7ea5107c-00df-459f-ba67-fc6649deb1e4 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Refreshing instance network info cache due to event network-changed-50f0d7f2-7e34-475a-9d69-145a0e321400. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-39cf4080-9ff4-4a84-be62-b42f01e674d5 req-7ea5107c-00df-459f-ba67-fc6649deb1e4 service nova] Acquiring lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-39cf4080-9ff4-4a84-be62-b42f01e674d5 req-7ea5107c-00df-459f-ba67-fc6649deb1e4 service nova] Acquired lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG nova.network.neutron [req-39cf4080-9ff4-4a84-be62-b42f01e674d5 req-7ea5107c-00df-459f-ba67-fc6649deb1e4 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Refreshing network info cache for port 50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Instance destroyed successfully.
Aug 09 16:44:12 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lazy-loading 'resources' on Instance uuid 68d63bc2-d726-49d8-91de-bc5cc66bb119 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1756856509',display_name='tempest-ServerActionsTestOtherB-server-1756856509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1756856509',id=15,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX4A4WBbci8tvlyfsVn8RtvZ67v0qxFwI098O4ybt1xkpAJgwLMitJ+vOXZXn9ziILn0Dux9cadl75sAIWbob/GvRq9Jin537WzoAVu2MvbyterRxvGm1tqvtVxJqTjrw==',key_name='tempest-keypair-561558216',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:42:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='329738ae9226414383acb6dcbd09dea0',ramdisk_id='',reservation_id='r-r2gg9o0o',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1665559429',owner_user_name='tempest-ServerActionsTestOtherB-1665559429-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:42:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a90a17815b46b8a64be7510ac5ba49',uuid=68d63bc2-d726-49d8-91de-bc5cc66bb119,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Converting VIF {"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG os_vif [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93d41bee-7c, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:44:12 user nova-compute[73091]: INFO os_vif [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c')
Aug 09 16:44:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfUAobeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:44:12 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:44:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de64504-50a1-404b-b30c-c97c54f565b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fa5d01-7a5e-4643-b320-3898db58cc68]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:44:12 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:44:12 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:44:12 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:44:12 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:44:12 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:44:12 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:44:12 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:44:12 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0603d6950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Removing single pathed devices sde {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73123d8-07e8-4b40-bed5-f7c4202d8020]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[824a947c-6374-43e0-b9a8-b96a09c5fb28]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e9cc1b-4d97-4395-9f63-f78fc8c37ac9]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1975c110-b7ca-483d-81d8-cbee6e8d037b]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dedf1bd-f572-451c-b4a3-12c68ee9b0cc]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dfcdd2-3a2a-4223-9ffe-688fc47ebde1]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260]
Aug 09 16:44:12 user nova-compute[73091]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260] successful.
Aug 09 16:44:12 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d90dac-d1c6-4cc0-9bd6-00431a0eca8c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] <== disconnect_volume: return (326ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Updating instance_info_cache with network_info: [{"id": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "address": "fa:16:3e:0b:7a:ff", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79746b9-c9", "ovs_interfaceid": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-93e10fd4-8841-4043-b4e2-7489c4dea3e6" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:44:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG nova.network.neutron [req-39cf4080-9ff4-4a84-be62-b42f01e674d5 req-7ea5107c-00df-459f-ba67-fc6649deb1e4 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Updated VIF entry in instance network info cache for port 50f0d7f2-7e34-475a-9d69-145a0e321400. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG nova.network.neutron [req-39cf4080-9ff4-4a84-be62-b42f01e674d5 req-7ea5107c-00df-459f-ba67-fc6649deb1e4 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Updating instance_info_cache with network_info: [{"id": "50f0d7f2-7e34-475a-9d69-145a0e321400", "address": "fa:16:3e:25:e0:ab", "network": {"id": "5868d9d5-2152-496d-93e2-8e1308b2ad18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d65ef533e7c145faae7d9af3815007ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0d7f2-7e", "ovs_interfaceid": "50f0d7f2-7e34-475a-9d69-145a0e321400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-39cf4080-9ff4-4a84-be62-b42f01e674d5 req-7ea5107c-00df-459f-ba67-fc6649deb1e4 service nova] Releasing lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Removed pending event for 38051bca-7190-4dff-91d1-3d99b4e4182b due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599453.2850583, 38051bca-7190-4dff-91d1-3d99b4e4182b => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:44:13 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] VM Resumed (Lifecycle Event)
Aug 09 16:44:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-97c21488-105f-49a8-9cf7-fea5babbbb28 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-b034a0d3-8c2a-421c-94e1-4ce86c71698e req-98bfe8a3-477c-4b4d-be85-db31064e907f service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received event network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b034a0d3-8c2a-421c-94e1-4ce86c71698e req-98bfe8a3-477c-4b4d-be85-db31064e907f service nova] Acquiring lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b034a0d3-8c2a-421c-94e1-4ce86c71698e req-98bfe8a3-477c-4b4d-be85-db31064e907f service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b034a0d3-8c2a-421c-94e1-4ce86c71698e req-98bfe8a3-477c-4b4d-be85-db31064e907f service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-b034a0d3-8c2a-421c-94e1-4ce86c71698e req-98bfe8a3-477c-4b4d-be85-db31064e907f service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] No waiting events found dispatching network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:44:13 user nova-compute[73091]: WARNING nova.compute.manager [req-b034a0d3-8c2a-421c-94e1-4ce86c71698e req-98bfe8a3-477c-4b4d-be85-db31064e907f service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received unexpected event network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 for instance with vm_state rescued and task_state unrescuing.
Aug 09 16:44:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-b034a0d3-8c2a-421c-94e1-4ce86c71698e req-98bfe8a3-477c-4b4d-be85-db31064e907f service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received event network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b034a0d3-8c2a-421c-94e1-4ce86c71698e req-98bfe8a3-477c-4b4d-be85-db31064e907f service nova] Acquiring lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b034a0d3-8c2a-421c-94e1-4ce86c71698e req-98bfe8a3-477c-4b4d-be85-db31064e907f service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b034a0d3-8c2a-421c-94e1-4ce86c71698e req-98bfe8a3-477c-4b4d-be85-db31064e907f service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-b034a0d3-8c2a-421c-94e1-4ce86c71698e req-98bfe8a3-477c-4b4d-be85-db31064e907f service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] No waiting events found dispatching network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:44:13 user nova-compute[73091]: WARNING nova.compute.manager [req-b034a0d3-8c2a-421c-94e1-4ce86c71698e req-98bfe8a3-477c-4b4d-be85-db31064e907f service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received unexpected event network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 for instance with vm_state rescued and task_state unrescuing.
Aug 09 16:44:13 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 16:44:13 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599453.2863078, 38051bca-7190-4dff-91d1-3d99b4e4182b => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:44:13 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] VM Started (Lifecycle Event)
Aug 09 16:44:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lazy-loading 'migration_context' on Instance uuid 68d63bc2-d726-49d8-91de-bc5cc66bb119 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-fd341c44-bf58-4bd4-8775-bf889bd74330 req-f7af66e3-8554-434c-9010-cc5ccdd94434 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received event network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fd341c44-bf58-4bd4-8775-bf889bd74330 req-f7af66e3-8554-434c-9010-cc5ccdd94434 service nova] Acquiring lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fd341c44-bf58-4bd4-8775-bf889bd74330 req-f7af66e3-8554-434c-9010-cc5ccdd94434 service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fd341c44-bf58-4bd4-8775-bf889bd74330 req-f7af66e3-8554-434c-9010-cc5ccdd94434 service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-fd341c44-bf58-4bd4-8775-bf889bd74330 req-f7af66e3-8554-434c-9010-cc5ccdd94434 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] No waiting events found dispatching network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:44:13 user nova-compute[73091]: WARNING nova.compute.manager [req-fd341c44-bf58-4bd4-8775-bf889bd74330 req-f7af66e3-8554-434c-9010-cc5ccdd94434 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received unexpected event network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 for instance with vm_state resized and task_state resize_reverting.
Aug 09 16:44:13 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Refreshing inventories for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Updating ProviderTree inventory for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Updating inventory in ProviderTree for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Refreshing aggregate associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Refreshing trait associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, traits: HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-ce636ae2-f07e-440b-b72f-1970f7e660b5 req-b1e7bb76-fe26-4583-950a-aaf2b90ee777 service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Received event network-changed-7c149e7c-01fc-4bfc-a69d-8c1841f904e9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-ce636ae2-f07e-440b-b72f-1970f7e660b5 req-b1e7bb76-fe26-4583-950a-aaf2b90ee777 service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Refreshing instance network info cache due to event network-changed-7c149e7c-01fc-4bfc-a69d-8c1841f904e9. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce636ae2-f07e-440b-b72f-1970f7e660b5 req-b1e7bb76-fe26-4583-950a-aaf2b90ee777 service nova] Acquiring lock "refresh_cache-4a39f479-265c-49c3-86c4-a65fff2f06c4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce636ae2-f07e-440b-b72f-1970f7e660b5 req-b1e7bb76-fe26-4583-950a-aaf2b90ee777 service nova] Acquired lock "refresh_cache-4a39f479-265c-49c3-86c4-a65fff2f06c4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG nova.network.neutron [req-ce636ae2-f07e-440b-b72f-1970f7e660b5 req-b1e7bb76-fe26-4583-950a-aaf2b90ee777 service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Refreshing network info cache for port 7c149e7c-01fc-4bfc-a69d-8c1841f904e9 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 1.038s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG nova.network.neutron [req-ce636ae2-f07e-440b-b72f-1970f7e660b5 req-b1e7bb76-fe26-4583-950a-aaf2b90ee777 service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Updated VIF entry in instance network info cache for port 7c149e7c-01fc-4bfc-a69d-8c1841f904e9. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG nova.network.neutron [req-ce636ae2-f07e-440b-b72f-1970f7e660b5 req-b1e7bb76-fe26-4583-950a-aaf2b90ee777 service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Updating instance_info_cache with network_info: [{"id": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "address": "fa:16:3e:89:17:f3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c149e7c-01", "ovs_interfaceid": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce636ae2-f07e-440b-b72f-1970f7e660b5 req-b1e7bb76-fe26-4583-950a-aaf2b90ee777 service nova] Releasing lock "refresh_cache-4a39f479-265c-49c3-86c4-a65fff2f06c4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-ce636ae2-f07e-440b-b72f-1970f7e660b5 req-b1e7bb76-fe26-4583-950a-aaf2b90ee777 service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Received event network-changed-23754e3d-f575-4074-b60b-f1104372977b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-ce636ae2-f07e-440b-b72f-1970f7e660b5 req-b1e7bb76-fe26-4583-950a-aaf2b90ee777 service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Refreshing instance network info cache due to event network-changed-23754e3d-f575-4074-b60b-f1104372977b. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce636ae2-f07e-440b-b72f-1970f7e660b5 req-b1e7bb76-fe26-4583-950a-aaf2b90ee777 service nova] Acquiring lock "refresh_cache-148cb211-b2f6-4782-8f35-e66a55cc95bc" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce636ae2-f07e-440b-b72f-1970f7e660b5 req-b1e7bb76-fe26-4583-950a-aaf2b90ee777 service nova] Acquired lock "refresh_cache-148cb211-b2f6-4782-8f35-e66a55cc95bc" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:44:14 user nova-compute[73091]: DEBUG nova.network.neutron [req-ce636ae2-f07e-440b-b72f-1970f7e660b5 req-b1e7bb76-fe26-4583-950a-aaf2b90ee777 service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Refreshing network info cache for port 23754e3d-f575-4074-b60b-f1104372977b {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:44:15 user nova-compute[73091]: INFO nova.compute.manager [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Swapping old allocation on dict_keys(['acad0a00-fc5f-4423-bdc7-4d5877e83b16']) held by migration 0c59254d-ea01-46db-919b-e65f5d788c1f for instance
Aug 09 16:44:15 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Overwriting current allocation {'allocations': {'acad0a00-fc5f-4423-bdc7-4d5877e83b16': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 32}}, 'project_id': '329738ae9226414383acb6dcbd09dea0', 'user_id': '77a90a17815b46b8a64be7510ac5ba49', 'consumer_generation': 1} on consumer 68d63bc2-d726-49d8-91de-bc5cc66bb119 {{(pid=73091) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 09 16:44:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:44:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquired lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:44:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:44:15 user nova-compute[73091]: DEBUG nova.network.neutron [req-ce636ae2-f07e-440b-b72f-1970f7e660b5 req-b1e7bb76-fe26-4583-950a-aaf2b90ee777 service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Updated VIF entry in instance network info cache for port 23754e3d-f575-4074-b60b-f1104372977b. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:44:15 user nova-compute[73091]: DEBUG nova.network.neutron [req-ce636ae2-f07e-440b-b72f-1970f7e660b5 req-b1e7bb76-fe26-4583-950a-aaf2b90ee777 service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Updating instance_info_cache with network_info: [{"id": "23754e3d-f575-4074-b60b-f1104372977b", "address": "fa:16:3e:b8:14:7c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23754e3d-f5", "ovs_interfaceid": "23754e3d-f575-4074-b60b-f1104372977b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:44:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce636ae2-f07e-440b-b72f-1970f7e660b5 req-b1e7bb76-fe26-4583-950a-aaf2b90ee777 service nova] Releasing lock "refresh_cache-148cb211-b2f6-4782-8f35-e66a55cc95bc" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:44:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:44:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:44:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:15 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Updating instance_info_cache with network_info: [{"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Releasing lock "refresh_cache-68d63bc2-d726-49d8-91de-bc5cc66bb119" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG os_brick.utils [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d423cee3-f94f-48a7-85df-4604cbe7e002]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d8dfa8-916d-42f7-9911-e61393743f45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46c20ae-a163-4d2b-84cc-14124653c0dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae9cf16-9591-42f5-9e4d-296ed6c39928]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:44:16 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c60128-81d1-4697-a0cc-6cea2b7d2104]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG os_brick.utils [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] <== get_connector_properties: return (203ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Acquiring lock "91d979ce-00bf-4a15-841c-b6b66092c874" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Lock "91d979ce-00bf-4a15-841c-b6b66092c874" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Acquiring lock "91d979ce-00bf-4a15-841c-b6b66092c874-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Lock "91d979ce-00bf-4a15-841c-b6b66092c874-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Lock "91d979ce-00bf-4a15-841c-b6b66092c874-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:16 user nova-compute[73091]: INFO nova.compute.manager [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Terminating instance
Aug 09 16:44:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-0b606bed-85f4-43a5-be3a-c2be78708ae3 req-b2eb92b7-e4c0-4287-b232-5931704781eb service nova] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Received event network-vif-unplugged-fe85552d-8cb5-4175-998e-08410f9d3e46 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0b606bed-85f4-43a5-be3a-c2be78708ae3 req-b2eb92b7-e4c0-4287-b232-5931704781eb service nova] Acquiring lock "91d979ce-00bf-4a15-841c-b6b66092c874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0b606bed-85f4-43a5-be3a-c2be78708ae3 req-b2eb92b7-e4c0-4287-b232-5931704781eb service nova] Lock "91d979ce-00bf-4a15-841c-b6b66092c874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0b606bed-85f4-43a5-be3a-c2be78708ae3 req-b2eb92b7-e4c0-4287-b232-5931704781eb service nova] Lock "91d979ce-00bf-4a15-841c-b6b66092c874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-0b606bed-85f4-43a5-be3a-c2be78708ae3 req-b2eb92b7-e4c0-4287-b232-5931704781eb service nova] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] No waiting events found dispatching network-vif-unplugged-fe85552d-8cb5-4175-998e-08410f9d3e46 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-0b606bed-85f4-43a5-be3a-c2be78708ae3 req-b2eb92b7-e4c0-4287-b232-5931704781eb service nova] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Received event network-vif-unplugged-fe85552d-8cb5-4175-998e-08410f9d3e46 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:17 user nova-compute[73091]: INFO nova.compute.manager [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Terminating instance
Aug 09 16:44:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "4a39f479-265c-49c3-86c4-a65fff2f06c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "4a39f479-265c-49c3-86c4-a65fff2f06c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG nova.objects.instance [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'flavor' on Instance uuid 4a39f479-265c-49c3-86c4-a65fff2f06c4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Instance destroyed successfully.
Aug 09 16:44:17 user nova-compute[73091]: DEBUG nova.objects.instance [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Lazy-loading 'resources' on Instance uuid 91d979ce-00bf-4a15-841c-b6b66092c874 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:42:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2122026904',display_name='tempest-VolumesNegativeTest-instance-2122026904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2122026904',id=27,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:42:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74bab6b1220048119001e80532700cf4',ramdisk_id='',reservation_id='r-b3bwqo8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1280249766',owner_user_name='tempest-VolumesNegativeTest-1280249766-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:42:34Z,user_data=None,user_id='b58b3a3f4e5e4aaf94417efd50e4ff1e',uuid=91d979ce-00bf-4a15-841c-b6b66092c874,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe85552d-8cb5-4175-998e-08410f9d3e46", "address": "fa:16:3e:27:42:ba", "network": {"id": "00fbf9c7-31b8-44b1-aa74-4cde83cf6e43", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60dfd79245eb479985ac7f4dd5ed5356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe85552d-8c", "ovs_interfaceid": "fe85552d-8cb5-4175-998e-08410f9d3e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Converting VIF {"id": "fe85552d-8cb5-4175-998e-08410f9d3e46", "address": "fa:16:3e:27:42:ba", "network": {"id": "00fbf9c7-31b8-44b1-aa74-4cde83cf6e43", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60dfd79245eb479985ac7f4dd5ed5356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe85552d-8c", "ovs_interfaceid": "fe85552d-8cb5-4175-998e-08410f9d3e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:42:ba,bridge_name='br-int',has_traffic_filtering=True,id=fe85552d-8cb5-4175-998e-08410f9d3e46,network=Network(00fbf9c7-31b8-44b1-aa74-4cde83cf6e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe85552d-8c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG os_vif [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:42:ba,bridge_name='br-int',has_traffic_filtering=True,id=fe85552d-8cb5-4175-998e-08410f9d3e46,network=Network(00fbf9c7-31b8-44b1-aa74-4cde83cf6e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe85552d-8c') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "4a39f479-265c-49c3-86c4-a65fff2f06c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.187s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe85552d-8c, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:44:17 user nova-compute[73091]: INFO os_vif [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:42:ba,bridge_name='br-int',has_traffic_filtering=True,id=fe85552d-8cb5-4175-998e-08410f9d3e46,network=Network(00fbf9c7-31b8-44b1-aa74-4cde83cf6e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe85552d-8c')
Aug 09 16:44:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Deleting instance files /opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874_del
Aug 09 16:44:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Deletion of /opt/stack/data/nova/instances/91d979ce-00bf-4a15-841c-b6b66092c874_del complete
Aug 09 16:44:17 user nova-compute[73091]: INFO nova.compute.manager [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-cbce53fd-6b16-446f-85ec-e95b99c41b61 req-ed45b347-cc8e-4234-94fa-25c3c17ba15b service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Received event network-vif-unplugged-c79746b9-c9d0-4f25-8934-f7f10a46f558 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cbce53fd-6b16-446f-85ec-e95b99c41b61 req-ed45b347-cc8e-4234-94fa-25c3c17ba15b service nova] Acquiring lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cbce53fd-6b16-446f-85ec-e95b99c41b61 req-ed45b347-cc8e-4234-94fa-25c3c17ba15b service nova] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cbce53fd-6b16-446f-85ec-e95b99c41b61 req-ed45b347-cc8e-4234-94fa-25c3c17ba15b service nova] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-cbce53fd-6b16-446f-85ec-e95b99c41b61 req-ed45b347-cc8e-4234-94fa-25c3c17ba15b service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] No waiting events found dispatching network-vif-unplugged-c79746b9-c9d0-4f25-8934-f7f10a46f558 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-cbce53fd-6b16-446f-85ec-e95b99c41b61 req-ed45b347-cc8e-4234-94fa-25c3c17ba15b service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Received event network-vif-unplugged-c79746b9-c9d0-4f25-8934-f7f10a46f558 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "4a39f479-265c-49c3-86c4-a65fff2f06c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "4a39f479-265c-49c3-86c4-a65fff2f06c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:17 user nova-compute[73091]: INFO nova.compute.manager [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Attaching volume 46c3402f-6cde-4711-9d83-db9c02483659 to /dev/vdb
Aug 09 16:44:17 user nova-compute[73091]: DEBUG os_brick.utils [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e6fad8-9b3a-461d-8619-476dd4a2685f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff35933e-ee27-4ea3-bf0a-608908cf1f40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:18 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Instance destroyed successfully.
Aug 09 16:44:18 user nova-compute[73091]: DEBUG nova.objects.instance [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lazy-loading 'resources' on Instance uuid 93e10fd4-8841-4043-b4e2-7489c4dea3e6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b65aa6-7ec8-4e86-8cf6-e0aa013b20c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[689ae6ab-1f7c-421c-9600-f77df5ec6bc2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-29133387',display_name='tempest-VolumesAdminNegativeTest-server-29133387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-29133387',id=16,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKp7KCeVFBZ6U0TsbVZzBp5sTrmJyGHDpI4aaRqPmXJhjLq3SF5k/pVG4rh5vnDs786ns7g7hLBIlwMPe2IJ3RqSWbZFoYY+MwBuSt5T+DBiPugCnn6df1DKp3oWRKoWpQ==',key_name='tempest-keypair-1517575998',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:38:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='22c72c5d15254ac2bf4348b99858f839',ramdisk_id='',reservation_id='r-ybfowc7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1174699978',owner_user_name='tempest-VolumesAdminNegativeTest-1174699978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='992b965912454b79b9d70db85c232bc0',uuid=93e10fd4-8841-4043-b4e2-7489c4dea3e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "address": "fa:16:3e:0b:7a:ff", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79746b9-c9", "ovs_interfaceid": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Converting VIF {"id": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "address": "fa:16:3e:0b:7a:ff", "network": {"id": "4279c047-a328-4c4c-aff6-667871ec03e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-61340416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c72c5d15254ac2bf4348b99858f839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79746b9-c9", "ovs_interfaceid": "c79746b9-c9d0-4f25-8934-f7f10a46f558", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:7a:ff,bridge_name='br-int',has_traffic_filtering=True,id=c79746b9-c9d0-4f25-8934-f7f10a46f558,network=Network(4279c047-a328-4c4c-aff6-667871ec03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79746b9-c9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG os_vif [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:7a:ff,bridge_name='br-int',has_traffic_filtering=True,id=c79746b9-c9d0-4f25-8934-f7f10a46f558,network=Network(4279c047-a328-4c4c-aff6-667871ec03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79746b9-c9') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc79746b9-c9, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:44:18 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3c476d-77a4-4d95-8795-a46f6e0cb692]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG os_brick.utils [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] <== get_connector_properties: return (281ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Updating existing volume attachment record: 10455470-d1fa-4d96-bbe8-2d002c1a87dc {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:44:18 user nova-compute[73091]: INFO os_vif [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:7a:ff,bridge_name='br-int',has_traffic_filtering=True,id=c79746b9-c9d0-4f25-8934-f7f10a46f558,network=Network(4279c047-a328-4c4c-aff6-667871ec03e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79746b9-c9')
Aug 09 16:44:18 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Deleting instance files /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6_del
Aug 09 16:44:18 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Deletion of /opt/stack/data/nova/instances/93e10fd4-8841-4043-b4e2-7489c4dea3e6_del complete
Aug 09 16:44:18 user nova-compute[73091]: INFO nova.compute.manager [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:44:18 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Took 1.10 seconds to deallocate network for instance.
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-bd8a547c-21a8-434a-a32c-7bbb3c580c0e req-72556956-96f1-4f1c-970e-3517907c25a3 service nova] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Received event network-vif-plugged-fe85552d-8cb5-4175-998e-08410f9d3e46 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bd8a547c-21a8-434a-a32c-7bbb3c580c0e req-72556956-96f1-4f1c-970e-3517907c25a3 service nova] Acquiring lock "91d979ce-00bf-4a15-841c-b6b66092c874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bd8a547c-21a8-434a-a32c-7bbb3c580c0e req-72556956-96f1-4f1c-970e-3517907c25a3 service nova] Lock "91d979ce-00bf-4a15-841c-b6b66092c874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bd8a547c-21a8-434a-a32c-7bbb3c580c0e req-72556956-96f1-4f1c-970e-3517907c25a3 service nova] Lock "91d979ce-00bf-4a15-841c-b6b66092c874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-bd8a547c-21a8-434a-a32c-7bbb3c580c0e req-72556956-96f1-4f1c-970e-3517907c25a3 service nova] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] No waiting events found dispatching network-vif-plugged-fe85552d-8cb5-4175-998e-08410f9d3e46 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:44:19 user nova-compute[73091]: WARNING nova.compute.manager [req-bd8a547c-21a8-434a-a32c-7bbb3c580c0e req-72556956-96f1-4f1c-970e-3517907c25a3 service nova] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Received unexpected event network-vif-plugged-fe85552d-8cb5-4175-998e-08410f9d3e46 for instance with vm_state deleted and task_state None.
Aug 09 16:44:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.658s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:19 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Deleted allocations for instance 91d979ce-00bf-4a15-841c-b6b66092c874
Aug 09 16:44:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-98844d8d-e746-45e5-bca9-fdaf99debe34 tempest-VolumesNegativeTest-1280249766 tempest-VolumesNegativeTest-1280249766-project-member] Lock "91d979ce-00bf-4a15-841c-b6b66092c874" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.231s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-a64acc3a-2b9e-4df9-85ef-41afdc69d168 req-f3b2516b-1d8e-44ad-9106-13963346e5a7 service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Received event network-vif-plugged-c79746b9-c9d0-4f25-8934-f7f10a46f558 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a64acc3a-2b9e-4df9-85ef-41afdc69d168 req-f3b2516b-1d8e-44ad-9106-13963346e5a7 service nova] Acquiring lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a64acc3a-2b9e-4df9-85ef-41afdc69d168 req-f3b2516b-1d8e-44ad-9106-13963346e5a7 service nova] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a64acc3a-2b9e-4df9-85ef-41afdc69d168 req-f3b2516b-1d8e-44ad-9106-13963346e5a7 service nova] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-a64acc3a-2b9e-4df9-85ef-41afdc69d168 req-f3b2516b-1d8e-44ad-9106-13963346e5a7 service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] No waiting events found dispatching network-vif-plugged-c79746b9-c9d0-4f25-8934-f7f10a46f558 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:44:19 user nova-compute[73091]: WARNING nova.compute.manager [req-a64acc3a-2b9e-4df9-85ef-41afdc69d168 req-f3b2516b-1d8e-44ad-9106-13963346e5a7 service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Received unexpected event network-vif-plugged-c79746b9-c9d0-4f25-8934-f7f10a46f558 for instance with vm_state active and task_state deleting.
Aug 09 16:44:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-a64acc3a-2b9e-4df9-85ef-41afdc69d168 req-f3b2516b-1d8e-44ad-9106-13963346e5a7 service nova] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Received event network-vif-deleted-fe85552d-8cb5-4175-998e-08410f9d3e46 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-a64acc3a-2b9e-4df9-85ef-41afdc69d168 req-f3b2516b-1d8e-44ad-9106-13963346e5a7 service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Received event network-vif-deleted-c79746b9-c9d0-4f25-8934-f7f10a46f558 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:19 user nova-compute[73091]: INFO nova.compute.manager [req-a64acc3a-2b9e-4df9-85ef-41afdc69d168 req-f3b2516b-1d8e-44ad-9106-13963346e5a7 service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Neutron deleted interface c79746b9-c9d0-4f25-8934-f7f10a46f558; detaching it from the instance and deleting it from the info cache
Aug 09 16:44:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-a64acc3a-2b9e-4df9-85ef-41afdc69d168 req-f3b2516b-1d8e-44ad-9106-13963346e5a7 service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:44:19 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Took 1.39 seconds to deallocate network for instance.
Aug 09 16:44:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-a64acc3a-2b9e-4df9-85ef-41afdc69d168 req-f3b2516b-1d8e-44ad-9106-13963346e5a7 service nova] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Detach interface failed, port_id=c79746b9-c9d0-4f25-8934-f7f10a46f558, reason: Instance 93e10fd4-8841-4043-b4e2-7489c4dea3e6 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:20 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:44:20 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:44:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7465MB free_disk=25.11572265625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:44:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:20 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:44:20 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:44:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.844s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.237s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:20 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Deleted allocations for instance 93e10fd4-8841-4043-b4e2-7489c4dea3e6
Aug 09 16:44:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:44:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 38051bca-7190-4dff-91d1-3d99b4e4182b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:44:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f939fe27-017a-481e-babc-147bf98e0132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:44:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8fc884a8-24bb-488a-baeb-ef2b1faf239d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:44:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f8f52e24-8ce5-4128-a2aa-afc68ceb7213 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:44:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 68d63bc2-d726-49d8-91de-bc5cc66bb119 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:44:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 148cb211-b2f6-4782-8f35-e66a55cc95bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:44:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 4a39f479-265c-49c3-86c4-a65fff2f06c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:44:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:44:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:44:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-994cdba6-7f58-43a0-b193-83d4b00613af tempest-VolumesAdminNegativeTest-1174699978 tempest-VolumesAdminNegativeTest-1174699978-project-member] Lock "93e10fd4-8841-4043-b4e2-7489c4dea3e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.622s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:21 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:44:21 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:44:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:44:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:44:25 user nova-compute[73091]: INFO nova.compute.claims [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Claim successful on node user
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:44:25 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.policy [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69ccebf0e9d54502a2318c809ce11369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d3dfd232d54594808dad271baa5192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:44:25 user nova-compute[73091]: INFO nova.virt.block_device [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Booting with volume snapshot e7faef16-12c9-4b2c-a61b-c0cb4513670c at /dev/vda
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Starting finish_revert_migration {{(pid=73091) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Start _get_guest_xml network_info=[{"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '412fb20c-8920-4236-bfb3-25ba1c24dac9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfUAobeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '68d63bc2-d726-49d8-91de-bc5cc66bb119', 'attached_at': '2023-08-09T16:44:26.000000', 'detached_at': '', 'volume_id': '9c698f00-64a1-4d7f-bad5-2d74153a7012', 'serial': '9c698f00-64a1-4d7f-bad5-2d74153a7012'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:44:25 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:44:25 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lazy-loading 'vcpu_model' on Instance uuid 68d63bc2-d726-49d8-91de-bc5cc66bb119 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfUAobeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:44:25 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:44:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:44:25 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:44:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:44:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:44:25 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:44:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b6d571-d93d-46f7-bce6-811ad69a2242]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:44:26 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[da54e8b2-29f8-4a3c-8e2b-4dd5e2850e37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012] added
Aug 09 16:44:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[592af4cb-3d3c-46ee-989f-79c1f4f19168]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87ad3ec-751f-48b8-b221-5fbde146341c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfUAobeV {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfUAobeV" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a7c6d5-f958-4a1a-b427-55a25d3cc42f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HfUAobeV'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[239bd429-ce94-4e42-bce4-a753256acb24]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[66376312-22a0-464f-a455-75ae615b94f0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:44:26 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:44:26 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:44:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:44:26 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:44:26 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:44:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[28faaf6c-d670-4a07-83bd-ae4845b0fefa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260]
Aug 09 16:44:26 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260] successful.
Aug 09 16:44:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.169s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[062252dc-244c-4019-93d8-3feefbef0add]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abab4c9-39ec-46f5-8735-c95ff21c2404]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:44:26 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:44:26 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:44:26 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:44:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:44:26 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:44:26 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:44:26 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:44:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.454s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[015b26c9-3904-4c55-bccc-48c7b2320814]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfUAobeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:44:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Successfully created port: 3d66a718-971e-4e64-80f3-d57b2b6364dc {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599452.2915144, 68d63bc2-d726-49d8-91de-bc5cc66bb119 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:44:27 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] VM Stopped (Lifecycle Event)
Aug 09 16:44:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8165419a-dfb8-4307-9e45-da9c2d598ae8 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Successfully updated port: 3d66a718-971e-4e64-80f3-d57b2b6364dc {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "refresh_cache-da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquired lock "refresh_cache-da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-eb27a5e6-4e8b-4f8f-8b23-3ecae02ce8b7 req-18953d9b-5597-45a1-a939-5641e3e940f2 service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Received event network-changed-3d66a718-971e-4e64-80f3-d57b2b6364dc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-eb27a5e6-4e8b-4f8f-8b23-3ecae02ce8b7 req-18953d9b-5597-45a1-a939-5641e3e940f2 service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Refreshing instance network info cache due to event network-changed-3d66a718-971e-4e64-80f3-d57b2b6364dc. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eb27a5e6-4e8b-4f8f-8b23-3ecae02ce8b7 req-18953d9b-5597-45a1-a939-5641e3e940f2 service nova] Acquiring lock "refresh_cache-da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.486s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] <== connect_volume: return (1487ms) {'type': 'block', 'scsi_wwn': '23334353635636464', 'path': '/dev/sdd'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334353635636464', 'path': '/dev/sdd'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1756856509',display_name='tempest-ServerActionsTestOtherB-server-1756856509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1756856509',id=15,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX4A4WBbci8tvlyfsVn8RtvZ67v0qxFwI098O4ybt1xkpAJgwLMitJ+vOXZXn9ziILn0Dux9cadl75sAIWbob/GvRq9Jin537WzoAVu2MvbyterRxvGm1tqvtVxJqTjrw==',key_name='tempest-keypair-561558216',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:42:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='329738ae9226414383acb6dcbd09dea0',ramdisk_id='',reservation_id='r-r2gg9o0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1665559429',owner_user_name='tempest-ServerActionsTestOtherB-1665559429-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:44:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a90a17815b46b8a64be7510ac5ba49',uuid=68d63bc2-d726-49d8-91de-bc5cc66bb119,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Converting VIF {"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:44:27 user nova-compute[73091]:   <uuid>68d63bc2-d726-49d8-91de-bc5cc66bb119</uuid>
Aug 09 16:44:27 user nova-compute[73091]:   <name>instance-0000000f</name>
Aug 09 16:44:27 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:44:27 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:44:27 user nova-compute[73091]:   <metadata>
Aug 09 16:44:27 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:44:27 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:44:27 user nova-compute[73091]:       <nova:name>tempest-ServerActionsTestOtherB-server-1756856509</nova:name>
Aug 09 16:44:27 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:44:25</nova:creationTime>
Aug 09 16:44:27 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:44:27 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:44:27 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:44:27 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:44:27 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:44:27 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:44:27 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:44:27 user nova-compute[73091]:       <nova:owner>
Aug 09 16:44:27 user nova-compute[73091]:         <nova:user uuid="77a90a17815b46b8a64be7510ac5ba49">tempest-ServerActionsTestOtherB-1665559429-project-member</nova:user>
Aug 09 16:44:27 user nova-compute[73091]:         <nova:project uuid="329738ae9226414383acb6dcbd09dea0">tempest-ServerActionsTestOtherB-1665559429</nova:project>
Aug 09 16:44:27 user nova-compute[73091]:       </nova:owner>
Aug 09 16:44:27 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:44:27 user nova-compute[73091]:       <nova:ports>
Aug 09 16:44:27 user nova-compute[73091]:         <nova:port uuid="93d41bee-7cab-45a7-b409-dd19fc3b88b6">
Aug 09 16:44:27 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 16:44:27 user nova-compute[73091]:         </nova:port>
Aug 09 16:44:27 user nova-compute[73091]:       </nova:ports>
Aug 09 16:44:27 user nova-compute[73091]:     </nova:instance>
Aug 09 16:44:27 user nova-compute[73091]:   </metadata>
Aug 09 16:44:27 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:44:27 user nova-compute[73091]:     <system>
Aug 09 16:44:27 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:44:27 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:44:27 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:44:27 user nova-compute[73091]:       <entry name="serial">68d63bc2-d726-49d8-91de-bc5cc66bb119</entry>
Aug 09 16:44:27 user nova-compute[73091]:       <entry name="uuid">68d63bc2-d726-49d8-91de-bc5cc66bb119</entry>
Aug 09 16:44:27 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:44:27 user nova-compute[73091]:     </system>
Aug 09 16:44:27 user nova-compute[73091]:   </sysinfo>
Aug 09 16:44:27 user nova-compute[73091]:   <os>
Aug 09 16:44:27 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:44:27 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:44:27 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:44:27 user nova-compute[73091]:   </os>
Aug 09 16:44:27 user nova-compute[73091]:   <features>
Aug 09 16:44:27 user nova-compute[73091]:     <acpi/>
Aug 09 16:44:27 user nova-compute[73091]:     <apic/>
Aug 09 16:44:27 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:44:27 user nova-compute[73091]:   </features>
Aug 09 16:44:27 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:44:27 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:44:27 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:44:27 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:44:27 user nova-compute[73091]:   </clock>
Aug 09 16:44:27 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:44:27 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:44:27 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:44:27 user nova-compute[73091]:   </cpu>
Aug 09 16:44:27 user nova-compute[73091]:   <devices>
Aug 09 16:44:27 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:44:27 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:44:27 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk"/>
Aug 09 16:44:27 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:44:27 user nova-compute[73091]:     </disk>
Aug 09 16:44:27 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:44:27 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:44:27 user nova-compute[73091]:       <source dev="/dev/sdd"/>
Aug 09 16:44:27 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 09 16:44:27 user nova-compute[73091]:       <serial>9c698f00-64a1-4d7f-bad5-2d74153a7012</serial>
Aug 09 16:44:27 user nova-compute[73091]:     </disk>
Aug 09 16:44:27 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:44:27 user nova-compute[73091]:       <mac address="fa:16:3e:3c:81:07"/>
Aug 09 16:44:27 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:44:27 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:44:27 user nova-compute[73091]:       <target dev="tap93d41bee-7c"/>
Aug 09 16:44:27 user nova-compute[73091]:     </interface>
Aug 09 16:44:27 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:44:27 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/console.log" append="off"/>
Aug 09 16:44:27 user nova-compute[73091]:     </serial>
Aug 09 16:44:27 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:44:27 user nova-compute[73091]:     <video>
Aug 09 16:44:27 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:44:27 user nova-compute[73091]:     </video>
Aug 09 16:44:27 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:44:27 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:44:27 user nova-compute[73091]:     </rng>
Aug 09 16:44:27 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:44:27 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:44:27 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:44:27 user nova-compute[73091]:     </memballoon>
Aug 09 16:44:27 user nova-compute[73091]:   </devices>
Aug 09 16:44:27 user nova-compute[73091]: </domain>
Aug 09 16:44:27 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1756856509',display_name='tempest-ServerActionsTestOtherB-server-1756856509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1756856509',id=15,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX4A4WBbci8tvlyfsVn8RtvZ67v0qxFwI098O4ybt1xkpAJgwLMitJ+vOXZXn9ziILn0Dux9cadl75sAIWbob/GvRq9Jin537WzoAVu2MvbyterRxvGm1tqvtVxJqTjrw==',key_name='tempest-keypair-561558216',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:42:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='329738ae9226414383acb6dcbd09dea0',ramdisk_id='',reservation_id='r-r2gg9o0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1665559429',owner_user_name='tempest-ServerActionsTestOtherB-1665559429-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:44:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a90a17815b46b8a64be7510ac5ba49',uuid=68d63bc2-d726-49d8-91de-bc5cc66bb119,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Converting VIF {"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG os_vif [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93d41bee-7c, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap93d41bee-7c, col_values=(('external_ids', {'iface-id': '93d41bee-7cab-45a7-b409-dd19fc3b88b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:81:07', 'vm-uuid': '68d63bc2-d726-49d8-91de-bc5cc66bb119'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:27 user nova-compute[73091]: INFO os_vif [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c')
Aug 09 16:44:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Updating instance_info_cache with network_info: [{"id": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "address": "fa:16:3e:b5:27:09", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66a718-97", "ovs_interfaceid": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Releasing lock "refresh_cache-da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Instance network_info: |[{"id": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "address": "fa:16:3e:b5:27:09", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66a718-97", "ovs_interfaceid": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eb27a5e6-4e8b-4f8f-8b23-3ecae02ce8b7 req-18953d9b-5597-45a1-a939-5641e3e940f2 service nova] Acquired lock "refresh_cache-da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:44:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-eb27a5e6-4e8b-4f8f-8b23-3ecae02ce8b7 req-18953d9b-5597-45a1-a939-5641e3e940f2 service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Refreshing network info cache for port 3d66a718-971e-4e64-80f3-d57b2b6364dc {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:44:28 user nova-compute[73091]: DEBUG nova.network.neutron [req-eb27a5e6-4e8b-4f8f-8b23-3ecae02ce8b7 req-18953d9b-5597-45a1-a939-5641e3e940f2 service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Updated VIF entry in instance network info cache for port 3d66a718-971e-4e64-80f3-d57b2b6364dc. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:44:28 user nova-compute[73091]: DEBUG nova.network.neutron [req-eb27a5e6-4e8b-4f8f-8b23-3ecae02ce8b7 req-18953d9b-5597-45a1-a939-5641e3e940f2 service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Updating instance_info_cache with network_info: [{"id": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "address": "fa:16:3e:b5:27:09", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66a718-97", "ovs_interfaceid": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:44:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-eb27a5e6-4e8b-4f8f-8b23-3ecae02ce8b7 req-18953d9b-5597-45a1-a939-5641e3e940f2 service nova] Releasing lock "refresh_cache-da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:44:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc285c29-8d9a-4714-b11b-ed75974112cc req-262bc110-0cbb-4d1d-ae9c-a3883f7e193a service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received event network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc285c29-8d9a-4714-b11b-ed75974112cc req-262bc110-0cbb-4d1d-ae9c-a3883f7e193a service nova] Acquiring lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc285c29-8d9a-4714-b11b-ed75974112cc req-262bc110-0cbb-4d1d-ae9c-a3883f7e193a service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc285c29-8d9a-4714-b11b-ed75974112cc req-262bc110-0cbb-4d1d-ae9c-a3883f7e193a service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc285c29-8d9a-4714-b11b-ed75974112cc req-262bc110-0cbb-4d1d-ae9c-a3883f7e193a service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] No waiting events found dispatching network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:44:29 user nova-compute[73091]: WARNING nova.compute.manager [req-cc285c29-8d9a-4714-b11b-ed75974112cc req-262bc110-0cbb-4d1d-ae9c-a3883f7e193a service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received unexpected event network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 for instance with vm_state resized and task_state resize_reverting.
Aug 09 16:44:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:31 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599471.1475813, 68d63bc2-d726-49d8-91de-bc5cc66bb119 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:44:31 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] VM Resumed (Lifecycle Event)
Aug 09 16:44:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:44:31 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Instance running successfully.
Aug 09 16:44:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] finish_revert_migration finished successfully. {{(pid=73091) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 09 16:44:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:44:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:44:31 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 09 16:44:31 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599471.1487749, 68d63bc2-d726-49d8-91de-bc5cc66bb119 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:44:31 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] VM Started (Lifecycle Event)
Aug 09 16:44:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:44:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:44:31 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 09 16:44:31 user nova-compute[73091]: INFO nova.compute.manager [None req-4d01e2db-e49d-4317-8a7a-3afec33fa1dd tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Updating instance to original state: 'active'
Aug 09 16:44:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-4befb216-6cd6-476e-a1bb-9503d990472e req-e73a6801-edcb-41b2-9cb5-f5e23996a84d service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received event network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4befb216-6cd6-476e-a1bb-9503d990472e req-e73a6801-edcb-41b2-9cb5-f5e23996a84d service nova] Acquiring lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4befb216-6cd6-476e-a1bb-9503d990472e req-e73a6801-edcb-41b2-9cb5-f5e23996a84d service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4befb216-6cd6-476e-a1bb-9503d990472e req-e73a6801-edcb-41b2-9cb5-f5e23996a84d service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-4befb216-6cd6-476e-a1bb-9503d990472e req-e73a6801-edcb-41b2-9cb5-f5e23996a84d service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] No waiting events found dispatching network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:44:31 user nova-compute[73091]: WARNING nova.compute.manager [req-4befb216-6cd6-476e-a1bb-9503d990472e req-e73a6801-edcb-41b2-9cb5-f5e23996a84d service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received unexpected event network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 for instance with vm_state active and task_state None.
Aug 09 16:44:32 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599457.3812113, 91d979ce-00bf-4a15-841c-b6b66092c874 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:44:32 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] VM Stopped (Lifecycle Event)
Aug 09 16:44:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-10387cb6-486f-465d-b711-dfc31f422cb2 None None] [instance: 91d979ce-00bf-4a15-841c-b6b66092c874] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrwAselG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:44:32 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:44:32 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:44:32 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15835a5-80e4-45bb-81df-dfa7a126b100]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:44:32 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11ab11a-b8b7-4652-b0d8-16f054c779d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659] added
Aug 09 16:44:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0819a9fa-1fe7-4c7e-a1af-7a158cdad2ed]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4c881e-0079-4d69-aa41-2ec1b98129d8]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QrwAselG {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QrwAselG" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca78f17-99bd-423a-a23d-b6d6f51ba5fc]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QrwAselG'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d181886b-881f-407d-b573-4d71c61c72f0]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d801f9d7-e3bf-4108-a953-97618d38c7df]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:44:32 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:44:32 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:44:32 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:44:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:44:32 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:44:32 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:44:32 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:44:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4166f67-e220-482a-aebe-6f9eae1db15f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659, portal: 172.16.0.220,3260]
Aug 09 16:44:32 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659, portal: 172.16.0.220,3260] successful.
Aug 09 16:44:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee74bbb-4079-4015-96bb-056da659c3da]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd06abf-8d53-44bd-85af-e32d79a11c95]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:44:32 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:44:32 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:44:32 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:44:32 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:44:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:44:32 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:44:32 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:44:32 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:44:32 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:44:32 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4780832f-4e45-4371-9572-8354e7413f35]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:32 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:44:33 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599458.101855, 93e10fd4-8841-4043-b4e2-7489c4dea3e6 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:44:33 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] VM Stopped (Lifecycle Event)
Aug 09 16:44:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-478fcb23-f142-496d-b0ef-2887c6f8215a None None] [instance: 93e10fd4-8841-4043-b4e2-7489c4dea3e6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:44:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:44:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrwAselG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:44:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:44:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23162363039336636', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:44:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162363039336636', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:44:33 user nova-compute[73091]: DEBUG nova.objects.instance [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'flavor' on Instance uuid 4a39f479-265c-49c3-86c4-a65fff2f06c4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:44:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:44:33 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:44:33 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 09 16:44:33 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:44:33 user nova-compute[73091]:   <serial>46c3402f-6cde-4711-9d83-db9c02483659</serial>
Aug 09 16:44:33 user nova-compute[73091]: </disk>
Aug 09 16:44:33 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:44:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:44:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:44:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] No VIF found with MAC fa:16:3e:89:17:f3, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:44:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-36f6c30f-8a06-4f69-8602-871521a5d739 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "4a39f479-265c-49c3-86c4-a65fff2f06c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.632s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "e03ff609-e74d-427d-b6e6-109fbee09e40" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:34 user nova-compute[73091]: INFO nova.compute.manager [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Unshelving
Aug 09 16:44:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:34 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'pci_requests' on Instance uuid e03ff609-e74d-427d-b6e6-109fbee09e40 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:44:34 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'numa_topology' on Instance uuid e03ff609-e74d-427d-b6e6-109fbee09e40 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:44:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:44:34 user nova-compute[73091]: INFO nova.compute.claims [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Claim successful on node user
Aug 09 16:44:35 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:44:35 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:44:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:35 user nova-compute[73091]: INFO nova.network.neutron [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Updating port 78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG os_brick.utils [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[14179f34-52ec-4d4b-9501-4135ef387fa1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquired lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf4030b-97d2-437c-8ee5-9b9263b05c53]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-ace9ee26-214d-440c-8e48-c8adbf7a92b3 req-9ce6dd17-15f5-4acc-a875-a4d73fc68c16 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received event network-changed-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-ace9ee26-214d-440c-8e48-c8adbf7a92b3 req-9ce6dd17-15f5-4acc-a875-a4d73fc68c16 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Refreshing instance network info cache due to event network-changed-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ace9ee26-214d-440c-8e48-c8adbf7a92b3 req-9ce6dd17-15f5-4acc-a875-a4d73fc68c16 service nova] Acquiring lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8de0aa-6430-45ad-9b91-33226dba668e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[92925137-2f84-4bdc-978a-aa1a0da49599]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:44:36 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:44:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[733c6983-9cd8-412c-8e5b-487e332526c8]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG os_brick.utils [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:44:36 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Updating existing volume attachment record: 4831c090-a54e-459d-b4b5-6c9611d48f94 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:44:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Updating instance_info_cache with network_info: [{"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:44:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Releasing lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:44:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:44:37 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Creating image(s)
Aug 09 16:44:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "/opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "/opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "/opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:37 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'trusted_certs' on Instance uuid e03ff609-e74d-427d-b6e6-109fbee09e40 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:44:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ace9ee26-214d-440c-8e48-c8adbf7a92b3 req-9ce6dd17-15f5-4acc-a875-a4d73fc68c16 service nova] Acquired lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:44:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-ace9ee26-214d-440c-8e48-c8adbf7a92b3 req-9ce6dd17-15f5-4acc-a875-a4d73fc68c16 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Refreshing network info cache for port 78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:44:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "cd2d22fca9434725101f3d9f0668ad03a2243dd8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "cd2d22fca9434725101f3d9f0668ad03a2243dd8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd2d22fca9434725101f3d9f0668ad03a2243dd8.part --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "f81e99b2-580f-43fa-b74d-84ad7764b64f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "f81e99b2-580f-43fa-b74d-84ad7764b64f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:44:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd2d22fca9434725101f3d9f0668ad03a2243dd8.part --force-share --output=json" returned: 0 in 0.167s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:38 user nova-compute[73091]: DEBUG nova.virt.images [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] e5cd35ca-72cb-4006-b1f0-36e1c553f01d was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 16:44:38 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 16:44:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cd2d22fca9434725101f3d9f0668ad03a2243dd8.part /opt/stack/data/nova/instances/_base/cd2d22fca9434725101f3d9f0668ad03a2243dd8.converted {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:44:38 user nova-compute[73091]: INFO nova.compute.claims [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Claim successful on node user
Aug 09 16:44:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-ace9ee26-214d-440c-8e48-c8adbf7a92b3 req-9ce6dd17-15f5-4acc-a875-a4d73fc68c16 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Updated VIF entry in instance network info cache for port 78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-ace9ee26-214d-440c-8e48-c8adbf7a92b3 req-9ce6dd17-15f5-4acc-a875-a4d73fc68c16 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Updating instance_info_cache with network_info: [{"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ace9ee26-214d-440c-8e48-c8adbf7a92b3 req-9ce6dd17-15f5-4acc-a875-a4d73fc68c16 service nova] Releasing lock "refresh_cache-e03ff609-e74d-427d-b6e6-109fbee09e40" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cd2d22fca9434725101f3d9f0668ad03a2243dd8.part /opt/stack/data/nova/instances/_base/cd2d22fca9434725101f3d9f0668ad03a2243dd8.converted" returned: 0 in 0.550s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd2d22fca9434725101f3d9f0668ad03a2243dd8.converted --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd2d22fca9434725101f3d9f0668ad03a2243dd8.converted --force-share --output=json" returned: 0 in 0.150s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "cd2d22fca9434725101f3d9f0668ad03a2243dd8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.277s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd2d22fca9434725101f3d9f0668ad03a2243dd8 --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd2d22fca9434725101f3d9f0668ad03a2243dd8 --force-share --output=json" returned: 0 in 0.232s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "cd2d22fca9434725101f3d9f0668ad03a2243dd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "cd2d22fca9434725101f3d9f0668ad03a2243dd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd2d22fca9434725101f3d9f0668ad03a2243dd8 --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.925s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:44:39 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:44:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd2d22fca9434725101f3d9f0668ad03a2243dd8 --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd2d22fca9434725101f3d9f0668ad03a2243dd8,backing_fmt=raw /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd2d22fca9434725101f3d9f0668ad03a2243dd8,backing_fmt=raw /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk 1073741824" returned: 0 in 0.066s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "cd2d22fca9434725101f3d9f0668ad03a2243dd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd2d22fca9434725101f3d9f0668ad03a2243dd8 --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:39 user nova-compute[73091]: DEBUG nova.policy [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a5c393d644c4c3f8e9cbb0805ba7c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f2275630ce4d55bf02851df830b6bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:44:40 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Creating image(s)
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "/opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "/opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "/opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd2d22fca9434725101f3d9f0668ad03a2243dd8 --force-share --output=json" returned: 0 in 0.205s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'migration_context' on Instance uuid e03ff609-e74d-427d-b6e6-109fbee09e40 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:44:40 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Rebasing disk image.
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.230s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff -F raw /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.203s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f/disk 1073741824" returned: 0 in 0.107s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.169s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Cannot resize image /opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG nova.objects.instance [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'migration_context' on Instance uuid f81e99b2-580f-43fa-b74d-84ad7764b64f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Ensure instance console log exists: /opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:41 user nova-compute[73091]: DEBUG nova.network.neutron [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Successfully created port: af939b86-9ea1-46d6-8d42-e6171ca189c5 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:44:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "38051bca-7190-4dff-91d1-3d99b4e4182b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:42 user nova-compute[73091]: INFO nova.compute.manager [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Detaching volume 2983f6b5-0deb-4c7a-8be7-4126c3b4975c
Aug 09 16:44:42 user nova-compute[73091]: INFO nova.virt.block_device [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Attempting to driver detach volume 2983f6b5-0deb-4c7a-8be7-4126c3b4975c from mountpoint /dev/vdb
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Attempting to detach device vdb from instance 38051bca-7190-4dff-91d1-3d99b4e4182b from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:44:42 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:44:42 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 16:44:42 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:44:42 user nova-compute[73091]:   <serial>2983f6b5-0deb-4c7a-8be7-4126c3b4975c</serial>
Aug 09 16:44:42 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:44:42 user nova-compute[73091]: </disk>
Aug 09 16:44:42 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:44:42 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Successfully detached device vdb from instance 38051bca-7190-4dff-91d1-3d99b4e4182b from the persistent domain config.
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 38051bca-7190-4dff-91d1-3d99b4e4182b from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:44:42 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:44:42 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 16:44:42 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:44:42 user nova-compute[73091]:   <serial>2983f6b5-0deb-4c7a-8be7-4126c3b4975c</serial>
Aug 09 16:44:42 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:44:42 user nova-compute[73091]: </disk>
Aug 09 16:44:42 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Successfully updated port: af939b86-9ea1-46d6-8d42-e6171ca189c5 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "refresh_cache-f81e99b2-580f-43fa-b74d-84ad7764b64f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquired lock "refresh_cache-f81e99b2-580f-43fa-b74d-84ad7764b64f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-1769ca68-9b05-4939-bda7-2152d83f9165 req-2755842c-ca38-42ee-b6bc-92aa84a7dbc7 service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Received event network-changed-af939b86-9ea1-46d6-8d42-e6171ca189c5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-1769ca68-9b05-4939-bda7-2152d83f9165 req-2755842c-ca38-42ee-b6bc-92aa84a7dbc7 service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Refreshing instance network info cache due to event network-changed-af939b86-9ea1-46d6-8d42-e6171ca189c5. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1769ca68-9b05-4939-bda7-2152d83f9165 req-2755842c-ca38-42ee-b6bc-92aa84a7dbc7 service nova] Acquiring lock "refresh_cache-f81e99b2-580f-43fa-b74d-84ad7764b64f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691599482.6617582, 38051bca-7190-4dff-91d1-3d99b4e4182b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 38051bca-7190-4dff-91d1-3d99b4e4182b {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:44:42 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Successfully detached device vdb from instance 38051bca-7190-4dff-91d1-3d99b4e4182b from the live domain config.
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wUVIiPtC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:44:42 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:44:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff -F raw /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk" returned: 0 in 2.328s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Ensure instance console log exists: /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Start _get_guest_xml network_info=[{"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c09bdc246ebda7ad6684c252d9c69c14',container_format='bare',created_at=2023-08-09T16:42:42Z,direct_url=<?>,disk_format='qcow2',id=e5cd35ca-72cb-4006-b1f0-36e1c553f01d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-631186991-shelved',owner='b8000a47d82748ce8d43d306682d62c6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T16:42:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c8c604-4715-45a7-8fe7-e75b64cbb2c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:42 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:44:42 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c09bdc246ebda7ad6684c252d9c69c14',container_format='bare',created_at=2023-08-09T16:42:42Z,direct_url=<?>,disk_format='qcow2',id=e5cd35ca-72cb-4006-b1f0-36e1c553f01d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-631186991-shelved',owner='b8000a47d82748ce8d43d306682d62c6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T16:42:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'vcpu_model' on Instance uuid e03ff609-e74d-427d-b6e6-109fbee09e40 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccad2aa9-9797-4292-b6f1-1923cb2b8973]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:44:42 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:44:42 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:44:42 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:44:42 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:44:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c (non-flash)
Aug 09 16:44:42 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:44:42 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:44:42 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:44:42 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:44:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0801c1b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T16:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-631186991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-631186991',id=22,image_ref='e5cd35ca-72cb-4006-b1f0-36e1c553f01d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-767621827',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b8000a47d82748ce8d43d306682d62c6',ramdisk_id='',reservation_id='r-kkx3fv25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1451982310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1451982310-project-member',shelved_at='2023-08-09T16:42:46.907469',shelved_host='user',shelved_image_id='e5cd35ca-72cb-4006-b1f0-36e1c553f01d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:44:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343ec5734ef547f292ee631dbb272359',uuid=e03ff609-e74d-427d-b6e6-109fbee09e40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converting VIF {"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ea:23,bridge_name='br-int',has_traffic_filtering=True,id=78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ad4923-b2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'pci_devices' on Instance uuid e03ff609-e74d-427d-b6e6-109fbee09e40 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30a1f09-848b-414b-84df-bf379468a905]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:44:42 user nova-compute[73091]:   <uuid>e03ff609-e74d-427d-b6e6-109fbee09e40</uuid>
Aug 09 16:44:42 user nova-compute[73091]:   <name>instance-00000016</name>
Aug 09 16:44:42 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:44:42 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:44:42 user nova-compute[73091]:   <metadata>
Aug 09 16:44:42 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:44:42 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:44:42 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-631186991</nova:name>
Aug 09 16:44:42 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:44:42</nova:creationTime>
Aug 09 16:44:42 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:44:42 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:44:42 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:44:42 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:44:42 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:44:42 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:44:42 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:44:42 user nova-compute[73091]:       <nova:owner>
Aug 09 16:44:42 user nova-compute[73091]:         <nova:user uuid="343ec5734ef547f292ee631dbb272359">tempest-AttachVolumeShelveTestJSON-1451982310-project-member</nova:user>
Aug 09 16:44:42 user nova-compute[73091]:         <nova:project uuid="b8000a47d82748ce8d43d306682d62c6">tempest-AttachVolumeShelveTestJSON-1451982310</nova:project>
Aug 09 16:44:42 user nova-compute[73091]:       </nova:owner>
Aug 09 16:44:42 user nova-compute[73091]:       <nova:root type="image" uuid="e5cd35ca-72cb-4006-b1f0-36e1c553f01d"/>
Aug 09 16:44:42 user nova-compute[73091]:       <nova:ports>
Aug 09 16:44:42 user nova-compute[73091]:         <nova:port uuid="78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8">
Aug 09 16:44:42 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 16:44:42 user nova-compute[73091]:         </nova:port>
Aug 09 16:44:42 user nova-compute[73091]:       </nova:ports>
Aug 09 16:44:42 user nova-compute[73091]:     </nova:instance>
Aug 09 16:44:42 user nova-compute[73091]:   </metadata>
Aug 09 16:44:42 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:44:42 user nova-compute[73091]:     <system>
Aug 09 16:44:42 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:44:42 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:44:42 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:44:42 user nova-compute[73091]:       <entry name="serial">e03ff609-e74d-427d-b6e6-109fbee09e40</entry>
Aug 09 16:44:42 user nova-compute[73091]:       <entry name="uuid">e03ff609-e74d-427d-b6e6-109fbee09e40</entry>
Aug 09 16:44:42 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:44:42 user nova-compute[73091]:     </system>
Aug 09 16:44:42 user nova-compute[73091]:   </sysinfo>
Aug 09 16:44:42 user nova-compute[73091]:   <os>
Aug 09 16:44:42 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:44:42 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:44:42 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:44:42 user nova-compute[73091]:   </os>
Aug 09 16:44:42 user nova-compute[73091]:   <features>
Aug 09 16:44:42 user nova-compute[73091]:     <acpi/>
Aug 09 16:44:42 user nova-compute[73091]:     <apic/>
Aug 09 16:44:42 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:44:42 user nova-compute[73091]:   </features>
Aug 09 16:44:42 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:44:42 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:44:42 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:44:42 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:44:42 user nova-compute[73091]:   </clock>
Aug 09 16:44:42 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:44:42 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:44:42 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:44:42 user nova-compute[73091]:   </cpu>
Aug 09 16:44:42 user nova-compute[73091]:   <devices>
Aug 09 16:44:42 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:44:42 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:44:42 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk"/>
Aug 09 16:44:42 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:44:42 user nova-compute[73091]:     </disk>
Aug 09 16:44:42 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:44:42 user nova-compute[73091]:       <mac address="fa:16:3e:3a:ea:23"/>
Aug 09 16:44:42 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:44:42 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:44:42 user nova-compute[73091]:       <target dev="tap78ad4923-b2"/>
Aug 09 16:44:42 user nova-compute[73091]:     </interface>
Aug 09 16:44:42 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:44:42 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/console.log" append="off"/>
Aug 09 16:44:42 user nova-compute[73091]:     </serial>
Aug 09 16:44:42 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:44:42 user nova-compute[73091]:     <video>
Aug 09 16:44:42 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:44:42 user nova-compute[73091]:     </video>
Aug 09 16:44:42 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:44:42 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:44:42 user nova-compute[73091]:     </rng>
Aug 09 16:44:42 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:44:42 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:44:42 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:44:42 user nova-compute[73091]:     </memballoon>
Aug 09 16:44:42 user nova-compute[73091]:   </devices>
Aug 09 16:44:42 user nova-compute[73091]: </domain>
Aug 09 16:44:42 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T16:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-631186991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-631186991',id=22,image_ref='e5cd35ca-72cb-4006-b1f0-36e1c553f01d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-767621827',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b8000a47d82748ce8d43d306682d62c6',ramdisk_id='',reservation_id='r-kkx3fv25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1451982310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1451982310-project-member',shelved_at='2023-08-09T16:42:46.907469',shelved_host='user',shelved_image_id='e5cd35ca-72cb-4006-b1f0-36e1c553f01d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:44:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343ec5734ef547f292ee631dbb272359',uuid=e03ff609-e74d-427d-b6e6-109fbee09e40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converting VIF {"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ea:23,bridge_name='br-int',has_traffic_filtering=True,id=78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ad4923-b2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG os_vif [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ea:23,bridge_name='br-int',has_traffic_filtering=True,id=78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ad4923-b2') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a6c394-26ae-450f-a1d7-8fb5c480889f]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78ad4923-b2, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap78ad4923-b2, col_values=(('external_ids', {'iface-id': '78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:ea:23', 'vm-uuid': 'e03ff609-e74d-427d-b6e6-109fbee09e40'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:42 user nova-compute[73091]: INFO os_vif [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ea:23,bridge_name='br-int',has_traffic_filtering=True,id=78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ad4923-b2')
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c6f203-b57c-4cf3-88f0-0a2aeb2fbba1]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Updating instance_info_cache with network_info: [{"id": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "address": "fa:16:3e:ad:36:32", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf939b86-9e", "ovs_interfaceid": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Releasing lock "refresh_cache-f81e99b2-580f-43fa-b74d-84ad7764b64f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Instance network_info: |[{"id": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "address": "fa:16:3e:ad:36:32", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf939b86-9e", "ovs_interfaceid": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1769ca68-9b05-4939-bda7-2152d83f9165 req-2755842c-ca38-42ee-b6bc-92aa84a7dbc7 service nova] Acquired lock "refresh_cache-f81e99b2-580f-43fa-b74d-84ad7764b64f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.network.neutron [req-1769ca68-9b05-4939-bda7-2152d83f9165 req-2755842c-ca38-42ee-b6bc-92aa84a7dbc7 service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Refreshing network info cache for port af939b86-9ea1-46d6-8d42-e6171ca189c5 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Start _get_guest_xml network_info=[{"id": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "address": "fa:16:3e:ad:36:32", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf939b86-9e", "ovs_interfaceid": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae42ea2-6d5d-4646-ad45-d415d62df1d7]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:42 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:44:42 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] No VIF found with MAC fa:16:3e:3a:ea:23, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:44:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-470825434',display_name='tempest-AttachVolumeNegativeTest-server-470825434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-470825434',id=29,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGYyx101qSsggbbUMFa+FT7Ci2pKtsxBAb+vCghkXHRD19pa8XnL26PLYo6r0bSpCisQR8bX6AGwPf7WPxjak1W4Vkjpyv3BYisUZ/wjzKa6t0yGlNilL1AL1iq55h1pw==',key_name='tempest-keypair-16271140',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27f2275630ce4d55bf02851df830b6bd',ramdisk_id='',reservation_id='r-ofcz6n67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-604747333',owner_user_name='tempest-AttachVolumeNegativeTest-604747333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:44:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a5c393d644c4c3f8e9cbb0805ba7c08',uuid=f81e99b2-580f-43fa-b74d-84ad7764b64f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "address": "fa:16:3e:ad:36:32", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf939b86-9e", "ovs_interfaceid": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converting VIF {"id": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "address": "fa:16:3e:ad:36:32", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf939b86-9e", "ovs_interfaceid": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:36:32,bridge_name='br-int',has_traffic_filtering=True,id=af939b86-9ea1-46d6-8d42-e6171ca189c5,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf939b86-9e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.objects.instance [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'pci_devices' on Instance uuid f81e99b2-580f-43fa-b74d-84ad7764b64f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e51fbb0-930d-43db-b574-5fc6f46b303a]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:44:42 user nova-compute[73091]:   <uuid>f81e99b2-580f-43fa-b74d-84ad7764b64f</uuid>
Aug 09 16:44:42 user nova-compute[73091]:   <name>instance-0000001d</name>
Aug 09 16:44:42 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:44:42 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:44:42 user nova-compute[73091]:   <metadata>
Aug 09 16:44:42 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:44:42 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:44:42 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeNegativeTest-server-470825434</nova:name>
Aug 09 16:44:42 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:44:42</nova:creationTime>
Aug 09 16:44:42 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:44:42 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:44:42 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:44:42 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:44:42 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:44:42 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:44:42 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:44:42 user nova-compute[73091]:       <nova:owner>
Aug 09 16:44:42 user nova-compute[73091]:         <nova:user uuid="8a5c393d644c4c3f8e9cbb0805ba7c08">tempest-AttachVolumeNegativeTest-604747333-project-member</nova:user>
Aug 09 16:44:42 user nova-compute[73091]:         <nova:project uuid="27f2275630ce4d55bf02851df830b6bd">tempest-AttachVolumeNegativeTest-604747333</nova:project>
Aug 09 16:44:42 user nova-compute[73091]:       </nova:owner>
Aug 09 16:44:42 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:44:42 user nova-compute[73091]:       <nova:ports>
Aug 09 16:44:42 user nova-compute[73091]:         <nova:port uuid="af939b86-9ea1-46d6-8d42-e6171ca189c5">
Aug 09 16:44:42 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 16:44:42 user nova-compute[73091]:         </nova:port>
Aug 09 16:44:42 user nova-compute[73091]:       </nova:ports>
Aug 09 16:44:42 user nova-compute[73091]:     </nova:instance>
Aug 09 16:44:42 user nova-compute[73091]:   </metadata>
Aug 09 16:44:42 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:44:42 user nova-compute[73091]:     <system>
Aug 09 16:44:42 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:44:42 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:44:42 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:44:42 user nova-compute[73091]:       <entry name="serial">f81e99b2-580f-43fa-b74d-84ad7764b64f</entry>
Aug 09 16:44:42 user nova-compute[73091]:       <entry name="uuid">f81e99b2-580f-43fa-b74d-84ad7764b64f</entry>
Aug 09 16:44:42 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:44:42 user nova-compute[73091]:     </system>
Aug 09 16:44:42 user nova-compute[73091]:   </sysinfo>
Aug 09 16:44:42 user nova-compute[73091]:   <os>
Aug 09 16:44:42 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:44:42 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:44:42 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:44:42 user nova-compute[73091]:   </os>
Aug 09 16:44:42 user nova-compute[73091]:   <features>
Aug 09 16:44:42 user nova-compute[73091]:     <acpi/>
Aug 09 16:44:42 user nova-compute[73091]:     <apic/>
Aug 09 16:44:42 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:44:42 user nova-compute[73091]:   </features>
Aug 09 16:44:42 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:44:42 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:44:42 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:44:42 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:44:42 user nova-compute[73091]:   </clock>
Aug 09 16:44:42 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:44:42 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:44:42 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:44:42 user nova-compute[73091]:   </cpu>
Aug 09 16:44:42 user nova-compute[73091]:   <devices>
Aug 09 16:44:42 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:44:42 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:44:42 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f/disk"/>
Aug 09 16:44:42 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:44:42 user nova-compute[73091]:     </disk>
Aug 09 16:44:42 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:44:42 user nova-compute[73091]:       <mac address="fa:16:3e:ad:36:32"/>
Aug 09 16:44:42 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:44:42 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:44:42 user nova-compute[73091]:       <target dev="tapaf939b86-9e"/>
Aug 09 16:44:42 user nova-compute[73091]:     </interface>
Aug 09 16:44:42 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:44:42 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f/console.log" append="off"/>
Aug 09 16:44:42 user nova-compute[73091]:     </serial>
Aug 09 16:44:42 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:44:42 user nova-compute[73091]:     <video>
Aug 09 16:44:42 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:44:42 user nova-compute[73091]:     </video>
Aug 09 16:44:42 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:44:42 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:44:42 user nova-compute[73091]:     </rng>
Aug 09 16:44:42 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:44:42 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:44:42 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:44:42 user nova-compute[73091]:     </memballoon>
Aug 09 16:44:42 user nova-compute[73091]:   </devices>
Aug 09 16:44:42 user nova-compute[73091]: </domain>
Aug 09 16:44:42 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:44:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-470825434',display_name='tempest-AttachVolumeNegativeTest-server-470825434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-470825434',id=29,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGYyx101qSsggbbUMFa+FT7Ci2pKtsxBAb+vCghkXHRD19pa8XnL26PLYo6r0bSpCisQR8bX6AGwPf7WPxjak1W4Vkjpyv3BYisUZ/wjzKa6t0yGlNilL1AL1iq55h1pw==',key_name='tempest-keypair-16271140',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27f2275630ce4d55bf02851df830b6bd',ramdisk_id='',reservation_id='r-ofcz6n67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-604747333',owner_user_name='tempest-AttachVolumeNegativeTest-604747333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:44:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a5c393d644c4c3f8e9cbb0805ba7c08',uuid=f81e99b2-580f-43fa-b74d-84ad7764b64f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "address": "fa:16:3e:ad:36:32", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf939b86-9e", "ovs_interfaceid": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converting VIF {"id": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "address": "fa:16:3e:ad:36:32", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf939b86-9e", "ovs_interfaceid": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:36:32,bridge_name='br-int',has_traffic_filtering=True,id=af939b86-9ea1-46d6-8d42-e6171ca189c5,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf939b86-9e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG os_vif [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:36:32,bridge_name='br-int',has_traffic_filtering=True,id=af939b86-9ea1-46d6-8d42-e6171ca189c5,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf939b86-9e') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf939b86-9e, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf939b86-9e, col_values=(('external_ids', {'iface-id': 'af939b86-9ea1-46d6-8d42-e6171ca189c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:36:32', 'vm-uuid': 'f81e99b2-580f-43fa-b74d-84ad7764b64f'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:44:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:44:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:43 user nova-compute[73091]: INFO os_vif [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:36:32,bridge_name='br-int',has_traffic_filtering=True,id=af939b86-9ea1-46d6-8d42-e6171ca189c5,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf939b86-9e')
Aug 09 16:44:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f573032f-510a-4fa6-a4fa-cbda1f3ae327]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c, portal: 172.16.0.220,3260]
Aug 09 16:44:43 user nova-compute[73091]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c, portal: 172.16.0.220,3260] successful.
Aug 09 16:44:43 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:44:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] No VIF found with MAC fa:16:3e:ad:36:32, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:44:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2983f6b5-0deb-4c7a-8be7-4126c3b4975c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a412cfa-97ce-4f3d-bb1c-e0441d84e105]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:44:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] <== disconnect_volume: return (407ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:44:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:44:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-1769ca68-9b05-4939-bda7-2152d83f9165 req-2755842c-ca38-42ee-b6bc-92aa84a7dbc7 service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Updated VIF entry in instance network info cache for port af939b86-9ea1-46d6-8d42-e6171ca189c5. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:44:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-1769ca68-9b05-4939-bda7-2152d83f9165 req-2755842c-ca38-42ee-b6bc-92aa84a7dbc7 service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Updating instance_info_cache with network_info: [{"id": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "address": "fa:16:3e:ad:36:32", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf939b86-9e", "ovs_interfaceid": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:44:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1769ca68-9b05-4939-bda7-2152d83f9165 req-2755842c-ca38-42ee-b6bc-92aa84a7dbc7 service nova] Releasing lock "refresh_cache-f81e99b2-580f-43fa-b74d-84ad7764b64f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:44:43 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lazy-loading 'flavor' on Instance uuid 38051bca-7190-4dff-91d1-3d99b4e4182b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:44:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6497bc29-689f-4e65-ab66-5a44cf79643b tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.992s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-6a1d66aa-3c57-403c-bc6f-93401874075a req-313e2b10-b5c9-4562-b29b-bbe82d5143ea service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received event network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6a1d66aa-3c57-403c-bc6f-93401874075a req-313e2b10-b5c9-4562-b29b-bbe82d5143ea service nova] Acquiring lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6a1d66aa-3c57-403c-bc6f-93401874075a req-313e2b10-b5c9-4562-b29b-bbe82d5143ea service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6a1d66aa-3c57-403c-bc6f-93401874075a req-313e2b10-b5c9-4562-b29b-bbe82d5143ea service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-6a1d66aa-3c57-403c-bc6f-93401874075a req-313e2b10-b5c9-4562-b29b-bbe82d5143ea service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] No waiting events found dispatching network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:44:45 user nova-compute[73091]: WARNING nova.compute.manager [req-6a1d66aa-3c57-403c-bc6f-93401874075a req-313e2b10-b5c9-4562-b29b-bbe82d5143ea service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received unexpected event network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 16:44:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:44:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Creating image(s)
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Ensure instance console log exists: /opt/stack/data/nova/instances/da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Start _get_guest_xml network_info=[{"id": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "address": "fa:16:3e:b5:27:09", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66a718-97", "ovs_interfaceid": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-09T16:44:15Z,direct_url=<?>,disk_format='qcow2',id=0ffe9f2b-0fc7-407d-b09d-5770d50f6516,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-259357609',owner='64d3dfd232d54594808dad271baa5192',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-09T16:44:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '4831c090-a54e-459d-b4b5-6c9611d48f94', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaPOjGRb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8', 'attached_at': '', 'detached_at': '', 'volume_id': 'bbf5f97c-b804-4b42-ac30-184a6698f5e0', 'serial': 'bbf5f97c-b804-4b42-ac30-184a6698f5e0'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:44:47 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:44:47 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-09T16:44:15Z,direct_url=<?>,disk_format='qcow2',id=0ffe9f2b-0fc7-407d-b09d-5770d50f6516,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-259357609',owner='64d3dfd232d54594808dad271baa5192',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-09T16:44:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaPOjGRb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:44:47 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:44:47 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:44:47 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ec9512-36a5-4761-b939-acb4ebbc3291]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:44:47 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce019bf9-45d2-4b3a-8c70-53ae4fe1150c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0] added
Aug 09 16:44:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ccfc9a-4710-4ae3-a974-f6a5e298b4ad]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8d36b7-035c-4e3b-8bf1-2743755444c9]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XaPOjGRb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XaPOjGRb" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8c3238-690c-412b-940d-04dce6cb6e7b]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XaPOjGRb'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4f8ac5-b252-4401-bb91-a44bd8f2d395]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae37f1f-f305-4227-91ed-88bedd68dd26]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:44:47 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:44:47 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:44:47 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:44:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:44:47 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:44:47 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:44:47 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:44:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[db010b99-26c9-4a5e-9c9e-768df628c63f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0, portal: 172.16.0.220,3260]
Aug 09 16:44:47 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0, portal: 172.16.0.220,3260] successful.
Aug 09 16:44:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb130cec-48e6-457f-9a41-16cf592d86bf]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b399ca8-12ab-4177-ae0d-4f02625351b0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:44:47 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:44:47 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:44:47 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:44:47 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 (non-flash)
Aug 09 16:44:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:44:47 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:44:47 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:44:47 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:44:47 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 (non-flash)
Aug 09 16:44:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cc940c-e51d-4b30-8b90-5d5e0d170a84]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaPOjGRb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-06e24622-50f5-4a88-b2fe-8e35043daf88 req-abf19be1-47ae-49a6-916b-82b5ffd4309a service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received event network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-06e24622-50f5-4a88-b2fe-8e35043daf88 req-abf19be1-47ae-49a6-916b-82b5ffd4309a service nova] Acquiring lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-06e24622-50f5-4a88-b2fe-8e35043daf88 req-abf19be1-47ae-49a6-916b-82b5ffd4309a service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-06e24622-50f5-4a88-b2fe-8e35043daf88 req-abf19be1-47ae-49a6-916b-82b5ffd4309a service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-06e24622-50f5-4a88-b2fe-8e35043daf88 req-abf19be1-47ae-49a6-916b-82b5ffd4309a service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] No waiting events found dispatching network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:44:47 user nova-compute[73091]: WARNING nova.compute.manager [req-06e24622-50f5-4a88-b2fe-8e35043daf88 req-abf19be1-47ae-49a6-916b-82b5ffd4309a service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received unexpected event network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-06e24622-50f5-4a88-b2fe-8e35043daf88 req-abf19be1-47ae-49a6-916b-82b5ffd4309a service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Received event network-vif-plugged-af939b86-9ea1-46d6-8d42-e6171ca189c5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-06e24622-50f5-4a88-b2fe-8e35043daf88 req-abf19be1-47ae-49a6-916b-82b5ffd4309a service nova] Acquiring lock "f81e99b2-580f-43fa-b74d-84ad7764b64f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-06e24622-50f5-4a88-b2fe-8e35043daf88 req-abf19be1-47ae-49a6-916b-82b5ffd4309a service nova] Lock "f81e99b2-580f-43fa-b74d-84ad7764b64f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-06e24622-50f5-4a88-b2fe-8e35043daf88 req-abf19be1-47ae-49a6-916b-82b5ffd4309a service nova] Lock "f81e99b2-580f-43fa-b74d-84ad7764b64f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-06e24622-50f5-4a88-b2fe-8e35043daf88 req-abf19be1-47ae-49a6-916b-82b5ffd4309a service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] No waiting events found dispatching network-vif-plugged-af939b86-9ea1-46d6-8d42-e6171ca189c5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:44:47 user nova-compute[73091]: WARNING nova.compute.manager [req-06e24622-50f5-4a88-b2fe-8e35043daf88 req-abf19be1-47ae-49a6-916b-82b5ffd4309a service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Received unexpected event network-vif-plugged-af939b86-9ea1-46d6-8d42-e6171ca189c5 for instance with vm_state building and task_state spawning.
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-06e24622-50f5-4a88-b2fe-8e35043daf88 req-abf19be1-47ae-49a6-916b-82b5ffd4309a service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Received event network-vif-plugged-af939b86-9ea1-46d6-8d42-e6171ca189c5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-06e24622-50f5-4a88-b2fe-8e35043daf88 req-abf19be1-47ae-49a6-916b-82b5ffd4309a service nova] Acquiring lock "f81e99b2-580f-43fa-b74d-84ad7764b64f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-06e24622-50f5-4a88-b2fe-8e35043daf88 req-abf19be1-47ae-49a6-916b-82b5ffd4309a service nova] Lock "f81e99b2-580f-43fa-b74d-84ad7764b64f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-06e24622-50f5-4a88-b2fe-8e35043daf88 req-abf19be1-47ae-49a6-916b-82b5ffd4309a service nova] Lock "f81e99b2-580f-43fa-b74d-84ad7764b64f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-06e24622-50f5-4a88-b2fe-8e35043daf88 req-abf19be1-47ae-49a6-916b-82b5ffd4309a service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] No waiting events found dispatching network-vif-plugged-af939b86-9ea1-46d6-8d42-e6171ca189c5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:44:47 user nova-compute[73091]: WARNING nova.compute.manager [req-06e24622-50f5-4a88-b2fe-8e35043daf88 req-abf19be1-47ae-49a6-916b-82b5ffd4309a service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Received unexpected event network-vif-plugged-af939b86-9ea1-46d6-8d42-e6171ca189c5 for instance with vm_state building and task_state spawning.
Aug 09 16:44:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599488.3820796, f81e99b2-580f-43fa-b74d-84ad7764b64f => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:44:48 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] VM Resumed (Lifecycle Event)
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:44:48 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Instance spawned successfully.
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:44:48 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Instance spawned successfully.
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:44:48 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599488.3836055, f81e99b2-580f-43fa-b74d-84ad7764b64f => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:44:48 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] VM Started (Lifecycle Event)
Aug 09 16:44:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26635393966653534', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635393966653534', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:44:48 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599488.387626, e03ff609-e74d-427d-b6e6-109fbee09e40 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:44:48 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] VM Resumed (Lifecycle Event)
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1680178947',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1680178947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1680178947',id=28,image_ref='0ffe9f2b-0fc7-407d-b09d-5770d50f6516',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzG5tw9UiRuKU2qFWQJ4z3/C8wD09/2CACmqWtwf/rB9ZQeS5mkjiNLhXWJ4mnXsjg7nsBXJVUnEVsXcgol/T77KM2MhvE8rHzZyx16lR2J52wNbR0+4O5wNPPvEnC40Q==',key_name='tempest-keypair-1930942646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d3dfd232d54594808dad271baa5192',ramdisk_id='',reservation_id='r-bmxyqwh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1605875873',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1605875873',owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:44:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69ccebf0e9d54502a2318c809ce11369',uuid=da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "address": "fa:16:3e:b5:27:09", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66a718-97", "ovs_interfaceid": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converting VIF {"id": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "address": "fa:16:3e:b5:27:09", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66a718-97", "ovs_interfaceid": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:27:09,bridge_name='br-int',has_traffic_filtering=True,id=3d66a718-971e-4e64-80f3-d57b2b6364dc,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d66a718-97') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lazy-loading 'pci_devices' on Instance uuid da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:44:48 user nova-compute[73091]: INFO nova.compute.manager [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Took 8.44 seconds to spawn the instance on the hypervisor.
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:44:48 user nova-compute[73091]:   <uuid>da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8</uuid>
Aug 09 16:44:48 user nova-compute[73091]:   <name>instance-0000001c</name>
Aug 09 16:44:48 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:44:48 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:44:48 user nova-compute[73091]:   <metadata>
Aug 09 16:44:48 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:44:48 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:44:48 user nova-compute[73091]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1680178947</nova:name>
Aug 09 16:44:48 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:44:47</nova:creationTime>
Aug 09 16:44:48 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:44:48 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:44:48 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:44:48 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:44:48 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:44:48 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:44:48 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:44:48 user nova-compute[73091]:       <nova:owner>
Aug 09 16:44:48 user nova-compute[73091]:         <nova:user uuid="69ccebf0e9d54502a2318c809ce11369">tempest-TestVolumeBootPattern-1605875873-project-member</nova:user>
Aug 09 16:44:48 user nova-compute[73091]:         <nova:project uuid="64d3dfd232d54594808dad271baa5192">tempest-TestVolumeBootPattern-1605875873</nova:project>
Aug 09 16:44:48 user nova-compute[73091]:       </nova:owner>
Aug 09 16:44:48 user nova-compute[73091]:       <nova:root type="image" uuid="0ffe9f2b-0fc7-407d-b09d-5770d50f6516"/>
Aug 09 16:44:48 user nova-compute[73091]:       <nova:ports>
Aug 09 16:44:48 user nova-compute[73091]:         <nova:port uuid="3d66a718-971e-4e64-80f3-d57b2b6364dc">
Aug 09 16:44:48 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 16:44:48 user nova-compute[73091]:         </nova:port>
Aug 09 16:44:48 user nova-compute[73091]:       </nova:ports>
Aug 09 16:44:48 user nova-compute[73091]:     </nova:instance>
Aug 09 16:44:48 user nova-compute[73091]:   </metadata>
Aug 09 16:44:48 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:44:48 user nova-compute[73091]:     <system>
Aug 09 16:44:48 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:44:48 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:44:48 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:44:48 user nova-compute[73091]:       <entry name="serial">da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8</entry>
Aug 09 16:44:48 user nova-compute[73091]:       <entry name="uuid">da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8</entry>
Aug 09 16:44:48 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:44:48 user nova-compute[73091]:     </system>
Aug 09 16:44:48 user nova-compute[73091]:   </sysinfo>
Aug 09 16:44:48 user nova-compute[73091]:   <os>
Aug 09 16:44:48 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:44:48 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:44:48 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:44:48 user nova-compute[73091]:   </os>
Aug 09 16:44:48 user nova-compute[73091]:   <features>
Aug 09 16:44:48 user nova-compute[73091]:     <acpi/>
Aug 09 16:44:48 user nova-compute[73091]:     <apic/>
Aug 09 16:44:48 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:44:48 user nova-compute[73091]:   </features>
Aug 09 16:44:48 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:44:48 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:44:48 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:44:48 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:44:48 user nova-compute[73091]:   </clock>
Aug 09 16:44:48 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:44:48 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:44:48 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:44:48 user nova-compute[73091]:   </cpu>
Aug 09 16:44:48 user nova-compute[73091]:   <devices>
Aug 09 16:44:48 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:44:48 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:44:48 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 09 16:44:48 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:44:48 user nova-compute[73091]:       <serial>bbf5f97c-b804-4b42-ac30-184a6698f5e0</serial>
Aug 09 16:44:48 user nova-compute[73091]:     </disk>
Aug 09 16:44:48 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:44:48 user nova-compute[73091]:       <mac address="fa:16:3e:b5:27:09"/>
Aug 09 16:44:48 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:44:48 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:44:48 user nova-compute[73091]:       <target dev="tap3d66a718-97"/>
Aug 09 16:44:48 user nova-compute[73091]:     </interface>
Aug 09 16:44:48 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:44:48 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8/console.log" append="off"/>
Aug 09 16:44:48 user nova-compute[73091]:     </serial>
Aug 09 16:44:48 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:44:48 user nova-compute[73091]:     <video>
Aug 09 16:44:48 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:44:48 user nova-compute[73091]:     </video>
Aug 09 16:44:48 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:44:48 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:44:48 user nova-compute[73091]:     </rng>
Aug 09 16:44:48 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:44:48 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:44:48 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:44:48 user nova-compute[73091]:     </memballoon>
Aug 09 16:44:48 user nova-compute[73091]:   </devices>
Aug 09 16:44:48 user nova-compute[73091]: </domain>
Aug 09 16:44:48 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1680178947',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1680178947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1680178947',id=28,image_ref='0ffe9f2b-0fc7-407d-b09d-5770d50f6516',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzG5tw9UiRuKU2qFWQJ4z3/C8wD09/2CACmqWtwf/rB9ZQeS5mkjiNLhXWJ4mnXsjg7nsBXJVUnEVsXcgol/T77KM2MhvE8rHzZyx16lR2J52wNbR0+4O5wNPPvEnC40Q==',key_name='tempest-keypair-1930942646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d3dfd232d54594808dad271baa5192',ramdisk_id='',reservation_id='r-bmxyqwh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1605875873',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1605875873',owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:44:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69ccebf0e9d54502a2318c809ce11369',uuid=da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "address": "fa:16:3e:b5:27:09", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66a718-97", "ovs_interfaceid": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converting VIF {"id": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "address": "fa:16:3e:b5:27:09", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66a718-97", "ovs_interfaceid": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:27:09,bridge_name='br-int',has_traffic_filtering=True,id=3d66a718-971e-4e64-80f3-d57b2b6364dc,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d66a718-97') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG os_vif [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:27:09,bridge_name='br-int',has_traffic_filtering=True,id=3d66a718-971e-4e64-80f3-d57b2b6364dc,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d66a718-97') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d66a718-97, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d66a718-97, col_values=(('external_ids', {'iface-id': '3d66a718-971e-4e64-80f3-d57b2b6364dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:27:09', 'vm-uuid': 'da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:48 user nova-compute[73091]: INFO os_vif [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:27:09,bridge_name='br-int',has_traffic_filtering=True,id=3d66a718-971e-4e64-80f3-d57b2b6364dc,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d66a718-97')
Aug 09 16:44:48 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599488.3885233, e03ff609-e74d-427d-b6e6-109fbee09e40 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:44:48 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] VM Started (Lifecycle Event)
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] No VIF found with MAC fa:16:3e:b5:27:09, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:44:48 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:44:48 user nova-compute[73091]: INFO nova.compute.manager [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Took 9.94 seconds to build instance.
Aug 09 16:44:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90d408e5-1c70-4d42-b72b-0c333df478f0 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "f81e99b2-580f-43fa-b74d-84ad7764b64f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.106s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8046f798-d196-4d0b-b559-7ab4fb84e3eb tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.932s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-446870aa-1aa2-4fe9-bf2c-0a2d19c3d2e3 req-cb575f82-d0a9-4926-8d82-1a154cf884c9 service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Received event network-vif-plugged-3d66a718-971e-4e64-80f3-d57b2b6364dc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-446870aa-1aa2-4fe9-bf2c-0a2d19c3d2e3 req-cb575f82-d0a9-4926-8d82-1a154cf884c9 service nova] Acquiring lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-446870aa-1aa2-4fe9-bf2c-0a2d19c3d2e3 req-cb575f82-d0a9-4926-8d82-1a154cf884c9 service nova] Lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-446870aa-1aa2-4fe9-bf2c-0a2d19c3d2e3 req-cb575f82-d0a9-4926-8d82-1a154cf884c9 service nova] Lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-446870aa-1aa2-4fe9-bf2c-0a2d19c3d2e3 req-cb575f82-d0a9-4926-8d82-1a154cf884c9 service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] No waiting events found dispatching network-vif-plugged-3d66a718-971e-4e64-80f3-d57b2b6364dc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:44:50 user nova-compute[73091]: WARNING nova.compute.manager [req-446870aa-1aa2-4fe9-bf2c-0a2d19c3d2e3 req-cb575f82-d0a9-4926-8d82-1a154cf884c9 service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Received unexpected event network-vif-plugged-3d66a718-971e-4e64-80f3-d57b2b6364dc for instance with vm_state building and task_state spawning.
Aug 09 16:44:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:44:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:44:52 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599492.1880333, da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:44:52 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] VM Resumed (Lifecycle Event)
Aug 09 16:44:52 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Instance spawned successfully.
Aug 09 16:44:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:44:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:44:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:44:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:44:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:44:52 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:44:52 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599492.1888094, da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:44:52 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] VM Started (Lifecycle Event)
Aug 09 16:44:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:44:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:44:52 user nova-compute[73091]: INFO nova.compute.manager [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Took 5.26 seconds to spawn the instance on the hypervisor.
Aug 09 16:44:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:44:52 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:44:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-69ca1dfc-4bff-4415-86b2-ac916b5f3acf req-596ed783-1bb3-48de-846f-e584d1334095 service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Received event network-vif-plugged-3d66a718-971e-4e64-80f3-d57b2b6364dc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:44:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-69ca1dfc-4bff-4415-86b2-ac916b5f3acf req-596ed783-1bb3-48de-846f-e584d1334095 service nova] Acquiring lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:44:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-69ca1dfc-4bff-4415-86b2-ac916b5f3acf req-596ed783-1bb3-48de-846f-e584d1334095 service nova] Lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:44:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-69ca1dfc-4bff-4415-86b2-ac916b5f3acf req-596ed783-1bb3-48de-846f-e584d1334095 service nova] Lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-69ca1dfc-4bff-4415-86b2-ac916b5f3acf req-596ed783-1bb3-48de-846f-e584d1334095 service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] No waiting events found dispatching network-vif-plugged-3d66a718-971e-4e64-80f3-d57b2b6364dc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:44:52 user nova-compute[73091]: WARNING nova.compute.manager [req-69ca1dfc-4bff-4415-86b2-ac916b5f3acf req-596ed783-1bb3-48de-846f-e584d1334095 service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Received unexpected event network-vif-plugged-3d66a718-971e-4e64-80f3-d57b2b6364dc for instance with vm_state building and task_state spawning.
Aug 09 16:44:52 user nova-compute[73091]: INFO nova.compute.manager [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Took 27.38 seconds to build instance.
Aug 09 16:44:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4fda4854-abf5-4617-af46-8a0ef73494aa tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.506s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:44:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:44:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:08 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:45:08 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:45:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:45:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:11 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:45:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:45:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:45:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:45:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:45:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Updating instance_info_cache with network_info: [{"id": "50f0d7f2-7e34-475a-9d69-145a0e321400", "address": "fa:16:3e:25:e0:ab", "network": {"id": "5868d9d5-2152-496d-93e2-8e1308b2ad18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d65ef533e7c145faae7d9af3815007ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0d7f2-7e", "ovs_interfaceid": "50f0d7f2-7e34-475a-9d69-145a0e321400", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:45:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-38051bca-7190-4dff-91d1-3d99b4e4182b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:45:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:45:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:45:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:45:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:45:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:14 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:45:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:45:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:45:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:45:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:15 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:45:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:45:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:45:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-874b474b-5e6e-4883-a2cc-f0debbd38f1d req-21e7ef1e-4041-4d71-92c3-989ddd278dcc service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received event network-changed-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-874b474b-5e6e-4883-a2cc-f0debbd38f1d req-21e7ef1e-4041-4d71-92c3-989ddd278dcc service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Refreshing instance network info cache due to event network-changed-2d1a984c-9df8-49a7-9460-bee934ea307f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-874b474b-5e6e-4883-a2cc-f0debbd38f1d req-21e7ef1e-4041-4d71-92c3-989ddd278dcc service nova] Acquiring lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-874b474b-5e6e-4883-a2cc-f0debbd38f1d req-21e7ef1e-4041-4d71-92c3-989ddd278dcc service nova] Acquired lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-874b474b-5e6e-4883-a2cc-f0debbd38f1d req-21e7ef1e-4041-4d71-92c3-989ddd278dcc service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Refreshing network info cache for port 2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:45:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG nova.network.neutron [req-874b474b-5e6e-4883-a2cc-f0debbd38f1d req-21e7ef1e-4041-4d71-92c3-989ddd278dcc service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Updated VIF entry in instance network info cache for port 2d1a984c-9df8-49a7-9460-bee934ea307f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG nova.network.neutron [req-874b474b-5e6e-4883-a2cc-f0debbd38f1d req-21e7ef1e-4041-4d71-92c3-989ddd278dcc service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Updating instance_info_cache with network_info: [{"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-874b474b-5e6e-4883-a2cc-f0debbd38f1d req-21e7ef1e-4041-4d71-92c3-989ddd278dcc service nova] Releasing lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-bc30de9b-4654-4e4c-be18-e4c303878159 req-ed661b76-91d6-4adf-8689-e679cd02a300 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received event network-changed-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-bc30de9b-4654-4e4c-be18-e4c303878159 req-ed661b76-91d6-4adf-8689-e679cd02a300 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Refreshing instance network info cache due to event network-changed-2d1a984c-9df8-49a7-9460-bee934ea307f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bc30de9b-4654-4e4c-be18-e4c303878159 req-ed661b76-91d6-4adf-8689-e679cd02a300 service nova] Acquiring lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bc30de9b-4654-4e4c-be18-e4c303878159 req-ed661b76-91d6-4adf-8689-e679cd02a300 service nova] Acquired lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG nova.network.neutron [req-bc30de9b-4654-4e4c-be18-e4c303878159 req-ed661b76-91d6-4adf-8689-e679cd02a300 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Refreshing network info cache for port 2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:45:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:19 user nova-compute[73091]: INFO nova.compute.manager [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Detaching volume e93752e2-313e-4a13-81bb-203e56bad5b0
Aug 09 16:45:19 user nova-compute[73091]: INFO nova.virt.block_device [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Attempting to driver detach volume e93752e2-313e-4a13-81bb-203e56bad5b0 from mountpoint /dev/vdb
Aug 09 16:45:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Attempting to detach device vdb from instance f8f52e24-8ce5-4128-a2aa-afc68ceb7213 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:45:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:45:19 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:45:19 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 09 16:45:19 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:45:19 user nova-compute[73091]:   <serial>e93752e2-313e-4a13-81bb-203e56bad5b0</serial>
Aug 09 16:45:19 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 16:45:19 user nova-compute[73091]: </disk>
Aug 09 16:45:19 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:45:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Successfully detached device vdb from instance f8f52e24-8ce5-4128-a2aa-afc68ceb7213 from the persistent domain config.
Aug 09 16:45:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f8f52e24-8ce5-4128-a2aa-afc68ceb7213 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:45:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:45:19 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:45:19 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 09 16:45:19 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:45:19 user nova-compute[73091]:   <serial>e93752e2-313e-4a13-81bb-203e56bad5b0</serial>
Aug 09 16:45:19 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 16:45:19 user nova-compute[73091]: </disk>
Aug 09 16:45:19 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:45:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-bc30de9b-4654-4e4c-be18-e4c303878159 req-ed661b76-91d6-4adf-8689-e679cd02a300 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Updated VIF entry in instance network info cache for port 2d1a984c-9df8-49a7-9460-bee934ea307f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:45:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-bc30de9b-4654-4e4c-be18-e4c303878159 req-ed661b76-91d6-4adf-8689-e679cd02a300 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Updating instance_info_cache with network_info: [{"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:45:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bc30de9b-4654-4e4c-be18-e4c303878159 req-ed661b76-91d6-4adf-8689-e679cd02a300 service nova] Releasing lock "refresh_cache-f8f52e24-8ce5-4128-a2aa-afc68ceb7213" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:45:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691599519.9532197, f8f52e24-8ce5-4128-a2aa-afc68ceb7213 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f8f52e24-8ce5-4128-a2aa-afc68ceb7213 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:45:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Successfully detached device vdb from instance f8f52e24-8ce5-4128-a2aa-afc68ceb7213 from the live domain config.
Aug 09 16:45:20 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:45:20 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:45:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7010MB free_disk=25.132816314697266GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNidHjKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:45:20 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:45:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e328a4d-b0f9-454a-9ff4-98ce95c80f3b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd640138-e0fc-4681-867c-cb02f0e8f594]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:45:20 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:45:20 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:45:20 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:45:20 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 (non-flash)
Aug 09 16:45:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:45:20 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 (non-flash)
Aug 09 16:45:20 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:45:20 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:45:20 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 (non-flash)
Aug 09 16:45:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff06032eb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0'): ({'sdf'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Removing single pathed devices sdf {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[605c66e5-c854-463a-afef-05cacf7af6d9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c661fd5b-37fa-4ea2-a8fc-5d02bb1d7a7d]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Flushing IO for device /dev/sdf {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea8857f-721f-4d8c-bdea-1543891c5984]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 38051bca-7190-4dff-91d1-3d99b4e4182b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f939fe27-017a-481e-babc-147bf98e0132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8fc884a8-24bb-488a-baeb-ef2b1faf239d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f8f52e24-8ce5-4128-a2aa-afc68ceb7213 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 68d63bc2-d726-49d8-91de-bc5cc66bb119 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 148cb211-b2f6-4782-8f35-e66a55cc95bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 4a39f479-265c-49c3-86c4-a65fff2f06c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance e03ff609-e74d-427d-b6e6-109fbee09e40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f81e99b2-580f-43fa-b74d-84ad7764b64f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.067s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9b4559-70d5-42cf-a238-58ef2d4d502a]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[36424774-50cf-439f-a725-5c1fba21bfc4]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[419cf942-2eb0-45dc-9193-04c72f5ae158]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0, portal: 172.16.0.220,3260]
Aug 09 16:45:20 user nova-compute[73091]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0, portal: 172.16.0.220,3260] successful.
Aug 09 16:45:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93752e2-313e-4a13-81bb-203e56bad5b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c83d910-e8af-449b-b95c-61de91d055a0]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] <== disconnect_volume: return (364ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:45:20 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:45:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:45:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.578s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lazy-loading 'flavor' on Instance uuid f8f52e24-8ce5-4128-a2aa-afc68ceb7213 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:45:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0e32ca3f-9e8b-4a47-bc0d-0857781f9791 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.436s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "97af1277-b4bd-4a89-903b-4f70087f0535" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "97af1277-b4bd-4a89-903b-4f70087f0535" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:45:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:31 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:45:31 user nova-compute[73091]: INFO nova.compute.claims [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Claim successful on node user
Aug 09 16:45:32 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG nova.network.neutron [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:45:32 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:45:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:45:32 user nova-compute[73091]: INFO nova.virt.block_device [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Booting with volume 35539ace-9cd8-4004-bdba-ccd3d56a7628 at /dev/vda
Aug 09 16:45:32 user nova-compute[73091]: DEBUG nova.policy [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8956fad221ec4dedb700f034d5230c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c913ceef2c4610a26bd19df29ee896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG os_brick.utils [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14e7be6-3f0f-45e8-9481-88d0929e44a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a58e10-84c8-4811-9746-cfe8a0001931]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87d6ec1-9d1b-41ee-b1da-8326728a2e2d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bd9246-da0b-41cd-99e2-1a7f02b46807]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:45:32 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ce048e-abfd-4198-a235-dfdb3dbd8bd4]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG os_brick.utils [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Updating existing volume attachment record: ee824c61-fa22-490f-b46e-c4a8dd3421ac {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "38051bca-7190-4dff-91d1-3d99b4e4182b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:32 user nova-compute[73091]: INFO nova.compute.manager [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Terminating instance
Aug 09 16:45:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-bcb92e5d-8f40-4c96-9a42-467bcf39f8b4 req-fa97750f-df63-412f-9afc-29660a8ad61a service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received event network-vif-unplugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:45:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bcb92e5d-8f40-4c96-9a42-467bcf39f8b4 req-fa97750f-df63-412f-9afc-29660a8ad61a service nova] Acquiring lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bcb92e5d-8f40-4c96-9a42-467bcf39f8b4 req-fa97750f-df63-412f-9afc-29660a8ad61a service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bcb92e5d-8f40-4c96-9a42-467bcf39f8b4 req-fa97750f-df63-412f-9afc-29660a8ad61a service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-bcb92e5d-8f40-4c96-9a42-467bcf39f8b4 req-fa97750f-df63-412f-9afc-29660a8ad61a service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] No waiting events found dispatching network-vif-unplugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:45:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-bcb92e5d-8f40-4c96-9a42-467bcf39f8b4 req-fa97750f-df63-412f-9afc-29660a8ad61a service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received event network-vif-unplugged-50f0d7f2-7e34-475a-9d69-145a0e321400 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:45:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:33 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Instance destroyed successfully.
Aug 09 16:45:33 user nova-compute[73091]: DEBUG nova.objects.instance [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lazy-loading 'resources' on Instance uuid 38051bca-7190-4dff-91d1-3d99b4e4182b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:45:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-261726215',display_name='tempest-ServerStableDeviceRescueTest-server-261726215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-261726215',id=17,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDt6bgWOl3OaJeJplczLpq3pEO+nQ0SnhcLURWVFOG9Ust3RYcVv/4I32bnc6u3NQSYIpFhMkkFOddkSUUubBFd//CxBbSxsh9Y6SvTjHrUjqSbV15wPCQRXhXN07VEozQ==',key_name='tempest-keypair-1192423936',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:42:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d65ef533e7c145faae7d9af3815007ac',ramdisk_id='',reservation_id='r-p601w4u8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-345363851',owner_user_name='tempest-ServerStableDeviceRescueTest-345363851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:44:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fee448a86074a69ac5a45ac5b010069',uuid=38051bca-7190-4dff-91d1-3d99b4e4182b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50f0d7f2-7e34-475a-9d69-145a0e321400", "address": "fa:16:3e:25:e0:ab", "network": {"id": "5868d9d5-2152-496d-93e2-8e1308b2ad18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d65ef533e7c145faae7d9af3815007ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0d7f2-7e", "ovs_interfaceid": "50f0d7f2-7e34-475a-9d69-145a0e321400", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:45:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Converting VIF {"id": "50f0d7f2-7e34-475a-9d69-145a0e321400", "address": "fa:16:3e:25:e0:ab", "network": {"id": "5868d9d5-2152-496d-93e2-8e1308b2ad18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-798948245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d65ef533e7c145faae7d9af3815007ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f0d7f2-7e", "ovs_interfaceid": "50f0d7f2-7e34-475a-9d69-145a0e321400", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:45:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:e0:ab,bridge_name='br-int',has_traffic_filtering=True,id=50f0d7f2-7e34-475a-9d69-145a0e321400,network=Network(5868d9d5-2152-496d-93e2-8e1308b2ad18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f0d7f2-7e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:45:33 user nova-compute[73091]: DEBUG os_vif [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:e0:ab,bridge_name='br-int',has_traffic_filtering=True,id=50f0d7f2-7e34-475a-9d69-145a0e321400,network=Network(5868d9d5-2152-496d-93e2-8e1308b2ad18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f0d7f2-7e') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:45:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50f0d7f2-7e, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:45:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:45:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:33 user nova-compute[73091]: INFO os_vif [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:e0:ab,bridge_name='br-int',has_traffic_filtering=True,id=50f0d7f2-7e34-475a-9d69-145a0e321400,network=Network(5868d9d5-2152-496d-93e2-8e1308b2ad18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f0d7f2-7e')
Aug 09 16:45:33 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Deleting instance files /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b_del
Aug 09 16:45:33 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Deletion of /opt/stack/data/nova/instances/38051bca-7190-4dff-91d1-3d99b4e4182b_del complete
Aug 09 16:45:33 user nova-compute[73091]: INFO nova.compute.manager [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 16:45:33 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:45:33 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:45:33 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:45:33 user nova-compute[73091]: DEBUG nova.network.neutron [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Successfully created port: a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:45:34 user nova-compute[73091]: INFO nova.compute.manager [None req-14bf4028-4afb-4077-ab7d-b0556125ef43 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Unrescuing
Aug 09 16:45:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-14bf4028-4afb-4077-ab7d-b0556125ef43 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "refresh_cache-f939fe27-017a-481e-babc-147bf98e0132" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:45:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-14bf4028-4afb-4077-ab7d-b0556125ef43 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquired lock "refresh_cache-f939fe27-017a-481e-babc-147bf98e0132" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:45:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-14bf4028-4afb-4077-ab7d-b0556125ef43 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:45:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-14bf4028-4afb-4077-ab7d-b0556125ef43 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Updating instance_info_cache with network_info: [{"id": "c830ef2e-da54-4321-905f-845e0440a759", "address": "fa:16:3e:b5:68:3c", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc830ef2e-da", "ovs_interfaceid": "c830ef2e-da54-4321-905f-845e0440a759", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-14bf4028-4afb-4077-ab7d-b0556125ef43 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Releasing lock "refresh_cache-f939fe27-017a-481e-babc-147bf98e0132" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG nova.objects.instance [None req-14bf4028-4afb-4077-ab7d-b0556125ef43 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'flavor' on Instance uuid f939fe27-017a-481e-babc-147bf98e0132 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:45:35 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Took 1.53 seconds to deallocate network for instance.
Aug 09 16:45:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-6540df60-a61d-4617-ad6b-add470f916f7 req-9e5ebb2e-3296-4ed8-bb07-7bb78bffd946 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received event network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6540df60-a61d-4617-ad6b-add470f916f7 req-9e5ebb2e-3296-4ed8-bb07-7bb78bffd946 service nova] Acquiring lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6540df60-a61d-4617-ad6b-add470f916f7 req-9e5ebb2e-3296-4ed8-bb07-7bb78bffd946 service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6540df60-a61d-4617-ad6b-add470f916f7 req-9e5ebb2e-3296-4ed8-bb07-7bb78bffd946 service nova] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-6540df60-a61d-4617-ad6b-add470f916f7 req-9e5ebb2e-3296-4ed8-bb07-7bb78bffd946 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] No waiting events found dispatching network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:45:35 user nova-compute[73091]: WARNING nova.compute.manager [req-6540df60-a61d-4617-ad6b-add470f916f7 req-9e5ebb2e-3296-4ed8-bb07-7bb78bffd946 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received unexpected event network-vif-plugged-50f0d7f2-7e34-475a-9d69-145a0e321400 for instance with vm_state active and task_state deleting.
Aug 09 16:45:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-6540df60-a61d-4617-ad6b-add470f916f7 req-9e5ebb2e-3296-4ed8-bb07-7bb78bffd946 service nova] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Received event network-vif-deleted-50f0d7f2-7e34-475a-9d69-145a0e321400 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Successfully updated port: a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquired lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-d59217a5-0ac4-4a8a-81e6-0d83333ec251 req-72304f45-1ca9-4565-980e-842ccb09fe36 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received event network-vif-unplugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d59217a5-0ac4-4a8a-81e6-0d83333ec251 req-72304f45-1ca9-4565-980e-842ccb09fe36 service nova] Acquiring lock "f939fe27-017a-481e-babc-147bf98e0132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d59217a5-0ac4-4a8a-81e6-0d83333ec251 req-72304f45-1ca9-4565-980e-842ccb09fe36 service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d59217a5-0ac4-4a8a-81e6-0d83333ec251 req-72304f45-1ca9-4565-980e-842ccb09fe36 service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-d59217a5-0ac4-4a8a-81e6-0d83333ec251 req-72304f45-1ca9-4565-980e-842ccb09fe36 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] No waiting events found dispatching network-vif-unplugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:45:35 user nova-compute[73091]: WARNING nova.compute.manager [req-d59217a5-0ac4-4a8a-81e6-0d83333ec251 req-72304f45-1ca9-4565-980e-842ccb09fe36 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received unexpected event network-vif-unplugged-c830ef2e-da54-4321-905f-845e0440a759 for instance with vm_state rescued and task_state unrescuing.
Aug 09 16:45:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.497s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:35 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Deleted allocations for instance 38051bca-7190-4dff-91d1-3d99b4e4182b
Aug 09 16:45:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Updating instance_info_cache with network_info: [{"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-42fefc53-514b-402b-bb40-4a2c0deb0b74 tempest-ServerStableDeviceRescueTest-345363851 tempest-ServerStableDeviceRescueTest-345363851-project-member] Lock "38051bca-7190-4dff-91d1-3d99b4e4182b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.157s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Releasing lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:45:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Instance network_info: |[{"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:45:35 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: f939fe27-017a-481e-babc-147bf98e0132] Instance destroyed successfully.
Aug 09 16:45:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-a9b12e38-8e09-427b-829c-02faf640e690 req-1dc6b302-d5fc-43fd-9f44-c92e91b56c34 service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Received event network-changed-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-a9b12e38-8e09-427b-829c-02faf640e690 req-1dc6b302-d5fc-43fd-9f44-c92e91b56c34 service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Refreshing instance network info cache due to event network-changed-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9b12e38-8e09-427b-829c-02faf640e690 req-1dc6b302-d5fc-43fd-9f44-c92e91b56c34 service nova] Acquiring lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9b12e38-8e09-427b-829c-02faf640e690 req-1dc6b302-d5fc-43fd-9f44-c92e91b56c34 service nova] Acquired lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-a9b12e38-8e09-427b-829c-02faf640e690 req-1dc6b302-d5fc-43fd-9f44-c92e91b56c34 service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Refreshing network info cache for port a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-e216317d-e09d-4b02-ac76-fba65a4bef29 req-0f41739b-73ba-4b05-b424-0ae6d79c3b01 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received event network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e216317d-e09d-4b02-ac76-fba65a4bef29 req-0f41739b-73ba-4b05-b424-0ae6d79c3b01 service nova] Acquiring lock "f939fe27-017a-481e-babc-147bf98e0132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e216317d-e09d-4b02-ac76-fba65a4bef29 req-0f41739b-73ba-4b05-b424-0ae6d79c3b01 service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e216317d-e09d-4b02-ac76-fba65a4bef29 req-0f41739b-73ba-4b05-b424-0ae6d79c3b01 service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-e216317d-e09d-4b02-ac76-fba65a4bef29 req-0f41739b-73ba-4b05-b424-0ae6d79c3b01 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] No waiting events found dispatching network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:45:37 user nova-compute[73091]: WARNING nova.compute.manager [req-e216317d-e09d-4b02-ac76-fba65a4bef29 req-0f41739b-73ba-4b05-b424-0ae6d79c3b01 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received unexpected event network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 for instance with vm_state rescued and task_state unrescuing.
Aug 09 16:45:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:45:37 user nova-compute[73091]: INFO nova.compute.claims [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Claim successful on node user
Aug 09 16:45:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-a9b12e38-8e09-427b-829c-02faf640e690 req-1dc6b302-d5fc-43fd-9f44-c92e91b56c34 service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Updated VIF entry in instance network info cache for port a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-a9b12e38-8e09-427b-829c-02faf640e690 req-1dc6b302-d5fc-43fd-9f44-c92e91b56c34 service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Updating instance_info_cache with network_info: [{"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:45:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9b12e38-8e09-427b-829c-02faf640e690 req-1dc6b302-d5fc-43fd-9f44-c92e91b56c34 service nova] Releasing lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:45:38 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:45:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG nova.policy [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50cd847d1eb74f15bca467f2ce19941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79c356957db41aaa4e38a994523ba49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:45:38 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Creating image(s)
Aug 09 16:45:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "/opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "/opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk 1073741824" returned: 0 in 0.053s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.157s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:45:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Cannot resize image /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lazy-loading 'migration_context' on Instance uuid b9639ddc-0ff9-41d2-b647-3af5fce945c2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Ensure instance console log exists: /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Successfully created port: 4f550175-ab3c-4b43-9a63-fd5b429773f3 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-14bf4028-4afb-4077-ab7d-b0556125ef43 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Removed pending event for f939fe27-017a-481e-babc-147bf98e0132 due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599539.594754, f939fe27-017a-481e-babc-147bf98e0132 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:45:39 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] VM Resumed (Lifecycle Event)
Aug 09 16:45:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-0928839b-f305-4544-99db-a7b08e7d1528 req-259e69ab-7694-4376-b090-5ab4b851f8b9 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received event network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0928839b-f305-4544-99db-a7b08e7d1528 req-259e69ab-7694-4376-b090-5ab4b851f8b9 service nova] Acquiring lock "f939fe27-017a-481e-babc-147bf98e0132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0928839b-f305-4544-99db-a7b08e7d1528 req-259e69ab-7694-4376-b090-5ab4b851f8b9 service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0928839b-f305-4544-99db-a7b08e7d1528 req-259e69ab-7694-4376-b090-5ab4b851f8b9 service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-0928839b-f305-4544-99db-a7b08e7d1528 req-259e69ab-7694-4376-b090-5ab4b851f8b9 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] No waiting events found dispatching network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:45:39 user nova-compute[73091]: WARNING nova.compute.manager [req-0928839b-f305-4544-99db-a7b08e7d1528 req-259e69ab-7694-4376-b090-5ab4b851f8b9 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received unexpected event network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 for instance with vm_state rescued and task_state unrescuing.
Aug 09 16:45:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-0928839b-f305-4544-99db-a7b08e7d1528 req-259e69ab-7694-4376-b090-5ab4b851f8b9 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received event network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0928839b-f305-4544-99db-a7b08e7d1528 req-259e69ab-7694-4376-b090-5ab4b851f8b9 service nova] Acquiring lock "f939fe27-017a-481e-babc-147bf98e0132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0928839b-f305-4544-99db-a7b08e7d1528 req-259e69ab-7694-4376-b090-5ab4b851f8b9 service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0928839b-f305-4544-99db-a7b08e7d1528 req-259e69ab-7694-4376-b090-5ab4b851f8b9 service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-0928839b-f305-4544-99db-a7b08e7d1528 req-259e69ab-7694-4376-b090-5ab4b851f8b9 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] No waiting events found dispatching network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:45:39 user nova-compute[73091]: WARNING nova.compute.manager [req-0928839b-f305-4544-99db-a7b08e7d1528 req-259e69ab-7694-4376-b090-5ab4b851f8b9 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received unexpected event network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 for instance with vm_state rescued and task_state unrescuing.
Aug 09 16:45:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:45:39 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 16:45:39 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599539.5953639, f939fe27-017a-481e-babc-147bf98e0132 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:45:39 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] VM Started (Lifecycle Event)
Aug 09 16:45:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:45:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Successfully updated port: 4f550175-ab3c-4b43-9a63-fd5b429773f3 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:45:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "refresh_cache-b9639ddc-0ff9-41d2-b647-3af5fce945c2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:45:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquired lock "refresh_cache-b9639ddc-0ff9-41d2-b647-3af5fce945c2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:45:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:45:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-21222515-8d33-4028-94fd-78b5fae9026e req-b4019a3b-09b2-47fb-8704-f69b2f49d222 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Received event network-changed-4f550175-ab3c-4b43-9a63-fd5b429773f3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:45:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-21222515-8d33-4028-94fd-78b5fae9026e req-b4019a3b-09b2-47fb-8704-f69b2f49d222 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Refreshing instance network info cache due to event network-changed-4f550175-ab3c-4b43-9a63-fd5b429773f3. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:45:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-21222515-8d33-4028-94fd-78b5fae9026e req-b4019a3b-09b2-47fb-8704-f69b2f49d222 service nova] Acquiring lock "refresh_cache-b9639ddc-0ff9-41d2-b647-3af5fce945c2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:45:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Updating instance_info_cache with network_info: [{"id": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "address": "fa:16:3e:07:e7:b6", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f550175-ab", "ovs_interfaceid": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Releasing lock "refresh_cache-b9639ddc-0ff9-41d2-b647-3af5fce945c2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Instance network_info: |[{"id": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "address": "fa:16:3e:07:e7:b6", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f550175-ab", "ovs_interfaceid": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-21222515-8d33-4028-94fd-78b5fae9026e req-b4019a3b-09b2-47fb-8704-f69b2f49d222 service nova] Acquired lock "refresh_cache-b9639ddc-0ff9-41d2-b647-3af5fce945c2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.network.neutron [req-21222515-8d33-4028-94fd-78b5fae9026e req-b4019a3b-09b2-47fb-8704-f69b2f49d222 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Refreshing network info cache for port 4f550175-ab3c-4b43-9a63-fd5b429773f3 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Start _get_guest_xml network_info=[{"id": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "address": "fa:16:3e:07:e7:b6", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f550175-ab", "ovs_interfaceid": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:45:41 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:45:41 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:45:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1960222994',display_name='tempest-TestStampPattern-server-1960222994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1960222994',id=31,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6P3Qr1VZMAIk6RrDyvvqyhQ7LZCS0nJ47xUsRbhRFY0D/71qjjhLa1dc7eKXbzOlylR7y7dZ2Cb+Q/d0qINaFIYFTtHe5bUCqpIXOHo2fHfUg3zDl3U8Cw2AlPHLav2Q==',key_name='tempest-TestStampPattern-1375898526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c79c356957db41aaa4e38a994523ba49',ramdisk_id='',reservation_id='r-afg3qheu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1011496614',owner_user_name='tempest-TestStampPattern-1011496614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:45:38Z,user_data=None,user_id='50cd847d1eb74f15bca467f2ce19941f',uuid=b9639ddc-0ff9-41d2-b647-3af5fce945c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "address": "fa:16:3e:07:e7:b6", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f550175-ab", "ovs_interfaceid": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Converting VIF {"id": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "address": "fa:16:3e:07:e7:b6", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f550175-ab", "ovs_interfaceid": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:e7:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f550175-ab3c-4b43-9a63-fd5b429773f3,network=Network(7a19d9ac-eff2-4fff-b74e-caad307b52ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f550175-ab') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lazy-loading 'pci_devices' on Instance uuid b9639ddc-0ff9-41d2-b647-3af5fce945c2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:45:41 user nova-compute[73091]:   <uuid>b9639ddc-0ff9-41d2-b647-3af5fce945c2</uuid>
Aug 09 16:45:41 user nova-compute[73091]:   <name>instance-0000001f</name>
Aug 09 16:45:41 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:45:41 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:45:41 user nova-compute[73091]:   <metadata>
Aug 09 16:45:41 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:45:41 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:45:41 user nova-compute[73091]:       <nova:name>tempest-TestStampPattern-server-1960222994</nova:name>
Aug 09 16:45:41 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:45:41</nova:creationTime>
Aug 09 16:45:41 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:45:41 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:45:41 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:45:41 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:45:41 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:45:41 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:45:41 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:45:41 user nova-compute[73091]:       <nova:owner>
Aug 09 16:45:41 user nova-compute[73091]:         <nova:user uuid="50cd847d1eb74f15bca467f2ce19941f">tempest-TestStampPattern-1011496614-project-member</nova:user>
Aug 09 16:45:41 user nova-compute[73091]:         <nova:project uuid="c79c356957db41aaa4e38a994523ba49">tempest-TestStampPattern-1011496614</nova:project>
Aug 09 16:45:41 user nova-compute[73091]:       </nova:owner>
Aug 09 16:45:41 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:45:41 user nova-compute[73091]:       <nova:ports>
Aug 09 16:45:41 user nova-compute[73091]:         <nova:port uuid="4f550175-ab3c-4b43-9a63-fd5b429773f3">
Aug 09 16:45:41 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 16:45:41 user nova-compute[73091]:         </nova:port>
Aug 09 16:45:41 user nova-compute[73091]:       </nova:ports>
Aug 09 16:45:41 user nova-compute[73091]:     </nova:instance>
Aug 09 16:45:41 user nova-compute[73091]:   </metadata>
Aug 09 16:45:41 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:45:41 user nova-compute[73091]:     <system>
Aug 09 16:45:41 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:45:41 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:45:41 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:45:41 user nova-compute[73091]:       <entry name="serial">b9639ddc-0ff9-41d2-b647-3af5fce945c2</entry>
Aug 09 16:45:41 user nova-compute[73091]:       <entry name="uuid">b9639ddc-0ff9-41d2-b647-3af5fce945c2</entry>
Aug 09 16:45:41 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:45:41 user nova-compute[73091]:     </system>
Aug 09 16:45:41 user nova-compute[73091]:   </sysinfo>
Aug 09 16:45:41 user nova-compute[73091]:   <os>
Aug 09 16:45:41 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:45:41 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:45:41 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:45:41 user nova-compute[73091]:   </os>
Aug 09 16:45:41 user nova-compute[73091]:   <features>
Aug 09 16:45:41 user nova-compute[73091]:     <acpi/>
Aug 09 16:45:41 user nova-compute[73091]:     <apic/>
Aug 09 16:45:41 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:45:41 user nova-compute[73091]:   </features>
Aug 09 16:45:41 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:45:41 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:45:41 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:45:41 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:45:41 user nova-compute[73091]:   </clock>
Aug 09 16:45:41 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:45:41 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:45:41 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:45:41 user nova-compute[73091]:   </cpu>
Aug 09 16:45:41 user nova-compute[73091]:   <devices>
Aug 09 16:45:41 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:45:41 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:45:41 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk"/>
Aug 09 16:45:41 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:45:41 user nova-compute[73091]:     </disk>
Aug 09 16:45:41 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:45:41 user nova-compute[73091]:       <mac address="fa:16:3e:07:e7:b6"/>
Aug 09 16:45:41 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:45:41 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:45:41 user nova-compute[73091]:       <target dev="tap4f550175-ab"/>
Aug 09 16:45:41 user nova-compute[73091]:     </interface>
Aug 09 16:45:41 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:45:41 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/console.log" append="off"/>
Aug 09 16:45:41 user nova-compute[73091]:     </serial>
Aug 09 16:45:41 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:45:41 user nova-compute[73091]:     <video>
Aug 09 16:45:41 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:45:41 user nova-compute[73091]:     </video>
Aug 09 16:45:41 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:45:41 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:45:41 user nova-compute[73091]:     </rng>
Aug 09 16:45:41 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:45:41 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:45:41 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:45:41 user nova-compute[73091]:     </memballoon>
Aug 09 16:45:41 user nova-compute[73091]:   </devices>
Aug 09 16:45:41 user nova-compute[73091]: </domain>
Aug 09 16:45:41 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:45:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1960222994',display_name='tempest-TestStampPattern-server-1960222994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1960222994',id=31,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6P3Qr1VZMAIk6RrDyvvqyhQ7LZCS0nJ47xUsRbhRFY0D/71qjjhLa1dc7eKXbzOlylR7y7dZ2Cb+Q/d0qINaFIYFTtHe5bUCqpIXOHo2fHfUg3zDl3U8Cw2AlPHLav2Q==',key_name='tempest-TestStampPattern-1375898526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c79c356957db41aaa4e38a994523ba49',ramdisk_id='',reservation_id='r-afg3qheu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1011496614',owner_user_name='tempest-TestStampPattern-1011496614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:45:38Z,user_data=None,user_id='50cd847d1eb74f15bca467f2ce19941f',uuid=b9639ddc-0ff9-41d2-b647-3af5fce945c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "address": "fa:16:3e:07:e7:b6", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f550175-ab", "ovs_interfaceid": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Converting VIF {"id": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "address": "fa:16:3e:07:e7:b6", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f550175-ab", "ovs_interfaceid": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:e7:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f550175-ab3c-4b43-9a63-fd5b429773f3,network=Network(7a19d9ac-eff2-4fff-b74e-caad307b52ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f550175-ab') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG os_vif [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:e7:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f550175-ab3c-4b43-9a63-fd5b429773f3,network=Network(7a19d9ac-eff2-4fff-b74e-caad307b52ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f550175-ab') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f550175-ab, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f550175-ab, col_values=(('external_ids', {'iface-id': '4f550175-ab3c-4b43-9a63-fd5b429773f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:e7:b6', 'vm-uuid': 'b9639ddc-0ff9-41d2-b647-3af5fce945c2'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:41 user nova-compute[73091]: INFO os_vif [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:e7:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f550175-ab3c-4b43-9a63-fd5b429773f3,network=Network(7a19d9ac-eff2-4fff-b74e-caad307b52ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f550175-ab')
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] No VIF found with MAC fa:16:3e:07:e7:b6, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.network.neutron [req-21222515-8d33-4028-94fd-78b5fae9026e req-b4019a3b-09b2-47fb-8704-f69b2f49d222 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Updated VIF entry in instance network info cache for port 4f550175-ab3c-4b43-9a63-fd5b429773f3. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG nova.network.neutron [req-21222515-8d33-4028-94fd-78b5fae9026e req-b4019a3b-09b2-47fb-8704-f69b2f49d222 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Updating instance_info_cache with network_info: [{"id": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "address": "fa:16:3e:07:e7:b6", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f550175-ab", "ovs_interfaceid": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:45:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-21222515-8d33-4028-94fd-78b5fae9026e req-b4019a3b-09b2-47fb-8704-f69b2f49d222 service nova] Releasing lock "refresh_cache-b9639ddc-0ff9-41d2-b647-3af5fce945c2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:45:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-7e60916a-cf10-4e5b-98c3-18103b9d3ce9 req-16601af0-ea9c-468e-ac6c-ae4da73d30d6 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Received event network-vif-plugged-4f550175-ab3c-4b43-9a63-fd5b429773f3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:45:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7e60916a-cf10-4e5b-98c3-18103b9d3ce9 req-16601af0-ea9c-468e-ac6c-ae4da73d30d6 service nova] Acquiring lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7e60916a-cf10-4e5b-98c3-18103b9d3ce9 req-16601af0-ea9c-468e-ac6c-ae4da73d30d6 service nova] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7e60916a-cf10-4e5b-98c3-18103b9d3ce9 req-16601af0-ea9c-468e-ac6c-ae4da73d30d6 service nova] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-7e60916a-cf10-4e5b-98c3-18103b9d3ce9 req-16601af0-ea9c-468e-ac6c-ae4da73d30d6 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] No waiting events found dispatching network-vif-plugged-4f550175-ab3c-4b43-9a63-fd5b429773f3 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:45:43 user nova-compute[73091]: WARNING nova.compute.manager [req-7e60916a-cf10-4e5b-98c3-18103b9d3ce9 req-16601af0-ea9c-468e-ac6c-ae4da73d30d6 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Received unexpected event network-vif-plugged-4f550175-ab3c-4b43-9a63-fd5b429773f3 for instance with vm_state building and task_state spawning.
Aug 09 16:45:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599545.3541212, b9639ddc-0ff9-41d2-b647-3af5fce945c2 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:45:45 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] VM Resumed (Lifecycle Event)
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:45:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Instance spawned successfully.
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:45:45 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599545.3583088, b9639ddc-0ff9-41d2-b647-3af5fce945c2 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:45:45 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] VM Started (Lifecycle Event)
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-233c21c7-a05c-4aa3-9fbe-1c4d30d51bbb req-f424c1ad-15b0-4d95-9c52-70be5bc4278f service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Received event network-vif-plugged-4f550175-ab3c-4b43-9a63-fd5b429773f3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-233c21c7-a05c-4aa3-9fbe-1c4d30d51bbb req-f424c1ad-15b0-4d95-9c52-70be5bc4278f service nova] Acquiring lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-233c21c7-a05c-4aa3-9fbe-1c4d30d51bbb req-f424c1ad-15b0-4d95-9c52-70be5bc4278f service nova] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-233c21c7-a05c-4aa3-9fbe-1c4d30d51bbb req-f424c1ad-15b0-4d95-9c52-70be5bc4278f service nova] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-233c21c7-a05c-4aa3-9fbe-1c4d30d51bbb req-f424c1ad-15b0-4d95-9c52-70be5bc4278f service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] No waiting events found dispatching network-vif-plugged-4f550175-ab3c-4b43-9a63-fd5b429773f3 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:45:45 user nova-compute[73091]: WARNING nova.compute.manager [req-233c21c7-a05c-4aa3-9fbe-1c4d30d51bbb req-f424c1ad-15b0-4d95-9c52-70be5bc4278f service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Received unexpected event network-vif-plugged-4f550175-ab3c-4b43-9a63-fd5b429773f3 for instance with vm_state building and task_state spawning.
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:45:45 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:45:45 user nova-compute[73091]: INFO nova.compute.manager [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Took 7.10 seconds to spawn the instance on the hypervisor.
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:45:45 user nova-compute[73091]: INFO nova.compute.manager [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Took 7.94 seconds to build instance.
Aug 09 16:45:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1a4f657a-e0c8-4068-b0d4-d317a8467e73 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.044s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:45:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Creating image(s)
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Ensure instance console log exists: /opt/stack/data/nova/instances/97af1277-b4bd-4a89-903b-4f70087f0535/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Start _get_guest_xml network_info=[{"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'ee824c61-fa22-490f-b46e-c4a8dd3421ac', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hztVspoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '97af1277-b4bd-4a89-903b-4f70087f0535', 'attached_at': '', 'detached_at': '', 'volume_id': '35539ace-9cd8-4004-bdba-ccd3d56a7628', 'serial': '35539ace-9cd8-4004-bdba-ccd3d56a7628'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:45:45 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:45:45 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hztVspoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:45:45 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:45:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:45:45 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:45:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:45:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:45:45 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:45:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6848f45f-79a7-48b3-8ddc-4dee59461186]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:45:46 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbddd86-0e69-4ca8-98a6-8358cabd3add]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628] added
Aug 09 16:45:46 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d96602-7226-4299-b526-1ba7909e7bd9]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ddb29e-2bb3-48d0-a512-df589ecfc546]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hztVspoH {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hztVspoH" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dbde4f-25ff-4a1e-8e19-841472b7cb6f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hztVspoH'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c66f717-b30c-4cec-ad0d-c112b7954164]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15d9a5d-0b1f-4f83-bd0f-a8a812a7ca58]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:45:46 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:45:46 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:45:46 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 (non-flash)
Aug 09 16:45:46 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:45:46 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:45:46 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:45:46 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 (non-flash)
Aug 09 16:45:46 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c007444-113f-4c67-a445-b9e1beee2ae5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628, portal: 172.16.0.220,3260]
Aug 09 16:45:46 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628, portal: 172.16.0.220,3260] successful.
Aug 09 16:45:46 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bfbf89-c4d0-4026-84fa-0e86b473d9da]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9f34a0-a619-461a-a317-895d2afdd93d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:45:46 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:45:46 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:45:46 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 (non-flash)
Aug 09 16:45:46 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:45:46 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:45:46 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:45:46 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:45:46 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 (non-flash)
Aug 09 16:45:46 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:45:46 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[decd81d5-3819-4b6d-a856-856a0d86c449]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:45:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hztVspoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26430616535373835', 'path': '/dev/sdf'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430616535373835', 'path': '/dev/sdf'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-946441557',display_name='tempest-ServerActionsTestOtherA-server-946441557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-946441557',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILfado63mW6+CgjHmwYiNct4RkaQ/hFrQzjzGZX9fcd5tmDChxbl9riU31kjgrW3xhMcxzy/FY8sPsumtyuqQ7ittcRZasxYBvL6XWrt/5jr8BpeJz8IvTq6jqpzExzYw==',key_name='tempest-keypair-1434010925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38c913ceef2c4610a26bd19df29ee896',ramdisk_id='',reservation_id='r-yjp8agt5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-813213856',owner_user_name='tempest-ServerActionsTestOtherA-813213856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:45:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8956fad221ec4dedb700f034d5230c06',uuid=97af1277-b4bd-4a89-903b-4f70087f0535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converting VIF {"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:07:07,bridge_name='br-int',has_traffic_filtering=True,id=a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ff67fb-2a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG nova.objects.instance [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lazy-loading 'pci_devices' on Instance uuid 97af1277-b4bd-4a89-903b-4f70087f0535 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:45:47 user nova-compute[73091]:   <uuid>97af1277-b4bd-4a89-903b-4f70087f0535</uuid>
Aug 09 16:45:47 user nova-compute[73091]:   <name>instance-0000001e</name>
Aug 09 16:45:47 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:45:47 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:45:47 user nova-compute[73091]:   <metadata>
Aug 09 16:45:47 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:45:47 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:45:47 user nova-compute[73091]:       <nova:name>tempest-ServerActionsTestOtherA-server-946441557</nova:name>
Aug 09 16:45:47 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:45:45</nova:creationTime>
Aug 09 16:45:47 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:45:47 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:45:47 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:45:47 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:45:47 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:45:47 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:45:47 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:45:47 user nova-compute[73091]:       <nova:owner>
Aug 09 16:45:47 user nova-compute[73091]:         <nova:user uuid="8956fad221ec4dedb700f034d5230c06">tempest-ServerActionsTestOtherA-813213856-project-member</nova:user>
Aug 09 16:45:47 user nova-compute[73091]:         <nova:project uuid="38c913ceef2c4610a26bd19df29ee896">tempest-ServerActionsTestOtherA-813213856</nova:project>
Aug 09 16:45:47 user nova-compute[73091]:       </nova:owner>
Aug 09 16:45:47 user nova-compute[73091]:       <nova:ports>
Aug 09 16:45:47 user nova-compute[73091]:         <nova:port uuid="a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca">
Aug 09 16:45:47 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 16:45:47 user nova-compute[73091]:         </nova:port>
Aug 09 16:45:47 user nova-compute[73091]:       </nova:ports>
Aug 09 16:45:47 user nova-compute[73091]:     </nova:instance>
Aug 09 16:45:47 user nova-compute[73091]:   </metadata>
Aug 09 16:45:47 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:45:47 user nova-compute[73091]:     <system>
Aug 09 16:45:47 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:45:47 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:45:47 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:45:47 user nova-compute[73091]:       <entry name="serial">97af1277-b4bd-4a89-903b-4f70087f0535</entry>
Aug 09 16:45:47 user nova-compute[73091]:       <entry name="uuid">97af1277-b4bd-4a89-903b-4f70087f0535</entry>
Aug 09 16:45:47 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:45:47 user nova-compute[73091]:     </system>
Aug 09 16:45:47 user nova-compute[73091]:   </sysinfo>
Aug 09 16:45:47 user nova-compute[73091]:   <os>
Aug 09 16:45:47 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:45:47 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:45:47 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:45:47 user nova-compute[73091]:   </os>
Aug 09 16:45:47 user nova-compute[73091]:   <features>
Aug 09 16:45:47 user nova-compute[73091]:     <acpi/>
Aug 09 16:45:47 user nova-compute[73091]:     <apic/>
Aug 09 16:45:47 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:45:47 user nova-compute[73091]:   </features>
Aug 09 16:45:47 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:45:47 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:45:47 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:45:47 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:45:47 user nova-compute[73091]:   </clock>
Aug 09 16:45:47 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:45:47 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:45:47 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:45:47 user nova-compute[73091]:   </cpu>
Aug 09 16:45:47 user nova-compute[73091]:   <devices>
Aug 09 16:45:47 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:45:47 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:45:47 user nova-compute[73091]:       <source dev="/dev/sdf"/>
Aug 09 16:45:47 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:45:47 user nova-compute[73091]:       <serial>35539ace-9cd8-4004-bdba-ccd3d56a7628</serial>
Aug 09 16:45:47 user nova-compute[73091]:     </disk>
Aug 09 16:45:47 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:45:47 user nova-compute[73091]:       <mac address="fa:16:3e:d1:07:07"/>
Aug 09 16:45:47 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:45:47 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:45:47 user nova-compute[73091]:       <target dev="tapa0ff67fb-2a"/>
Aug 09 16:45:47 user nova-compute[73091]:     </interface>
Aug 09 16:45:47 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:45:47 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/97af1277-b4bd-4a89-903b-4f70087f0535/console.log" append="off"/>
Aug 09 16:45:47 user nova-compute[73091]:     </serial>
Aug 09 16:45:47 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:45:47 user nova-compute[73091]:     <video>
Aug 09 16:45:47 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:45:47 user nova-compute[73091]:     </video>
Aug 09 16:45:47 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:45:47 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:45:47 user nova-compute[73091]:     </rng>
Aug 09 16:45:47 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:45:47 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:45:47 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:45:47 user nova-compute[73091]:     </memballoon>
Aug 09 16:45:47 user nova-compute[73091]:   </devices>
Aug 09 16:45:47 user nova-compute[73091]: </domain>
Aug 09 16:45:47 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-946441557',display_name='tempest-ServerActionsTestOtherA-server-946441557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-946441557',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILfado63mW6+CgjHmwYiNct4RkaQ/hFrQzjzGZX9fcd5tmDChxbl9riU31kjgrW3xhMcxzy/FY8sPsumtyuqQ7ittcRZasxYBvL6XWrt/5jr8BpeJz8IvTq6jqpzExzYw==',key_name='tempest-keypair-1434010925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38c913ceef2c4610a26bd19df29ee896',ramdisk_id='',reservation_id='r-yjp8agt5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-813213856',owner_user_name='tempest-ServerActionsTestOtherA-813213856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:45:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8956fad221ec4dedb700f034d5230c06',uuid=97af1277-b4bd-4a89-903b-4f70087f0535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converting VIF {"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:07:07,bridge_name='br-int',has_traffic_filtering=True,id=a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ff67fb-2a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG os_vif [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:07:07,bridge_name='br-int',has_traffic_filtering=True,id=a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ff67fb-2a') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0ff67fb-2a, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0ff67fb-2a, col_values=(('external_ids', {'iface-id': 'a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:07:07', 'vm-uuid': '97af1277-b4bd-4a89-903b-4f70087f0535'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:47 user nova-compute[73091]: INFO os_vif [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:07:07,bridge_name='br-int',has_traffic_filtering=True,id=a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ff67fb-2a')
Aug 09 16:45:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:45:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] No VIF found with MAC fa:16:3e:d1:07:07, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:45:48 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599533.5202389, 38051bca-7190-4dff-91d1-3d99b4e4182b => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:45:48 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] VM Stopped (Lifecycle Event)
Aug 09 16:45:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-052bc543-2475-4e0d-a03a-f0edf4daf409 None None] [instance: 38051bca-7190-4dff-91d1-3d99b4e4182b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:45:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-322ddd69-a6fe-471f-a4c9-6231b4c784f3 req-346659ee-462e-4f61-ac0d-e3158d526993 service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Received event network-vif-plugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:45:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-322ddd69-a6fe-471f-a4c9-6231b4c784f3 req-346659ee-462e-4f61-ac0d-e3158d526993 service nova] Acquiring lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-322ddd69-a6fe-471f-a4c9-6231b4c784f3 req-346659ee-462e-4f61-ac0d-e3158d526993 service nova] Lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-322ddd69-a6fe-471f-a4c9-6231b4c784f3 req-346659ee-462e-4f61-ac0d-e3158d526993 service nova] Lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-322ddd69-a6fe-471f-a4c9-6231b4c784f3 req-346659ee-462e-4f61-ac0d-e3158d526993 service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] No waiting events found dispatching network-vif-plugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:45:49 user nova-compute[73091]: WARNING nova.compute.manager [req-322ddd69-a6fe-471f-a4c9-6231b4c784f3 req-346659ee-462e-4f61-ac0d-e3158d526993 service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Received unexpected event network-vif-plugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca for instance with vm_state building and task_state spawning.
Aug 09 16:45:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-c319ff1c-fdf9-4053-87dd-ce532b2baed1 req-5329aeb2-f436-4ba9-9f46-26bb7c125d6a service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Received event network-vif-plugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:45:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c319ff1c-fdf9-4053-87dd-ce532b2baed1 req-5329aeb2-f436-4ba9-9f46-26bb7c125d6a service nova] Acquiring lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:45:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c319ff1c-fdf9-4053-87dd-ce532b2baed1 req-5329aeb2-f436-4ba9-9f46-26bb7c125d6a service nova] Lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:45:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c319ff1c-fdf9-4053-87dd-ce532b2baed1 req-5329aeb2-f436-4ba9-9f46-26bb7c125d6a service nova] Lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-c319ff1c-fdf9-4053-87dd-ce532b2baed1 req-5329aeb2-f436-4ba9-9f46-26bb7c125d6a service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] No waiting events found dispatching network-vif-plugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:45:51 user nova-compute[73091]: WARNING nova.compute.manager [req-c319ff1c-fdf9-4053-87dd-ce532b2baed1 req-5329aeb2-f436-4ba9-9f46-26bb7c125d6a service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Received unexpected event network-vif-plugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca for instance with vm_state building and task_state spawning.
Aug 09 16:45:51 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599551.1880667, 97af1277-b4bd-4a89-903b-4f70087f0535 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:45:51 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] VM Resumed (Lifecycle Event)
Aug 09 16:45:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:45:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:45:51 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Instance spawned successfully.
Aug 09 16:45:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:45:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:45:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:45:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:45:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:45:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:45:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:45:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:45:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:45:51 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:45:51 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599551.188349, 97af1277-b4bd-4a89-903b-4f70087f0535 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:45:51 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] VM Started (Lifecycle Event)
Aug 09 16:45:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:45:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:45:51 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:45:51 user nova-compute[73091]: INFO nova.compute.manager [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Took 5.44 seconds to spawn the instance on the hypervisor.
Aug 09 16:45:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:45:51 user nova-compute[73091]: INFO nova.compute.manager [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Took 19.64 seconds to build instance.
Aug 09 16:45:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af298e0a-053e-495e-8497-3a6751b09275 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "97af1277-b4bd-4a89-903b-4f70087f0535" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.747s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:45:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:45:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:10 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:46:10 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:46:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:46:11 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:46:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:46:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-f939fe27-017a-481e-babc-147bf98e0132" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:46:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-f939fe27-017a-481e-babc-147bf98e0132" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:46:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:46:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] Updating instance_info_cache with network_info: [{"id": "c830ef2e-da54-4321-905f-845e0440a759", "address": "fa:16:3e:b5:68:3c", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc830ef2e-da", "ovs_interfaceid": "c830ef2e-da54-4321-905f-845e0440a759", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:46:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-f939fe27-017a-481e-babc-147bf98e0132" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:46:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:46:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:46:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:46:14 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:46:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:15 user nova-compute[73091]: INFO nova.compute.manager [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Terminating instance
Aug 09 16:46:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-5b7b610a-0662-49a4-8825-cd5487d27334 req-5d8ca988-8475-49d4-b4c8-d93dc4d9618b service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received event network-vif-unplugged-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5b7b610a-0662-49a4-8825-cd5487d27334 req-5d8ca988-8475-49d4-b4c8-d93dc4d9618b service nova] Acquiring lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5b7b610a-0662-49a4-8825-cd5487d27334 req-5d8ca988-8475-49d4-b4c8-d93dc4d9618b service nova] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5b7b610a-0662-49a4-8825-cd5487d27334 req-5d8ca988-8475-49d4-b4c8-d93dc4d9618b service nova] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-5b7b610a-0662-49a4-8825-cd5487d27334 req-5d8ca988-8475-49d4-b4c8-d93dc4d9618b service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] No waiting events found dispatching network-vif-unplugged-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-5b7b610a-0662-49a4-8825-cd5487d27334 req-5d8ca988-8475-49d4-b4c8-d93dc4d9618b service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received event network-vif-unplugged-2d1a984c-9df8-49a7-9460-bee934ea307f for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:46:15 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Instance destroyed successfully.
Aug 09 16:46:15 user nova-compute[73091]: DEBUG nova.objects.instance [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lazy-loading 'resources' on Instance uuid f8f52e24-8ce5-4128-a2aa-afc68ceb7213 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2111103488',display_name='tempest-TestMinimumBasicScenario-server-2111103488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2111103488',id=23,image_ref='7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4fcOiauymPg1Mn6EtQBUS6MQJ73JOzdMcX2vEpkzNb6cuhSFoEA59T/46bifiCrBZbHeOerT/inFpaPvwCybY3FALz6D+iNcGrn55JR/YB/RfNu/DBpwIJEcdSqkNNXQ==',key_name='tempest-TestMinimumBasicScenario-488048769',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:41:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e1ecfa8609840b1950ed8563bd427d1',ramdisk_id='',reservation_id='r-e4yztxi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7aabc7ff-9c50-44a4-bab1-fc6c417ec3a1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-51921820',owner_user_name='tempest-TestMinimumBasicScenario-51921820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:43:33Z,user_data=None,user_id='d6652e0ef40d4e26b67628d261f2848e',uuid=f8f52e24-8ce5-4128-a2aa-afc68ceb7213,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Converting VIF {"id": "2d1a984c-9df8-49a7-9460-bee934ea307f", "address": "fa:16:3e:c8:8c:6d", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d1a984c-9d", "ovs_interfaceid": "2d1a984c-9df8-49a7-9460-bee934ea307f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:8c:6d,bridge_name='br-int',has_traffic_filtering=True,id=2d1a984c-9df8-49a7-9460-bee934ea307f,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d1a984c-9d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG os_vif [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:8c:6d,bridge_name='br-int',has_traffic_filtering=True,id=2d1a984c-9df8-49a7-9460-bee934ea307f,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d1a984c-9d') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d1a984c-9d, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:46:15 user nova-compute[73091]: INFO os_vif [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:8c:6d,bridge_name='br-int',has_traffic_filtering=True,id=2d1a984c-9df8-49a7-9460-bee934ea307f,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d1a984c-9d')
Aug 09 16:46:15 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Deleting instance files /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213_del
Aug 09 16:46:15 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Deletion of /opt/stack/data/nova/instances/f8f52e24-8ce5-4128-a2aa-afc68ceb7213_del complete
Aug 09 16:46:16 user nova-compute[73091]: INFO nova.compute.manager [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 16:46:16 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-31b847d1-968d-4739-8d11-84ec74091af4 req-6578d0c4-b3a8-4fe7-8014-1cfdbdd94e1e service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Received event network-changed-3d66a718-971e-4e64-80f3-d57b2b6364dc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-31b847d1-968d-4739-8d11-84ec74091af4 req-6578d0c4-b3a8-4fe7-8014-1cfdbdd94e1e service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Refreshing instance network info cache due to event network-changed-3d66a718-971e-4e64-80f3-d57b2b6364dc. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-31b847d1-968d-4739-8d11-84ec74091af4 req-6578d0c4-b3a8-4fe7-8014-1cfdbdd94e1e service nova] Acquiring lock "refresh_cache-da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-31b847d1-968d-4739-8d11-84ec74091af4 req-6578d0c4-b3a8-4fe7-8014-1cfdbdd94e1e service nova] Acquired lock "refresh_cache-da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-31b847d1-968d-4739-8d11-84ec74091af4 req-6578d0c4-b3a8-4fe7-8014-1cfdbdd94e1e service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Refreshing network info cache for port 3d66a718-971e-4e64-80f3-d57b2b6364dc {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:46:16 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Took 0.84 seconds to deallocate network for instance.
Aug 09 16:46:16 user nova-compute[73091]: INFO nova.compute.manager [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Terminating instance
Aug 09 16:46:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-b5df1496-fcf4-434e-b25c-45d2abe5cee0 req-909ef9c7-c563-4d58-9932-61339850fd55 service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received event network-vif-deleted-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-31b847d1-968d-4739-8d11-84ec74091af4 req-6578d0c4-b3a8-4fe7-8014-1cfdbdd94e1e service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Updated VIF entry in instance network info cache for port 3d66a718-971e-4e64-80f3-d57b2b6364dc. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-31b847d1-968d-4739-8d11-84ec74091af4 req-6578d0c4-b3a8-4fe7-8014-1cfdbdd94e1e service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Updating instance_info_cache with network_info: [{"id": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "address": "fa:16:3e:b5:27:09", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66a718-97", "ovs_interfaceid": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-31b847d1-968d-4739-8d11-84ec74091af4 req-6578d0c4-b3a8-4fe7-8014-1cfdbdd94e1e service nova] Releasing lock "refresh_cache-da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:17 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Deleted allocations for instance f8f52e24-8ce5-4128-a2aa-afc68ceb7213
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-210ceced-ef69-4d6b-92ab-b85aa5defbb3 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.372s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-3adbe6e2-cbf4-4db7-bebb-77f02f765e93 req-bacce98e-db7a-4d25-9858-b1347b6710eb service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received event network-vif-plugged-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3adbe6e2-cbf4-4db7-bebb-77f02f765e93 req-bacce98e-db7a-4d25-9858-b1347b6710eb service nova] Acquiring lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3adbe6e2-cbf4-4db7-bebb-77f02f765e93 req-bacce98e-db7a-4d25-9858-b1347b6710eb service nova] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3adbe6e2-cbf4-4db7-bebb-77f02f765e93 req-bacce98e-db7a-4d25-9858-b1347b6710eb service nova] Lock "f8f52e24-8ce5-4128-a2aa-afc68ceb7213-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-3adbe6e2-cbf4-4db7-bebb-77f02f765e93 req-bacce98e-db7a-4d25-9858-b1347b6710eb service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] No waiting events found dispatching network-vif-plugged-2d1a984c-9df8-49a7-9460-bee934ea307f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:46:17 user nova-compute[73091]: WARNING nova.compute.manager [req-3adbe6e2-cbf4-4db7-bebb-77f02f765e93 req-bacce98e-db7a-4d25-9858-b1347b6710eb service nova] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Received unexpected event network-vif-plugged-2d1a984c-9df8-49a7-9460-bee934ea307f for instance with vm_state deleted and task_state None.
Aug 09 16:46:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Instance destroyed successfully.
Aug 09 16:46:17 user nova-compute[73091]: DEBUG nova.objects.instance [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lazy-loading 'resources' on Instance uuid da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1680178947',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1680178947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1680178947',id=28,image_ref='0ffe9f2b-0fc7-407d-b09d-5770d50f6516',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzG5tw9UiRuKU2qFWQJ4z3/C8wD09/2CACmqWtwf/rB9ZQeS5mkjiNLhXWJ4mnXsjg7nsBXJVUnEVsXcgol/T77KM2MhvE8rHzZyx16lR2J52wNbR0+4O5wNPPvEnC40Q==',key_name='tempest-keypair-1930942646',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:44:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64d3dfd232d54594808dad271baa5192',ramdisk_id='',reservation_id='r-bmxyqwh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1605875873',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1605875873',owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69ccebf0e9d54502a2318c809ce11369',uuid=da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "address": "fa:16:3e:b5:27:09", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66a718-97", "ovs_interfaceid": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converting VIF {"id": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "address": "fa:16:3e:b5:27:09", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66a718-97", "ovs_interfaceid": "3d66a718-971e-4e64-80f3-d57b2b6364dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:27:09,bridge_name='br-int',has_traffic_filtering=True,id=3d66a718-971e-4e64-80f3-d57b2b6364dc,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d66a718-97') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG os_vif [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:27:09,bridge_name='br-int',has_traffic_filtering=True,id=3d66a718-971e-4e64-80f3-d57b2b6364dc,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d66a718-97') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d66a718-97, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:46:17 user nova-compute[73091]: INFO os_vif [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:27:09,bridge_name='br-int',has_traffic_filtering=True,id=3d66a718-971e-4e64-80f3-d57b2b6364dc,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d66a718-97')
Aug 09 16:46:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaPOjGRb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:46:17 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:46:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d08775-090f-40da-8035-8e5e5b02fb2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa746a0-8b1e-423f-bc18-3076bdfc37ef]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:46:17 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:46:17 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:46:17 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 (non-flash)
Aug 09 16:46:17 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:46:17 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:46:17 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:46:17 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:46:17 user nova-compute[73091]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 (non-flash)
Aug 09 16:46:17 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:46:17 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff080129a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca77558c-30b4-4859-8234-268ad1aa682a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[986ac216-d8e4-47cb-9a26-073151cdfbb6]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[29abd64e-f4cf-4630-8b8a-b620aef470a3]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aeaf820-52f4-4399-86ca-682d74dd59d4]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b21af65-48ef-47c6-9e1f-c35eef1d710b]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:46:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60fbd0f-12d1-4a82-8f08-c99bef5c424d]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0, portal: 172.16.0.220,3260]
Aug 09 16:46:18 user nova-compute[73091]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0, portal: 172.16.0.220,3260] successful.
Aug 09 16:46:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf5f97c-b804-4b42-ac30-184a6698f5e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[27229f1c-790f-4765-833f-5181ef061436]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] <== disconnect_volume: return (359ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:46:18 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Deleting instance files /opt/stack/data/nova/instances/da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8_del
Aug 09 16:46:18 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Deletion of /opt/stack/data/nova/instances/da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8_del complete
Aug 09 16:46:18 user nova-compute[73091]: INFO nova.compute.manager [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:18 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Error from libvirt while getting description of instance-0000001c: [Error Code 42] Domain not found: no domain with matching uuid 'da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8' (instance-0000001c): libvirt.libvirtError: Domain not found: no domain with matching uuid 'da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8' (instance-0000001c)
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-b54fc7c2-7291-4957-9c06-48e2f983b831 req-44121252-69fd-4592-9d87-0d65fdac7a16 service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Received event network-vif-unplugged-3d66a718-971e-4e64-80f3-d57b2b6364dc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b54fc7c2-7291-4957-9c06-48e2f983b831 req-44121252-69fd-4592-9d87-0d65fdac7a16 service nova] Acquiring lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b54fc7c2-7291-4957-9c06-48e2f983b831 req-44121252-69fd-4592-9d87-0d65fdac7a16 service nova] Lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b54fc7c2-7291-4957-9c06-48e2f983b831 req-44121252-69fd-4592-9d87-0d65fdac7a16 service nova] Lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-b54fc7c2-7291-4957-9c06-48e2f983b831 req-44121252-69fd-4592-9d87-0d65fdac7a16 service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] No waiting events found dispatching network-vif-unplugged-3d66a718-971e-4e64-80f3-d57b2b6364dc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-b54fc7c2-7291-4957-9c06-48e2f983b831 req-44121252-69fd-4592-9d87-0d65fdac7a16 service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Received event network-vif-unplugged-3d66a718-971e-4e64-80f3-d57b2b6364dc for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-b54fc7c2-7291-4957-9c06-48e2f983b831 req-44121252-69fd-4592-9d87-0d65fdac7a16 service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Received event network-vif-plugged-3d66a718-971e-4e64-80f3-d57b2b6364dc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b54fc7c2-7291-4957-9c06-48e2f983b831 req-44121252-69fd-4592-9d87-0d65fdac7a16 service nova] Acquiring lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b54fc7c2-7291-4957-9c06-48e2f983b831 req-44121252-69fd-4592-9d87-0d65fdac7a16 service nova] Lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b54fc7c2-7291-4957-9c06-48e2f983b831 req-44121252-69fd-4592-9d87-0d65fdac7a16 service nova] Lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-b54fc7c2-7291-4957-9c06-48e2f983b831 req-44121252-69fd-4592-9d87-0d65fdac7a16 service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] No waiting events found dispatching network-vif-plugged-3d66a718-971e-4e64-80f3-d57b2b6364dc {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:46:18 user nova-compute[73091]: WARNING nova.compute.manager [req-b54fc7c2-7291-4957-9c06-48e2f983b831 req-44121252-69fd-4592-9d87-0d65fdac7a16 service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Received unexpected event network-vif-plugged-3d66a718-971e-4e64-80f3-d57b2b6364dc for instance with vm_state active and task_state deleting.
Aug 09 16:46:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:19 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:46:19 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Took 1.02 seconds to deallocate network for instance.
Aug 09 16:46:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:46:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:19 user nova-compute[73091]: INFO nova.compute.manager [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Took 0.80 seconds to detach 1 volumes for instance.
Aug 09 16:46:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Deleting volume: bbf5f97c-b804-4b42-ac30-184a6698f5e0 {{(pid=73091) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 16:46:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:46:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:20 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:46:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:46:20 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:46:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:20 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Deleted allocations for instance da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8
Aug 09 16:46:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:46:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-73c67aa4-4179-46b5-9940-2c21d547f517 req-839ebdea-3fb1-4871-94d6-ab7117825587 service nova] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Received event network-vif-deleted-3d66a718-971e-4e64-80f3-d57b2b6364dc {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:46:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-22c17b28-60fd-4c79-9370-3f7d6db52882 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.260s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:21 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:46:21 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:46:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7148MB free_disk=25.251022338867188GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:46:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:46:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f939fe27-017a-481e-babc-147bf98e0132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:46:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8fc884a8-24bb-488a-baeb-ef2b1faf239d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:46:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 68d63bc2-d726-49d8-91de-bc5cc66bb119 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:46:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 148cb211-b2f6-4782-8f35-e66a55cc95bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:46:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 4a39f479-265c-49c3-86c4-a65fff2f06c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:46:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance e03ff609-e74d-427d-b6e6-109fbee09e40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:46:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f81e99b2-580f-43fa-b74d-84ad7764b64f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:46:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 97af1277-b4bd-4a89-903b-4f70087f0535 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:46:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance b9639ddc-0ff9-41d2-b647-3af5fce945c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:46:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:46:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:46:21 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:46:21 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:46:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:46:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:22 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:46:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "e03ff609-e74d-427d-b6e6-109fbee09e40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:25 user nova-compute[73091]: INFO nova.compute.manager [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Terminating instance
Aug 09 16:46:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:46:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-d11361ab-d98f-4085-a19f-374e4811cbbe req-1d2d6241-2c0a-4cd5-ac05-923108e96a24 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received event network-vif-unplugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:46:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d11361ab-d98f-4085-a19f-374e4811cbbe req-1d2d6241-2c0a-4cd5-ac05-923108e96a24 service nova] Acquiring lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d11361ab-d98f-4085-a19f-374e4811cbbe req-1d2d6241-2c0a-4cd5-ac05-923108e96a24 service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d11361ab-d98f-4085-a19f-374e4811cbbe req-1d2d6241-2c0a-4cd5-ac05-923108e96a24 service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-d11361ab-d98f-4085-a19f-374e4811cbbe req-1d2d6241-2c0a-4cd5-ac05-923108e96a24 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] No waiting events found dispatching network-vif-unplugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:46:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-d11361ab-d98f-4085-a19f-374e4811cbbe req-1d2d6241-2c0a-4cd5-ac05-923108e96a24 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received event network-vif-unplugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:46:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Instance destroyed successfully.
Aug 09 16:46:26 user nova-compute[73091]: DEBUG nova.objects.instance [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lazy-loading 'resources' on Instance uuid e03ff609-e74d-427d-b6e6-109fbee09e40 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:46:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T16:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-631186991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-631186991',id=22,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNf3A+5Z7pIEBlhzfnQHoxgivCxTPlvm/huyNXliMpXw073U0iPJQNiNLgMagYal2KPG1QBF641Llp0BRSjbgXgq3B8bIM/yGSRax/YnqZ6VB4oH6+6U8bfE9BQdhXTbjQ==',key_name='tempest-keypair-767621827',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:44:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8000a47d82748ce8d43d306682d62c6',ramdisk_id='',reservation_id='r-kkx3fv25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1451982310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1451982310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='343ec5734ef547f292ee631dbb272359',uuid=e03ff609-e74d-427d-b6e6-109fbee09e40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:46:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converting VIF {"id": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "address": "fa:16:3e:3a:ea:23", "network": {"id": "a9eff2a5-0b72-46bc-a0e3-22694490dcaf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-144274818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8000a47d82748ce8d43d306682d62c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ad4923-b2", "ovs_interfaceid": "78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:46:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ea:23,bridge_name='br-int',has_traffic_filtering=True,id=78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ad4923-b2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:46:26 user nova-compute[73091]: DEBUG os_vif [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ea:23,bridge_name='br-int',has_traffic_filtering=True,id=78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ad4923-b2') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:46:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78ad4923-b2, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:46:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:46:26 user nova-compute[73091]: INFO os_vif [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ea:23,bridge_name='br-int',has_traffic_filtering=True,id=78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8,network=Network(a9eff2a5-0b72-46bc-a0e3-22694490dcaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ad4923-b2')
Aug 09 16:46:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Deleting instance files /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40_del
Aug 09 16:46:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Deletion of /opt/stack/data/nova/instances/e03ff609-e74d-427d-b6e6-109fbee09e40_del complete
Aug 09 16:46:26 user nova-compute[73091]: INFO nova.compute.manager [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 09 16:46:26 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:46:26 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:46:26 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:46:26 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:46:26 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Took 0.84 seconds to deallocate network for instance.
Aug 09 16:46:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-ab655f0c-fd4a-4ab0-a3da-db4e1eb34b07 req-9e87fa51-5433-4c91-b3a3-6ac506b7fb6d service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received event network-vif-deleted-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:46:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:27 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:46:27 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:46:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:27 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Deleted allocations for instance e03ff609-e74d-427d-b6e6-109fbee09e40
Aug 09 16:46:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-577e7385-a87b-4348-a6df-7dcdc8d0f392 tempest-AttachVolumeShelveTestJSON-1451982310 tempest-AttachVolumeShelveTestJSON-1451982310-project-member] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.200s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-d797af21-8ea5-4f0c-90a8-20f551031d78 req-bdf005b1-45a2-4eac-8be7-9540ffb76656 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received event network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:46:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d797af21-8ea5-4f0c-90a8-20f551031d78 req-bdf005b1-45a2-4eac-8be7-9540ffb76656 service nova] Acquiring lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d797af21-8ea5-4f0c-90a8-20f551031d78 req-bdf005b1-45a2-4eac-8be7-9540ffb76656 service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d797af21-8ea5-4f0c-90a8-20f551031d78 req-bdf005b1-45a2-4eac-8be7-9540ffb76656 service nova] Lock "e03ff609-e74d-427d-b6e6-109fbee09e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-d797af21-8ea5-4f0c-90a8-20f551031d78 req-bdf005b1-45a2-4eac-8be7-9540ffb76656 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] No waiting events found dispatching network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:46:27 user nova-compute[73091]: WARNING nova.compute.manager [req-d797af21-8ea5-4f0c-90a8-20f551031d78 req-bdf005b1-45a2-4eac-8be7-9540ffb76656 service nova] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Received unexpected event network-vif-plugged-78ad4923-b2bc-4cfd-8cd9-5a44e5d46eb8 for instance with vm_state deleted and task_state None.
Aug 09 16:46:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-5cc330c8-09ce-4262-998f-f7ab545dcc45 req-8dfa2090-b669-4248-8a14-bcba0c605b9c service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Received event network-changed-af939b86-9ea1-46d6-8d42-e6171ca189c5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:46:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-5cc330c8-09ce-4262-998f-f7ab545dcc45 req-8dfa2090-b669-4248-8a14-bcba0c605b9c service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Refreshing instance network info cache due to event network-changed-af939b86-9ea1-46d6-8d42-e6171ca189c5. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:46:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5cc330c8-09ce-4262-998f-f7ab545dcc45 req-8dfa2090-b669-4248-8a14-bcba0c605b9c service nova] Acquiring lock "refresh_cache-f81e99b2-580f-43fa-b74d-84ad7764b64f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:46:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5cc330c8-09ce-4262-998f-f7ab545dcc45 req-8dfa2090-b669-4248-8a14-bcba0c605b9c service nova] Acquired lock "refresh_cache-f81e99b2-580f-43fa-b74d-84ad7764b64f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:46:29 user nova-compute[73091]: DEBUG nova.network.neutron [req-5cc330c8-09ce-4262-998f-f7ab545dcc45 req-8dfa2090-b669-4248-8a14-bcba0c605b9c service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Refreshing network info cache for port af939b86-9ea1-46d6-8d42-e6171ca189c5 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:46:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "f81e99b2-580f-43fa-b74d-84ad7764b64f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "f81e99b2-580f-43fa-b74d-84ad7764b64f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "f81e99b2-580f-43fa-b74d-84ad7764b64f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "f81e99b2-580f-43fa-b74d-84ad7764b64f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "f81e99b2-580f-43fa-b74d-84ad7764b64f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:30 user nova-compute[73091]: INFO nova.compute.manager [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Terminating instance
Aug 09 16:46:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:46:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:30 user nova-compute[73091]: DEBUG nova.network.neutron [req-5cc330c8-09ce-4262-998f-f7ab545dcc45 req-8dfa2090-b669-4248-8a14-bcba0c605b9c service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Updated VIF entry in instance network info cache for port af939b86-9ea1-46d6-8d42-e6171ca189c5. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:46:30 user nova-compute[73091]: DEBUG nova.network.neutron [req-5cc330c8-09ce-4262-998f-f7ab545dcc45 req-8dfa2090-b669-4248-8a14-bcba0c605b9c service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Updating instance_info_cache with network_info: [{"id": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "address": "fa:16:3e:ad:36:32", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf939b86-9e", "ovs_interfaceid": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:46:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5cc330c8-09ce-4262-998f-f7ab545dcc45 req-8dfa2090-b669-4248-8a14-bcba0c605b9c service nova] Releasing lock "refresh_cache-f81e99b2-580f-43fa-b74d-84ad7764b64f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:46:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-dcc8c8d7-632f-4d2b-9183-ce664c9546cd req-cc85faf3-ad53-40fb-9955-2c049d73df06 service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Received event network-vif-unplugged-af939b86-9ea1-46d6-8d42-e6171ca189c5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:46:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dcc8c8d7-632f-4d2b-9183-ce664c9546cd req-cc85faf3-ad53-40fb-9955-2c049d73df06 service nova] Acquiring lock "f81e99b2-580f-43fa-b74d-84ad7764b64f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dcc8c8d7-632f-4d2b-9183-ce664c9546cd req-cc85faf3-ad53-40fb-9955-2c049d73df06 service nova] Lock "f81e99b2-580f-43fa-b74d-84ad7764b64f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dcc8c8d7-632f-4d2b-9183-ce664c9546cd req-cc85faf3-ad53-40fb-9955-2c049d73df06 service nova] Lock "f81e99b2-580f-43fa-b74d-84ad7764b64f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-dcc8c8d7-632f-4d2b-9183-ce664c9546cd req-cc85faf3-ad53-40fb-9955-2c049d73df06 service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] No waiting events found dispatching network-vif-unplugged-af939b86-9ea1-46d6-8d42-e6171ca189c5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:46:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-dcc8c8d7-632f-4d2b-9183-ce664c9546cd req-cc85faf3-ad53-40fb-9955-2c049d73df06 service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Received event network-vif-unplugged-af939b86-9ea1-46d6-8d42-e6171ca189c5 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:46:30 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599575.9446306, f8f52e24-8ce5-4128-a2aa-afc68ceb7213 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:46:30 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] VM Stopped (Lifecycle Event)
Aug 09 16:46:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7fb141fd-6612-4560-bd87-28ccd96b5035 None None] [instance: f8f52e24-8ce5-4128-a2aa-afc68ceb7213] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:46:30 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Instance destroyed successfully.
Aug 09 16:46:30 user nova-compute[73091]: DEBUG nova.objects.instance [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'resources' on Instance uuid f81e99b2-580f-43fa-b74d-84ad7764b64f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:46:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:44:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-470825434',display_name='tempest-AttachVolumeNegativeTest-server-470825434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-470825434',id=29,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGYyx101qSsggbbUMFa+FT7Ci2pKtsxBAb+vCghkXHRD19pa8XnL26PLYo6r0bSpCisQR8bX6AGwPf7WPxjak1W4Vkjpyv3BYisUZ/wjzKa6t0yGlNilL1AL1iq55h1pw==',key_name='tempest-keypair-16271140',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:44:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27f2275630ce4d55bf02851df830b6bd',ramdisk_id='',reservation_id='r-ofcz6n67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-604747333',owner_user_name='tempest-AttachVolumeNegativeTest-604747333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a5c393d644c4c3f8e9cbb0805ba7c08',uuid=f81e99b2-580f-43fa-b74d-84ad7764b64f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "address": "fa:16:3e:ad:36:32", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf939b86-9e", "ovs_interfaceid": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:46:31 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converting VIF {"id": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "address": "fa:16:3e:ad:36:32", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf939b86-9e", "ovs_interfaceid": "af939b86-9ea1-46d6-8d42-e6171ca189c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:46:31 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:36:32,bridge_name='br-int',has_traffic_filtering=True,id=af939b86-9ea1-46d6-8d42-e6171ca189c5,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf939b86-9e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:46:31 user nova-compute[73091]: DEBUG os_vif [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:36:32,bridge_name='br-int',has_traffic_filtering=True,id=af939b86-9ea1-46d6-8d42-e6171ca189c5,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf939b86-9e') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:46:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf939b86-9e, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:46:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:46:31 user nova-compute[73091]: INFO os_vif [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:36:32,bridge_name='br-int',has_traffic_filtering=True,id=af939b86-9ea1-46d6-8d42-e6171ca189c5,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf939b86-9e')
Aug 09 16:46:31 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Deleting instance files /opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f_del
Aug 09 16:46:31 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Deletion of /opt/stack/data/nova/instances/f81e99b2-580f-43fa-b74d-84ad7764b64f_del complete
Aug 09 16:46:31 user nova-compute[73091]: INFO nova.compute.manager [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 16:46:31 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:46:31 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:46:31 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:46:31 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:46:31 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Took 0.85 seconds to deallocate network for instance.
Aug 09 16:46:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-4c99238f-5d7b-4b5a-939f-aea67ddfc70b req-b83c2d63-9194-4c49-ad6c-fcda934096d0 service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Received event network-vif-deleted-af939b86-9ea1-46d6-8d42-e6171ca189c5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:46:31 user nova-compute[73091]: INFO nova.compute.manager [req-4c99238f-5d7b-4b5a-939f-aea67ddfc70b req-b83c2d63-9194-4c49-ad6c-fcda934096d0 service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Neutron deleted interface af939b86-9ea1-46d6-8d42-e6171ca189c5; detaching it from the instance and deleting it from the info cache
Aug 09 16:46:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-4c99238f-5d7b-4b5a-939f-aea67ddfc70b req-b83c2d63-9194-4c49-ad6c-fcda934096d0 service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:46:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-4c99238f-5d7b-4b5a-939f-aea67ddfc70b req-b83c2d63-9194-4c49-ad6c-fcda934096d0 service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Detach interface failed, port_id=af939b86-9ea1-46d6-8d42-e6171ca189c5, reason: Instance f81e99b2-580f-43fa-b74d-84ad7764b64f could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 16:46:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:32 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:46:32 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:46:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:32 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Deleted allocations for instance f81e99b2-580f-43fa-b74d-84ad7764b64f
Aug 09 16:46:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eac016cc-6618-40d7-94bb-89acb2d0236c tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "f81e99b2-580f-43fa-b74d-84ad7764b64f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.222s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:32 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599577.646424, da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:46:32 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] VM Stopped (Lifecycle Event)
Aug 09 16:46:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5ef5014a-4b3a-415f-944e-2a1c3b1a7d14 None None] [instance: da7fdd3d-1ac5-4518-a78b-ea4e5cae5ee8] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:46:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-23d44de9-9a1a-4711-989b-755ee669a039 req-48c6424d-4115-4b4a-9e7c-62b4e2899b9d service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Received event network-vif-plugged-af939b86-9ea1-46d6-8d42-e6171ca189c5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:46:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-23d44de9-9a1a-4711-989b-755ee669a039 req-48c6424d-4115-4b4a-9e7c-62b4e2899b9d service nova] Acquiring lock "f81e99b2-580f-43fa-b74d-84ad7764b64f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:46:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-23d44de9-9a1a-4711-989b-755ee669a039 req-48c6424d-4115-4b4a-9e7c-62b4e2899b9d service nova] Lock "f81e99b2-580f-43fa-b74d-84ad7764b64f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:46:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-23d44de9-9a1a-4711-989b-755ee669a039 req-48c6424d-4115-4b4a-9e7c-62b4e2899b9d service nova] Lock "f81e99b2-580f-43fa-b74d-84ad7764b64f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:46:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-23d44de9-9a1a-4711-989b-755ee669a039 req-48c6424d-4115-4b4a-9e7c-62b4e2899b9d service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] No waiting events found dispatching network-vif-plugged-af939b86-9ea1-46d6-8d42-e6171ca189c5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:46:32 user nova-compute[73091]: WARNING nova.compute.manager [req-23d44de9-9a1a-4711-989b-755ee669a039 req-48c6424d-4115-4b4a-9e7c-62b4e2899b9d service nova] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Received unexpected event network-vif-plugged-af939b86-9ea1-46d6-8d42-e6171ca189c5 for instance with vm_state deleted and task_state None.
Aug 09 16:46:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:41 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599585.9989595, e03ff609-e74d-427d-b6e6-109fbee09e40 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:46:41 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] VM Stopped (Lifecycle Event)
Aug 09 16:46:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:46:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f61509a0-9742-434e-bbf7-19052ea3bc1e None None] [instance: e03ff609-e74d-427d-b6e6-109fbee09e40] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:46:45 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599590.977983, f81e99b2-580f-43fa-b74d-84ad7764b64f => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:46:45 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] VM Stopped (Lifecycle Event)
Aug 09 16:46:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6cf2677d-8b60-4256-ade3-3d4beb72ae71 None None] [instance: f81e99b2-580f-43fa-b74d-84ad7764b64f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:46:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:46:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:46:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:47:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "68d63bc2-d726-49d8-91de-bc5cc66bb119" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:02 user nova-compute[73091]: INFO nova.compute.manager [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Terminating instance
Aug 09 16:47:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-da2a08f2-0460-4d96-a996-978338c1871e req-2aedf4e5-6d5f-43d0-b665-f2ff446abc05 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received event network-vif-unplugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da2a08f2-0460-4d96-a996-978338c1871e req-2aedf4e5-6d5f-43d0-b665-f2ff446abc05 service nova] Acquiring lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da2a08f2-0460-4d96-a996-978338c1871e req-2aedf4e5-6d5f-43d0-b665-f2ff446abc05 service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da2a08f2-0460-4d96-a996-978338c1871e req-2aedf4e5-6d5f-43d0-b665-f2ff446abc05 service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-da2a08f2-0460-4d96-a996-978338c1871e req-2aedf4e5-6d5f-43d0-b665-f2ff446abc05 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] No waiting events found dispatching network-vif-unplugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-da2a08f2-0460-4d96-a996-978338c1871e req-2aedf4e5-6d5f-43d0-b665-f2ff446abc05 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received event network-vif-unplugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:47:02 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Instance destroyed successfully.
Aug 09 16:47:02 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lazy-loading 'resources' on Instance uuid 68d63bc2-d726-49d8-91de-bc5cc66bb119 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1756856509',display_name='tempest-ServerActionsTestOtherB-server-1756856509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1756856509',id=15,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX4A4WBbci8tvlyfsVn8RtvZ67v0qxFwI098O4ybt1xkpAJgwLMitJ+vOXZXn9ziILn0Dux9cadl75sAIWbob/GvRq9Jin537WzoAVu2MvbyterRxvGm1tqvtVxJqTjrw==',key_name='tempest-keypair-561558216',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:44:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='329738ae9226414383acb6dcbd09dea0',ramdisk_id='',reservation_id='r-r2gg9o0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1665559429',owner_user_name='tempest-ServerActionsTestOtherB-1665559429-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:44:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a90a17815b46b8a64be7510ac5ba49',uuid=68d63bc2-d726-49d8-91de-bc5cc66bb119,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Converting VIF {"id": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "address": "fa:16:3e:3c:81:07", "network": {"id": "1040a634-671a-4a70-a3ab-c98ffd33c035", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-815237771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "329738ae9226414383acb6dcbd09dea0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d41bee-7c", "ovs_interfaceid": "93d41bee-7cab-45a7-b409-dd19fc3b88b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG os_vif [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93d41bee-7c, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:47:02 user nova-compute[73091]: INFO os_vif [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:81:07,bridge_name='br-int',has_traffic_filtering=True,id=93d41bee-7cab-45a7-b409-dd19fc3b88b6,network=Network(1040a634-671a-4a70-a3ab-c98ffd33c035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93d41bee-7c')
Aug 09 16:47:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfUAobeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:47:02 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:47:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1295660-ad0f-4ceb-8918-40bddd80e0a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef289c4-23aa-4993-876e-daf9e1691878]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:47:03 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:47:03 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:47:03 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:47:03 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:47:03 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 (non-flash)
Aug 09 16:47:03 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:47:03 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:47:03 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff06039c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012'): ({'sdd'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Removing single pathed devices sdd {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[15209b6b-9637-41fd-ab6b-6fcdd05a76f0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f7888a-38a6-44f5-adcf-1d45d58aac42]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Flushing IO for device /dev/sdd {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a60a6d-450e-40a1-a1ee-88e269a50c84]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b5ef87-ce2e-4ff3-845d-2af72b9716fc]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4219768c-5648-43c2-adfc-1bf79d7e834d]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a092c1b4-476f-4a48-a681-50440f0fa98c]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260]
Aug 09 16:47:03 user nova-compute[73091]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012, portal: 172.16.0.220,3260] successful.
Aug 09 16:47:03 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c698f00-64a1-4d7f-bad5-2d74153a7012 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cf86eb-2f9e-4ee5-bcc0-66514c1cd59b]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] <== disconnect_volume: return (272ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:47:03 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Deleting instance files /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119_del
Aug 09 16:47:03 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Deletion of /opt/stack/data/nova/instances/68d63bc2-d726-49d8-91de-bc5cc66bb119_del complete
Aug 09 16:47:03 user nova-compute[73091]: INFO nova.compute.manager [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 09 16:47:03 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:47:03 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:47:04 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:47:04 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Took 1.05 seconds to deallocate network for instance.
Aug 09 16:47:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-9b294523-62c0-4f6f-a1f6-3c379f0d65f9 req-2372af5f-c7ee-4136-a94f-83d24f08bf9c service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received event network-vif-deleted-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:47:04 user nova-compute[73091]: INFO nova.compute.manager [req-9b294523-62c0-4f6f-a1f6-3c379f0d65f9 req-2372af5f-c7ee-4136-a94f-83d24f08bf9c service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Neutron deleted interface 93d41bee-7cab-45a7-b409-dd19fc3b88b6; detaching it from the instance and deleting it from the info cache
Aug 09 16:47:04 user nova-compute[73091]: DEBUG nova.network.neutron [req-9b294523-62c0-4f6f-a1f6-3c379f0d65f9 req-2372af5f-c7ee-4136-a94f-83d24f08bf9c service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:47:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-9b294523-62c0-4f6f-a1f6-3c379f0d65f9 req-2372af5f-c7ee-4136-a94f-83d24f08bf9c service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Detach interface failed, port_id=93d41bee-7cab-45a7-b409-dd19fc3b88b6, reason: Instance 68d63bc2-d726-49d8-91de-bc5cc66bb119 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 16:47:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-1acee407-758e-4bc0-9ed7-1a2ccb58e09c req-6b050c70-8ca0-4fc9-b43e-d52dad361eb4 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received event network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:47:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1acee407-758e-4bc0-9ed7-1a2ccb58e09c req-6b050c70-8ca0-4fc9-b43e-d52dad361eb4 service nova] Acquiring lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1acee407-758e-4bc0-9ed7-1a2ccb58e09c req-6b050c70-8ca0-4fc9-b43e-d52dad361eb4 service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1acee407-758e-4bc0-9ed7-1a2ccb58e09c req-6b050c70-8ca0-4fc9-b43e-d52dad361eb4 service nova] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-1acee407-758e-4bc0-9ed7-1a2ccb58e09c req-6b050c70-8ca0-4fc9-b43e-d52dad361eb4 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] No waiting events found dispatching network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:47:04 user nova-compute[73091]: WARNING nova.compute.manager [req-1acee407-758e-4bc0-9ed7-1a2ccb58e09c req-6b050c70-8ca0-4fc9-b43e-d52dad361eb4 service nova] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Received unexpected event network-vif-plugged-93d41bee-7cab-45a7-b409-dd19fc3b88b6 for instance with vm_state active and task_state deleting.
Aug 09 16:47:05 user nova-compute[73091]: INFO nova.compute.manager [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Took 0.74 seconds to detach 1 volumes for instance.
Aug 09 16:47:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:05 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:47:05 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:47:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:05 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Deleted allocations for instance 68d63bc2-d726-49d8-91de-bc5cc66bb119
Aug 09 16:47:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f4ea3efb-210b-411d-a66f-eddfb51ea8a7 tempest-ServerActionsTestOtherB-1665559429 tempest-ServerActionsTestOtherB-1665559429-project-member] Lock "68d63bc2-d726-49d8-91de-bc5cc66bb119" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.477s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:47:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "c142dbba-1e7f-4381-91a5-876b55e11a64" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:47:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:47:09 user nova-compute[73091]: INFO nova.compute.claims [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Claim successful on node user
Aug 09 16:47:09 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:47:09 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:47:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:47:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:47:10 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:47:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:47:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:47:10 user nova-compute[73091]: DEBUG nova.policy [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6652e0ef40d4e26b67628d261f2848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1ecfa8609840b1950ed8563bd427d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:47:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:47:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:47:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Creating image(s)
Aug 09 16:47:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "/opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "/opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "/opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "6e5fb35af1e0b3225906c08e568b6622fb50e588" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "6e5fb35af1e0b3225906c08e568b6622fb50e588" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e5fb35af1e0b3225906c08e568b6622fb50e588.part --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e5fb35af1e0b3225906c08e568b6622fb50e588.part --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:10 user nova-compute[73091]: DEBUG nova.virt.images [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] 315f3d5d-9f33-47f0-9347-eeea00742c89 was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 16:47:10 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 16:47:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6e5fb35af1e0b3225906c08e568b6622fb50e588.part /opt/stack/data/nova/instances/_base/6e5fb35af1e0b3225906c08e568b6622fb50e588.converted {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6e5fb35af1e0b3225906c08e568b6622fb50e588.part /opt/stack/data/nova/instances/_base/6e5fb35af1e0b3225906c08e568b6622fb50e588.converted" returned: 0 in 0.355s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e5fb35af1e0b3225906c08e568b6622fb50e588.converted --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Successfully created port: 84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e5fb35af1e0b3225906c08e568b6622fb50e588.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "6e5fb35af1e0b3225906c08e568b6622fb50e588" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.236s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e5fb35af1e0b3225906c08e568b6622fb50e588 --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e5fb35af1e0b3225906c08e568b6622fb50e588 --force-share --output=json" returned: 0 in 0.133s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "6e5fb35af1e0b3225906c08e568b6622fb50e588" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "6e5fb35af1e0b3225906c08e568b6622fb50e588" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e5fb35af1e0b3225906c08e568b6622fb50e588 --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "148cb211-b2f6-4782-8f35-e66a55cc95bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "148cb211-b2f6-4782-8f35-e66a55cc95bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "148cb211-b2f6-4782-8f35-e66a55cc95bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "148cb211-b2f6-4782-8f35-e66a55cc95bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "148cb211-b2f6-4782-8f35-e66a55cc95bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:11 user nova-compute[73091]: INFO nova.compute.manager [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Terminating instance
Aug 09 16:47:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e5fb35af1e0b3225906c08e568b6622fb50e588 --force-share --output=json" returned: 0 in 0.162s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6e5fb35af1e0b3225906c08e568b6622fb50e588,backing_fmt=raw /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6e5fb35af1e0b3225906c08e568b6622fb50e588,backing_fmt=raw /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk 1073741824" returned: 0 in 0.058s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "6e5fb35af1e0b3225906c08e568b6622fb50e588" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e5fb35af1e0b3225906c08e568b6622fb50e588 --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e5fb35af1e0b3225906c08e568b6622fb50e588 --force-share --output=json" returned: 0 in 0.146s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-70051170-65e5-41fc-8af0-a3173c92b8f8 req-fc53279f-60a8-4acb-9ed9-e22f8a73d857 service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Received event network-vif-unplugged-23754e3d-f575-4074-b60b-f1104372977b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-70051170-65e5-41fc-8af0-a3173c92b8f8 req-fc53279f-60a8-4acb-9ed9-e22f8a73d857 service nova] Acquiring lock "148cb211-b2f6-4782-8f35-e66a55cc95bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-70051170-65e5-41fc-8af0-a3173c92b8f8 req-fc53279f-60a8-4acb-9ed9-e22f8a73d857 service nova] Lock "148cb211-b2f6-4782-8f35-e66a55cc95bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-70051170-65e5-41fc-8af0-a3173c92b8f8 req-fc53279f-60a8-4acb-9ed9-e22f8a73d857 service nova] Lock "148cb211-b2f6-4782-8f35-e66a55cc95bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-70051170-65e5-41fc-8af0-a3173c92b8f8 req-fc53279f-60a8-4acb-9ed9-e22f8a73d857 service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] No waiting events found dispatching network-vif-unplugged-23754e3d-f575-4074-b60b-f1104372977b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:47:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-70051170-65e5-41fc-8af0-a3173c92b8f8 req-fc53279f-60a8-4acb-9ed9-e22f8a73d857 service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Received event network-vif-unplugged-23754e3d-f575-4074-b60b-f1104372977b for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Cannot resize image /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lazy-loading 'migration_context' on Instance uuid c142dbba-1e7f-4381-91a5-876b55e11a64 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Ensure instance console log exists: /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-8fc884a8-24bb-488a-baeb-ef2b1faf239d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-8fc884a8-24bb-488a-baeb-ef2b1faf239d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Successfully updated port: 84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquired lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-a3f54991-154c-4e42-bed5-5575ea610736 req-e6fc7662-b7a0-46db-8d65-aae841e5de47 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received event network-changed-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-a3f54991-154c-4e42-bed5-5575ea610736 req-e6fc7662-b7a0-46db-8d65-aae841e5de47 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Refreshing instance network info cache due to event network-changed-84392ff0-9f13-41e4-adb9-c3a5db7677a5. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a3f54991-154c-4e42-bed5-5575ea610736 req-e6fc7662-b7a0-46db-8d65-aae841e5de47 service nova] Acquiring lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:47:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Instance destroyed successfully.
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.objects.instance [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lazy-loading 'resources' on Instance uuid 148cb211-b2f6-4782-8f35-e66a55cc95bc {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-113439707',display_name='tempest-TestVolumeBootPattern-volume-backed-server-113439707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-113439707',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJIY/FfZB1Ybu6RyZ7w348VpSHuKTiZ86bLXsmiRzH1gQaOVDAaumaBDjHUKUqC00ts7LeKpEj5bDvz3yoN2UTprtXMvXtpLFP/mMlVqluITuI0pZQMGp0RVtBplJIGEQ==',key_name='tempest-keypair-1624103908',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:42:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64d3dfd232d54594808dad271baa5192',ramdisk_id='',reservation_id='r-e6v02939',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1605875873',owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:42:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69ccebf0e9d54502a2318c809ce11369',uuid=148cb211-b2f6-4782-8f35-e66a55cc95bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23754e3d-f575-4074-b60b-f1104372977b", "address": "fa:16:3e:b8:14:7c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23754e3d-f5", "ovs_interfaceid": "23754e3d-f575-4074-b60b-f1104372977b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converting VIF {"id": "23754e3d-f575-4074-b60b-f1104372977b", "address": "fa:16:3e:b8:14:7c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23754e3d-f5", "ovs_interfaceid": "23754e3d-f575-4074-b60b-f1104372977b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:14:7c,bridge_name='br-int',has_traffic_filtering=True,id=23754e3d-f575-4074-b60b-f1104372977b,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23754e3d-f5') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG os_vif [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:14:7c,bridge_name='br-int',has_traffic_filtering=True,id=23754e3d-f575-4074-b60b-f1104372977b,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23754e3d-f5') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23754e3d-f5, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:47:12 user nova-compute[73091]: INFO os_vif [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:14:7c,bridge_name='br-int',has_traffic_filtering=True,id=23754e3d-f575-4074-b60b-f1104372977b,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23754e3d-f5')
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqpaiyLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:47:12 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:47:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d09b3e4-a7fd-4dcf-ada9-27022ebf0374]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ab0e64-fb59-460c-85ee-faca7be224e3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:47:12 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:47:12 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:47:12 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a (non-flash)
Aug 09 16:47:12 user nova-compute[73091]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:47:12 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:47:12 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff08feb9000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d979d4-7678-4d29-b6cd-c750fec9703f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8de8e6a-9de6-482f-9e50-863e8d5ed0c0]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[927978bf-b4bf-46e0-b7ed-b9f913f458aa]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec966af-2bce-43f5-a33a-82cc5ad9837f]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7847e3f-c774-4407-9b17-f988ded1f06c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d71ea91-7465-465d-ab78-e48e65d6b423]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a, portal: 172.16.0.220,3260]
Aug 09 16:47:12 user nova-compute[73091]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a, portal: 172.16.0.220,3260] successful.
Aug 09 16:47:12 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8078d69f-c4bc-4a94-990b-2c5a6bf26def]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] <== disconnect_volume: return (299ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:47:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Deleting instance files /opt/stack/data/nova/instances/148cb211-b2f6-4782-8f35-e66a55cc95bc_del
Aug 09 16:47:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Deletion of /opt/stack/data/nova/instances/148cb211-b2f6-4782-8f35-e66a55cc95bc_del complete
Aug 09 16:47:12 user nova-compute[73091]: INFO nova.compute.manager [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Updating instance_info_cache with network_info: [{"id": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "address": "fa:16:3e:af:49:2e", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84392ff0-9f", "ovs_interfaceid": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Updating instance_info_cache with network_info: [{"id": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "address": "fa:16:3e:b3:de:fe", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ffdd03-c8", "ovs_interfaceid": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Releasing lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Instance network_info: |[{"id": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "address": "fa:16:3e:af:49:2e", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84392ff0-9f", "ovs_interfaceid": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-8fc884a8-24bb-488a-baeb-ef2b1faf239d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a3f54991-154c-4e42-bed5-5575ea610736 req-e6fc7662-b7a0-46db-8d65-aae841e5de47 service nova] Acquired lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.network.neutron [req-a3f54991-154c-4e42-bed5-5575ea610736 req-e6fc7662-b7a0-46db-8d65-aae841e5de47 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Refreshing network info cache for port 84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Start _get_guest_xml network_info=[{"id": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "address": "fa:16:3e:af:49:2e", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84392ff0-9f", "ovs_interfaceid": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:47:07Z,direct_url=<?>,disk_format='qcow2',id=315f3d5d-9f33-47f0-9347-eeea00742c89,min_disk=0,min_ram=0,name='tempest-scenario-img--1744531066',owner='2e1ecfa8609840b1950ed8563bd427d1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:47:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': '315f3d5d-9f33-47f0-9347-eeea00742c89'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:47:12 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:47:12 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:47:07Z,direct_url=<?>,disk_format='qcow2',id=315f3d5d-9f33-47f0-9347-eeea00742c89,min_disk=0,min_ram=0,name='tempest-scenario-img--1744531066',owner='2e1ecfa8609840b1950ed8563bd427d1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:47:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-555112067',display_name='tempest-TestMinimumBasicScenario-server-555112067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-555112067',id=32,image_ref='315f3d5d-9f33-47f0-9347-eeea00742c89',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJJTaTt6mrnEToLWj6nubMKFVBkIJwEb5cDa5Yu86AftoYDLns8EgRlJGxSLc2cqmOVkWKfcWg93a8UH6XQPiGNITEhujb4EycBouXSykeAVhwwkZ1aI0XrPmFSukQ+Xw==',key_name='tempest-TestMinimumBasicScenario-1099798685',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e1ecfa8609840b1950ed8563bd427d1',ramdisk_id='',reservation_id='r-c7zbbjs6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='315f3d5d-9f33-47f0-9347-eeea00742c89',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-51921820',owner_user_name='tempest-TestMinimumBasicScenario-51921820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:47:10Z,user_data=None,user_id='d6652e0ef40d4e26b67628d261f2848e',uuid=c142dbba-1e7f-4381-91a5-876b55e11a64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "address": "fa:16:3e:af:49:2e", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84392ff0-9f", "ovs_interfaceid": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Converting VIF {"id": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "address": "fa:16:3e:af:49:2e", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84392ff0-9f", "ovs_interfaceid": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:49:2e,bridge_name='br-int',has_traffic_filtering=True,id=84392ff0-9f13-41e4-adb9-c3a5db7677a5,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84392ff0-9f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:47:12 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lazy-loading 'pci_devices' on Instance uuid c142dbba-1e7f-4381-91a5-876b55e11a64 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:47:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:47:13 user nova-compute[73091]:   <uuid>c142dbba-1e7f-4381-91a5-876b55e11a64</uuid>
Aug 09 16:47:13 user nova-compute[73091]:   <name>instance-00000020</name>
Aug 09 16:47:13 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:47:13 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:47:13 user nova-compute[73091]:   <metadata>
Aug 09 16:47:13 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:47:13 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:47:13 user nova-compute[73091]:       <nova:name>tempest-TestMinimumBasicScenario-server-555112067</nova:name>
Aug 09 16:47:13 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:47:12</nova:creationTime>
Aug 09 16:47:13 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:47:13 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:47:13 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:47:13 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:47:13 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:47:13 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:47:13 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:47:13 user nova-compute[73091]:       <nova:owner>
Aug 09 16:47:13 user nova-compute[73091]:         <nova:user uuid="d6652e0ef40d4e26b67628d261f2848e">tempest-TestMinimumBasicScenario-51921820-project-member</nova:user>
Aug 09 16:47:13 user nova-compute[73091]:         <nova:project uuid="2e1ecfa8609840b1950ed8563bd427d1">tempest-TestMinimumBasicScenario-51921820</nova:project>
Aug 09 16:47:13 user nova-compute[73091]:       </nova:owner>
Aug 09 16:47:13 user nova-compute[73091]:       <nova:root type="image" uuid="315f3d5d-9f33-47f0-9347-eeea00742c89"/>
Aug 09 16:47:13 user nova-compute[73091]:       <nova:ports>
Aug 09 16:47:13 user nova-compute[73091]:         <nova:port uuid="84392ff0-9f13-41e4-adb9-c3a5db7677a5">
Aug 09 16:47:13 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 16:47:13 user nova-compute[73091]:         </nova:port>
Aug 09 16:47:13 user nova-compute[73091]:       </nova:ports>
Aug 09 16:47:13 user nova-compute[73091]:     </nova:instance>
Aug 09 16:47:13 user nova-compute[73091]:   </metadata>
Aug 09 16:47:13 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:47:13 user nova-compute[73091]:     <system>
Aug 09 16:47:13 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:47:13 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:47:13 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:47:13 user nova-compute[73091]:       <entry name="serial">c142dbba-1e7f-4381-91a5-876b55e11a64</entry>
Aug 09 16:47:13 user nova-compute[73091]:       <entry name="uuid">c142dbba-1e7f-4381-91a5-876b55e11a64</entry>
Aug 09 16:47:13 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:47:13 user nova-compute[73091]:     </system>
Aug 09 16:47:13 user nova-compute[73091]:   </sysinfo>
Aug 09 16:47:13 user nova-compute[73091]:   <os>
Aug 09 16:47:13 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:47:13 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:47:13 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:47:13 user nova-compute[73091]:   </os>
Aug 09 16:47:13 user nova-compute[73091]:   <features>
Aug 09 16:47:13 user nova-compute[73091]:     <acpi/>
Aug 09 16:47:13 user nova-compute[73091]:     <apic/>
Aug 09 16:47:13 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:47:13 user nova-compute[73091]:   </features>
Aug 09 16:47:13 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:47:13 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:47:13 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:47:13 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:47:13 user nova-compute[73091]:   </clock>
Aug 09 16:47:13 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:47:13 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:47:13 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:47:13 user nova-compute[73091]:   </cpu>
Aug 09 16:47:13 user nova-compute[73091]:   <devices>
Aug 09 16:47:13 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:47:13 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:47:13 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk"/>
Aug 09 16:47:13 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:47:13 user nova-compute[73091]:     </disk>
Aug 09 16:47:13 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:47:13 user nova-compute[73091]:       <mac address="fa:16:3e:af:49:2e"/>
Aug 09 16:47:13 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:47:13 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:47:13 user nova-compute[73091]:       <target dev="tap84392ff0-9f"/>
Aug 09 16:47:13 user nova-compute[73091]:     </interface>
Aug 09 16:47:13 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:47:13 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/console.log" append="off"/>
Aug 09 16:47:13 user nova-compute[73091]:     </serial>
Aug 09 16:47:13 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:47:13 user nova-compute[73091]:     <video>
Aug 09 16:47:13 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:47:13 user nova-compute[73091]:     </video>
Aug 09 16:47:13 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:47:13 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:47:13 user nova-compute[73091]:     </rng>
Aug 09 16:47:13 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:47:13 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:47:13 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:47:13 user nova-compute[73091]:     </memballoon>
Aug 09 16:47:13 user nova-compute[73091]:   </devices>
Aug 09 16:47:13 user nova-compute[73091]: </domain>
Aug 09 16:47:13 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:47:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-555112067',display_name='tempest-TestMinimumBasicScenario-server-555112067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-555112067',id=32,image_ref='315f3d5d-9f33-47f0-9347-eeea00742c89',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJJTaTt6mrnEToLWj6nubMKFVBkIJwEb5cDa5Yu86AftoYDLns8EgRlJGxSLc2cqmOVkWKfcWg93a8UH6XQPiGNITEhujb4EycBouXSykeAVhwwkZ1aI0XrPmFSukQ+Xw==',key_name='tempest-TestMinimumBasicScenario-1099798685',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e1ecfa8609840b1950ed8563bd427d1',ramdisk_id='',reservation_id='r-c7zbbjs6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='315f3d5d-9f33-47f0-9347-eeea00742c89',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-51921820',owner_user_name='tempest-TestMinimumBasicScenario-51921820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:47:10Z,user_data=None,user_id='d6652e0ef40d4e26b67628d261f2848e',uuid=c142dbba-1e7f-4381-91a5-876b55e11a64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "address": "fa:16:3e:af:49:2e", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84392ff0-9f", "ovs_interfaceid": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:47:13 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Converting VIF {"id": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "address": "fa:16:3e:af:49:2e", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84392ff0-9f", "ovs_interfaceid": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:47:13 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:49:2e,bridge_name='br-int',has_traffic_filtering=True,id=84392ff0-9f13-41e4-adb9-c3a5db7677a5,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84392ff0-9f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:47:13 user nova-compute[73091]: DEBUG os_vif [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:49:2e,bridge_name='br-int',has_traffic_filtering=True,id=84392ff0-9f13-41e4-adb9-c3a5db7677a5,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84392ff0-9f') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:47:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:47:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:47:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84392ff0-9f, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:47:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84392ff0-9f, col_values=(('external_ids', {'iface-id': '84392ff0-9f13-41e4-adb9-c3a5db7677a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:49:2e', 'vm-uuid': 'c142dbba-1e7f-4381-91a5-876b55e11a64'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:47:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:47:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:13 user nova-compute[73091]: INFO os_vif [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:49:2e,bridge_name='br-int',has_traffic_filtering=True,id=84392ff0-9f13-41e4-adb9-c3a5db7677a5,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84392ff0-9f')
Aug 09 16:47:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:47:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] No VIF found with MAC fa:16:3e:af:49:2e, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:47:13 user nova-compute[73091]: DEBUG nova.network.neutron [req-a3f54991-154c-4e42-bed5-5575ea610736 req-e6fc7662-b7a0-46db-8d65-aae841e5de47 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Updated VIF entry in instance network info cache for port 84392ff0-9f13-41e4-adb9-c3a5db7677a5. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:47:13 user nova-compute[73091]: DEBUG nova.network.neutron [req-a3f54991-154c-4e42-bed5-5575ea610736 req-e6fc7662-b7a0-46db-8d65-aae841e5de47 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Updating instance_info_cache with network_info: [{"id": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "address": "fa:16:3e:af:49:2e", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84392ff0-9f", "ovs_interfaceid": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:47:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a3f54991-154c-4e42-bed5-5575ea610736 req-e6fc7662-b7a0-46db-8d65-aae841e5de47 service nova] Releasing lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:47:13 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:47:13 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Took 0.83 seconds to deallocate network for instance.
Aug 09 16:47:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-5daaddd3-055c-4f66-8f8b-7f6fc47f6513 req-e2f3729d-d476-44db-9227-5cb04dbed1e5 service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Received event network-vif-deleted-23754e3d-f575-4074-b60b-f1104372977b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:47:13 user nova-compute[73091]: INFO nova.compute.manager [req-5daaddd3-055c-4f66-8f8b-7f6fc47f6513 req-e2f3729d-d476-44db-9227-5cb04dbed1e5 service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Neutron deleted interface 23754e3d-f575-4074-b60b-f1104372977b; detaching it from the instance and deleting it from the info cache
Aug 09 16:47:13 user nova-compute[73091]: DEBUG nova.network.neutron [req-5daaddd3-055c-4f66-8f8b-7f6fc47f6513 req-e2f3729d-d476-44db-9227-5cb04dbed1e5 service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:47:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-5daaddd3-055c-4f66-8f8b-7f6fc47f6513 req-e2f3729d-d476-44db-9227-5cb04dbed1e5 service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Detach interface failed, port_id=23754e3d-f575-4074-b60b-f1104372977b, reason: Instance 148cb211-b2f6-4782-8f35-e66a55cc95bc could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 16:47:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-c355bc67-fb48-440b-8f44-59cda4e34052 req-9da37abf-5793-43ae-bc36-5740cbcb598a service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Received event network-vif-plugged-23754e3d-f575-4074-b60b-f1104372977b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:47:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c355bc67-fb48-440b-8f44-59cda4e34052 req-9da37abf-5793-43ae-bc36-5740cbcb598a service nova] Acquiring lock "148cb211-b2f6-4782-8f35-e66a55cc95bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c355bc67-fb48-440b-8f44-59cda4e34052 req-9da37abf-5793-43ae-bc36-5740cbcb598a service nova] Lock "148cb211-b2f6-4782-8f35-e66a55cc95bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c355bc67-fb48-440b-8f44-59cda4e34052 req-9da37abf-5793-43ae-bc36-5740cbcb598a service nova] Lock "148cb211-b2f6-4782-8f35-e66a55cc95bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-c355bc67-fb48-440b-8f44-59cda4e34052 req-9da37abf-5793-43ae-bc36-5740cbcb598a service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] No waiting events found dispatching network-vif-plugged-23754e3d-f575-4074-b60b-f1104372977b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:47:14 user nova-compute[73091]: WARNING nova.compute.manager [req-c355bc67-fb48-440b-8f44-59cda4e34052 req-9da37abf-5793-43ae-bc36-5740cbcb598a service nova] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Received unexpected event network-vif-plugged-23754e3d-f575-4074-b60b-f1104372977b for instance with vm_state active and task_state deleting.
Aug 09 16:47:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:14 user nova-compute[73091]: INFO nova.compute.manager [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Took 0.77 seconds to detach 1 volumes for instance.
Aug 09 16:47:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Deleting volume: cbbd3b7b-f913-4ed2-84ff-7ba76a59dd0a {{(pid=73091) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 16:47:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:14 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:47:14 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:47:14 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:47:14 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:47:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:14 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Deleted allocations for instance 148cb211-b2f6-4782-8f35-e66a55cc95bc
Aug 09 16:47:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-166e9dcc-aee6-40ef-855b-6e986fdb6f8a tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "148cb211-b2f6-4782-8f35-e66a55cc95bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.476s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc01f014-d6c0-46ec-9dfa-5aeebd5e0537 req-eddfdf9d-7799-4af4-9a3a-ba6a47f7d282 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received event network-vif-plugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:47:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc01f014-d6c0-46ec-9dfa-5aeebd5e0537 req-eddfdf9d-7799-4af4-9a3a-ba6a47f7d282 service nova] Acquiring lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc01f014-d6c0-46ec-9dfa-5aeebd5e0537 req-eddfdf9d-7799-4af4-9a3a-ba6a47f7d282 service nova] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc01f014-d6c0-46ec-9dfa-5aeebd5e0537 req-eddfdf9d-7799-4af4-9a3a-ba6a47f7d282 service nova] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc01f014-d6c0-46ec-9dfa-5aeebd5e0537 req-eddfdf9d-7799-4af4-9a3a-ba6a47f7d282 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] No waiting events found dispatching network-vif-plugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:47:15 user nova-compute[73091]: WARNING nova.compute.manager [req-cc01f014-d6c0-46ec-9dfa-5aeebd5e0537 req-eddfdf9d-7799-4af4-9a3a-ba6a47f7d282 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received unexpected event network-vif-plugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 for instance with vm_state building and task_state spawning.
Aug 09 16:47:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc01f014-d6c0-46ec-9dfa-5aeebd5e0537 req-eddfdf9d-7799-4af4-9a3a-ba6a47f7d282 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received event network-vif-plugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:47:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc01f014-d6c0-46ec-9dfa-5aeebd5e0537 req-eddfdf9d-7799-4af4-9a3a-ba6a47f7d282 service nova] Acquiring lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc01f014-d6c0-46ec-9dfa-5aeebd5e0537 req-eddfdf9d-7799-4af4-9a3a-ba6a47f7d282 service nova] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc01f014-d6c0-46ec-9dfa-5aeebd5e0537 req-eddfdf9d-7799-4af4-9a3a-ba6a47f7d282 service nova] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc01f014-d6c0-46ec-9dfa-5aeebd5e0537 req-eddfdf9d-7799-4af4-9a3a-ba6a47f7d282 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] No waiting events found dispatching network-vif-plugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:47:15 user nova-compute[73091]: WARNING nova.compute.manager [req-cc01f014-d6c0-46ec-9dfa-5aeebd5e0537 req-eddfdf9d-7799-4af4-9a3a-ba6a47f7d282 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received unexpected event network-vif-plugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 for instance with vm_state building and task_state spawning.
Aug 09 16:47:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:47:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:47:17 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599637.024092, c142dbba-1e7f-4381-91a5-876b55e11a64 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:47:17 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] VM Resumed (Lifecycle Event)
Aug 09 16:47:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:47:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:47:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Instance spawned successfully.
Aug 09 16:47:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:47:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:47:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:47:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:47:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:47:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:47:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:47:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:47:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:47:17 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:47:17 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599637.0256202, c142dbba-1e7f-4381-91a5-876b55e11a64 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:47:17 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] VM Started (Lifecycle Event)
Aug 09 16:47:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:47:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:47:17 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:47:17 user nova-compute[73091]: INFO nova.compute.manager [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Took 7.05 seconds to spawn the instance on the hypervisor.
Aug 09 16:47:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:47:17 user nova-compute[73091]: INFO nova.compute.manager [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Took 7.82 seconds to build instance.
Aug 09 16:47:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1863e19f-0c39-4581-92c7-97426ba94c8b tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.925s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:47:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:17 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:47:17 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599622.9151108, 68d63bc2-d726-49d8-91de-bc5cc66bb119 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:47:17 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] VM Stopped (Lifecycle Event)
Aug 09 16:47:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-993918f5-b188-4523-b9e3-6133d7989b49 None None] [instance: 68d63bc2-d726-49d8-91de-bc5cc66bb119] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:47:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:47:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:21 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:47:21 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:47:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7650MB free_disk=25.300186157226562GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:47:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:47:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f939fe27-017a-481e-babc-147bf98e0132 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:47:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8fc884a8-24bb-488a-baeb-ef2b1faf239d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:47:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 4a39f479-265c-49c3-86c4-a65fff2f06c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:47:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 97af1277-b4bd-4a89-903b-4f70087f0535 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:47:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance b9639ddc-0ff9-41d2-b647-3af5fce945c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:47:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c142dbba-1e7f-4381-91a5-876b55e11a64 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:47:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:47:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:47:21 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:47:21 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:47:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:47:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.516s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "4a39f479-265c-49c3-86c4-a65fff2f06c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "4a39f479-265c-49c3-86c4-a65fff2f06c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:22 user nova-compute[73091]: INFO nova.compute.manager [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Detaching volume 46c3402f-6cde-4711-9d83-db9c02483659
Aug 09 16:47:22 user nova-compute[73091]: INFO nova.virt.block_device [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Attempting to driver detach volume 46c3402f-6cde-4711-9d83-db9c02483659 from mountpoint /dev/vdb
Aug 09 16:47:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Attempting to detach device vdb from instance 4a39f479-265c-49c3-86c4-a65fff2f06c4 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:47:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:47:22 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:47:22 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 09 16:47:22 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:47:22 user nova-compute[73091]:   <serial>46c3402f-6cde-4711-9d83-db9c02483659</serial>
Aug 09 16:47:22 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:47:22 user nova-compute[73091]: </disk>
Aug 09 16:47:22 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:47:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Successfully detached device vdb from instance 4a39f479-265c-49c3-86c4-a65fff2f06c4 from the persistent domain config.
Aug 09 16:47:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4a39f479-265c-49c3-86c4-a65fff2f06c4 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:47:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:47:22 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:47:22 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 09 16:47:22 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:47:22 user nova-compute[73091]:   <serial>46c3402f-6cde-4711-9d83-db9c02483659</serial>
Aug 09 16:47:22 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:47:22 user nova-compute[73091]: </disk>
Aug 09 16:47:22 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:47:22 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:47:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691599642.9269955, 4a39f479-265c-49c3-86c4-a65fff2f06c4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:47:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4a39f479-265c-49c3-86c4-a65fff2f06c4 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:47:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Successfully detached device vdb from instance 4a39f479-265c-49c3-86c4-a65fff2f06c4 from the live domain config.
Aug 09 16:47:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:47:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrwAselG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:47:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:47:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:47:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:47:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:47:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1b9ac2-c31b-4325-9c61-b31f8b84c2b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1338a9ba-e57f-4a85-8985-1a2297a6d129]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:47:23 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:47:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 (non-flash)
Aug 09 16:47:23 user nova-compute[73091]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:47:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0601b4af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Removing single pathed devices sde {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adb469d-cb70-4cfc-b8fd-d3b942f87901]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d5275a-06a2-43d3-9c94-301e13ff5139]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[81175cf7-2793-435b-af97-48b830585847]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1be204-4079-4e27-b123-04e6207a68ce]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0afa855-7af9-43bf-a367-5ba0353fdea8]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4d5d2c-be1f-4a29-8955-1f7ec8f96754]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659, portal: 172.16.0.220,3260]
Aug 09 16:47:23 user nova-compute[73091]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659, portal: 172.16.0.220,3260] successful.
Aug 09 16:47:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c3402f-6cde-4711-9d83-db9c02483659 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ab3484-f7d7-46e8-aaf6-cc3dff689615]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] <== disconnect_volume: return (363ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-93b39bdc-83e0-457b-a363-cc921e0b946a req-8193113c-6f84-41b7-82e0-a77c7a184db0 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Received event network-changed-54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-93b39bdc-83e0-457b-a363-cc921e0b946a req-8193113c-6f84-41b7-82e0-a77c7a184db0 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Refreshing instance network info cache due to event network-changed-54c1bb8c-584f-446c-9b64-c840c486a4f1. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-93b39bdc-83e0-457b-a363-cc921e0b946a req-8193113c-6f84-41b7-82e0-a77c7a184db0 service nova] Acquiring lock "refresh_cache-18d8e887-0f91-42e1-ba79-13db5aa9b84b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-93b39bdc-83e0-457b-a363-cc921e0b946a req-8193113c-6f84-41b7-82e0-a77c7a184db0 service nova] Acquired lock "refresh_cache-18d8e887-0f91-42e1-ba79-13db5aa9b84b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:47:23 user nova-compute[73091]: DEBUG nova.network.neutron [req-93b39bdc-83e0-457b-a363-cc921e0b946a req-8193113c-6f84-41b7-82e0-a77c7a184db0 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Refreshing network info cache for port 54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:47:24 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'flavor' on Instance uuid 4a39f479-265c-49c3-86c4-a65fff2f06c4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:47:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca371112-d1e5-491f-a526-11edb5da8b9f tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "4a39f479-265c-49c3-86c4-a65fff2f06c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.952s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:24 user nova-compute[73091]: DEBUG nova.network.neutron [req-93b39bdc-83e0-457b-a363-cc921e0b946a req-8193113c-6f84-41b7-82e0-a77c7a184db0 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Updated VIF entry in instance network info cache for port 54c1bb8c-584f-446c-9b64-c840c486a4f1. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:47:24 user nova-compute[73091]: DEBUG nova.network.neutron [req-93b39bdc-83e0-457b-a363-cc921e0b946a req-8193113c-6f84-41b7-82e0-a77c7a184db0 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Updating instance_info_cache with network_info: [{"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:47:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-93b39bdc-83e0-457b-a363-cc921e0b946a req-8193113c-6f84-41b7-82e0-a77c7a184db0 service nova] Releasing lock "refresh_cache-18d8e887-0f91-42e1-ba79-13db5aa9b84b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:47:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-a018f02a-8771-4994-bab3-2eebb84f33fe req-866a54d3-3722-4950-ad83-cd1ee36450be service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Received event network-changed-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:47:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-a018f02a-8771-4994-bab3-2eebb84f33fe req-866a54d3-3722-4950-ad83-cd1ee36450be service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Refreshing instance network info cache due to event network-changed-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:47:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a018f02a-8771-4994-bab3-2eebb84f33fe req-866a54d3-3722-4950-ad83-cd1ee36450be service nova] Acquiring lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:47:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a018f02a-8771-4994-bab3-2eebb84f33fe req-866a54d3-3722-4950-ad83-cd1ee36450be service nova] Acquired lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:47:25 user nova-compute[73091]: DEBUG nova.network.neutron [req-a018f02a-8771-4994-bab3-2eebb84f33fe req-866a54d3-3722-4950-ad83-cd1ee36450be service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Refreshing network info cache for port a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:47:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Stashing vm_state: active {{(pid=73091) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 09 16:47:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:26 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lazy-loading 'pci_requests' on Instance uuid 97af1277-b4bd-4a89-903b-4f70087f0535 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:47:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:47:26 user nova-compute[73091]: INFO nova.compute.claims [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Claim successful on node user
Aug 09 16:47:26 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lazy-loading 'resources' on Instance uuid 97af1277-b4bd-4a89-903b-4f70087f0535 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:47:26 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lazy-loading 'pci_devices' on Instance uuid 97af1277-b4bd-4a89-903b-4f70087f0535 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:47:26 user nova-compute[73091]: INFO nova.compute.resource_tracker [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Updating resource usage from migration e6bc1e93-7c64-4de8-ae72-95a59498e872
Aug 09 16:47:26 user nova-compute[73091]: DEBUG nova.network.neutron [req-a018f02a-8771-4994-bab3-2eebb84f33fe req-866a54d3-3722-4950-ad83-cd1ee36450be service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Updated VIF entry in instance network info cache for port a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:47:26 user nova-compute[73091]: DEBUG nova.network.neutron [req-a018f02a-8771-4994-bab3-2eebb84f33fe req-866a54d3-3722-4950-ad83-cd1ee36450be service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Updating instance_info_cache with network_info: [{"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:47:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a018f02a-8771-4994-bab3-2eebb84f33fe req-866a54d3-3722-4950-ad83-cd1ee36450be service nova] Releasing lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:47:26 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:47:26 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:47:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.515s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:26 user nova-compute[73091]: INFO nova.compute.manager [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Migrating
Aug 09 16:47:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:47:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquired lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:47:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:47:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Updating instance_info_cache with network_info: [{"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:47:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Releasing lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:47:27 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599632.411883, 148cb211-b2f6-4782-8f35-e66a55cc95bc => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:47:27 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] VM Stopped (Lifecycle Event)
Aug 09 16:47:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Starting migrate_disk_and_power_off {{(pid=73091) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 09 16:47:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-62d32f41-7ef4-4b30-831f-d15601cb8baa None None] [instance: 148cb211-b2f6-4782-8f35-e66a55cc95bc] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:47:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-85e1cf40-34ec-4497-adea-08490a86882f req-c3308eb6-8a96-4ebb-93c2-39fe9e2826e9 service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Received event network-vif-unplugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:47:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-85e1cf40-34ec-4497-adea-08490a86882f req-c3308eb6-8a96-4ebb-93c2-39fe9e2826e9 service nova] Acquiring lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-85e1cf40-34ec-4497-adea-08490a86882f req-c3308eb6-8a96-4ebb-93c2-39fe9e2826e9 service nova] Lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-85e1cf40-34ec-4497-adea-08490a86882f req-c3308eb6-8a96-4ebb-93c2-39fe9e2826e9 service nova] Lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-85e1cf40-34ec-4497-adea-08490a86882f req-c3308eb6-8a96-4ebb-93c2-39fe9e2826e9 service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] No waiting events found dispatching network-vif-unplugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:47:27 user nova-compute[73091]: WARNING nova.compute.manager [req-85e1cf40-34ec-4497-adea-08490a86882f req-c3308eb6-8a96-4ebb-93c2-39fe9e2826e9 service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Received unexpected event network-vif-unplugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca for instance with vm_state active and task_state resize_migrating.
Aug 09 16:47:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:28 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Instance destroyed successfully.
Aug 09 16:47:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-946441557',display_name='tempest-ServerActionsTestOtherA-server-946441557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-946441557',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILfado63mW6+CgjHmwYiNct4RkaQ/hFrQzjzGZX9fcd5tmDChxbl9riU31kjgrW3xhMcxzy/FY8sPsumtyuqQ7ittcRZasxYBvL6XWrt/5jr8BpeJz8IvTq6jqpzExzYw==',key_name='tempest-keypair-1434010925',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:45:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='38c913ceef2c4610a26bd19df29ee896',ramdisk_id='',reservation_id='r-yjp8agt5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-813213856',owner_user_name='tempest-ServerActionsTestOtherA-813213856-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8956fad221ec4dedb700f034d5230c06',uuid=97af1277-b4bd-4a89-903b-4f70087f0535,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-597214137-network", "vif_mac": "fa:16:3e:d1:07:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converting VIF {"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-597214137-network", "vif_mac": "fa:16:3e:d1:07:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:07:07,bridge_name='br-int',has_traffic_filtering=True,id=a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ff67fb-2a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG os_vif [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:07:07,bridge_name='br-int',has_traffic_filtering=True,id=a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ff67fb-2a') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0ff67fb-2a, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:47:28 user nova-compute[73091]: INFO os_vif [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:07:07,bridge_name='br-int',has_traffic_filtering=True,id=a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ff67fb-2a')
Aug 09 16:47:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hztVspoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:47:28 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:47:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6f2c68-deb9-4711-9c4e-e82dd23d41cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[981b10e3-8899-4d32-afa2-5c13909cbc19]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:47:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:47:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff08025acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628'): ({'sdf'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Removing single pathed devices sdf {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3477446f-37ee-4ada-9a0a-963a9283309b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4bf9cd-259a-4aa8-bcee-9b48cc259e27]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Flushing IO for device /dev/sdf {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39b5ab5-596f-426d-8452-39348270dc91]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9583fbed-6d42-4927-b17d-232860e452b6]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c10d10-a3dd-4aaf-bf09-b2f8ef91f17f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[838d8f75-ad17-4c95-a438-9892a38e4f3f]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628, portal: 172.16.0.220,3260]
Aug 09 16:47:28 user nova-compute[73091]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628, portal: 172.16.0.220,3260] successful.
Aug 09 16:47:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b66a405-3c63-4c91-8514-6bca05132f76]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] <== disconnect_volume: return (303ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:47:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:47:29 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Port a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca binding to destination host user is already ACTIVE {{(pid=73091) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 16:47:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-4f83afe5-ec18-41b3-9faa-0215e4f63896 req-0a3f70fa-e795-4df1-aa0d-0fcabb95d659 service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Received event network-vif-plugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:47:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4f83afe5-ec18-41b3-9faa-0215e4f63896 req-0a3f70fa-e795-4df1-aa0d-0fcabb95d659 service nova] Acquiring lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4f83afe5-ec18-41b3-9faa-0215e4f63896 req-0a3f70fa-e795-4df1-aa0d-0fcabb95d659 service nova] Lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4f83afe5-ec18-41b3-9faa-0215e4f63896 req-0a3f70fa-e795-4df1-aa0d-0fcabb95d659 service nova] Lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-4f83afe5-ec18-41b3-9faa-0215e4f63896 req-0a3f70fa-e795-4df1-aa0d-0fcabb95d659 service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] No waiting events found dispatching network-vif-plugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:47:29 user nova-compute[73091]: WARNING nova.compute.manager [req-4f83afe5-ec18-41b3-9faa-0215e4f63896 req-0a3f70fa-e795-4df1-aa0d-0fcabb95d659 service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Received unexpected event network-vif-plugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca for instance with vm_state active and task_state resize_migrating.
Aug 09 16:47:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:47:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquired lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:47:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:47:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-fa5d2fd1-463d-411d-ba70-d238bc16d654 req-d1f1e759-8713-48dd-8a4e-fa3cb40b3467 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Received event network-changed-4f550175-ab3c-4b43-9a63-fd5b429773f3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:47:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-fa5d2fd1-463d-411d-ba70-d238bc16d654 req-d1f1e759-8713-48dd-8a4e-fa3cb40b3467 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Refreshing instance network info cache due to event network-changed-4f550175-ab3c-4b43-9a63-fd5b429773f3. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:47:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fa5d2fd1-463d-411d-ba70-d238bc16d654 req-d1f1e759-8713-48dd-8a4e-fa3cb40b3467 service nova] Acquiring lock "refresh_cache-b9639ddc-0ff9-41d2-b647-3af5fce945c2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:47:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fa5d2fd1-463d-411d-ba70-d238bc16d654 req-d1f1e759-8713-48dd-8a4e-fa3cb40b3467 service nova] Acquired lock "refresh_cache-b9639ddc-0ff9-41d2-b647-3af5fce945c2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:47:30 user nova-compute[73091]: DEBUG nova.network.neutron [req-fa5d2fd1-463d-411d-ba70-d238bc16d654 req-d1f1e759-8713-48dd-8a4e-fa3cb40b3467 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Refreshing network info cache for port 4f550175-ab3c-4b43-9a63-fd5b429773f3 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:47:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Updating instance_info_cache with network_info: [{"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:47:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Releasing lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG os_brick.utils [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.036s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bf4f6b-4433-4a41-93b8-cff25f31f78e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb91f4e-f1a3-4337-b9d4-cee3dc8c8ec6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee3268a-9a07-49dc-b1d0-98172169a106]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[58155254-8b82-4adb-8ed0-a311120b1e8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:47:31 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[770b9a73-a83c-4d66-8122-562463ecea22]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG os_brick.utils [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG nova.objects.instance [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lazy-loading 'flavor' on Instance uuid b9639ddc-0ff9-41d2-b647-3af5fce945c2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-fa5d2fd1-463d-411d-ba70-d238bc16d654 req-d1f1e759-8713-48dd-8a4e-fa3cb40b3467 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Updated VIF entry in instance network info cache for port 4f550175-ab3c-4b43-9a63-fd5b429773f3. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-fa5d2fd1-463d-411d-ba70-d238bc16d654 req-d1f1e759-8713-48dd-8a4e-fa3cb40b3467 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Updating instance_info_cache with network_info: [{"id": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "address": "fa:16:3e:07:e7:b6", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f550175-ab", "ovs_interfaceid": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fa5d2fd1-463d-411d-ba70-d238bc16d654 req-d1f1e759-8713-48dd-8a4e-fa3cb40b3467 service nova] Releasing lock "refresh_cache-b9639ddc-0ff9-41d2-b647-3af5fce945c2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:31 user nova-compute[73091]: INFO nova.compute.manager [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Attaching volume 93f39caf-2dbd-4472-b931-7d08ad5feaaf to /dev/vdb
Aug 09 16:47:31 user nova-compute[73091]: DEBUG os_brick.utils [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7a3b3c-987d-45df-b987-d3a0cc45c61a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45d3dbf-d405-4ba1-a7ab-25b20a0a133d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5bd5b1-bb82-450d-9470-0427714d07a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba2a1d8-d101-4674-84bb-5102c14b5bb4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:47:31 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:47:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d40983-5308-45ed-aa31-6eaf4b67dc39]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG os_brick.utils [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:47:31 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Updating existing volume attachment record: 056797e6-2cbf-409f-b5a0-f4d885ab5a8f {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:47:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:47:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:47:38 user nova-compute[73091]: INFO nova.compute.claims [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Claim successful on node user
Aug 09 16:47:39 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:47:39 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:47:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG nova.policy [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef7727ab5d1b46d383bfc02750d29ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a03dd6b23c840c7b4a07f0235c1051b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:47:39 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Creating image(s)
Aug 09 16:47:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "/opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "/opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.167s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Starting finish_migration {{(pid=73091) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 16:47:39 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Creating image(s)
Aug 09 16:47:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Ensure instance console log exists: /opt/stack/data/nova/instances/97af1277-b4bd-4a89-903b-4f70087f0535/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Start _get_guest_xml network_info=[{"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-597214137-network", "vif_mac": "fa:16:3e:d1:07:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '0f866742-948f-43dc-bdd1-37cc32e9c29e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hztVspoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '97af1277-b4bd-4a89-903b-4f70087f0535', 'attached_at': '2023-08-09T16:47:40.000000', 'detached_at': '', 'volume_id': '35539ace-9cd8-4004-bdba-ccd3d56a7628', 'serial': '35539ace-9cd8-4004-bdba-ccd3d56a7628'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.177s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:39 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:47:39 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:47:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk 1073741824" returned: 0 in 0.062s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lazy-loading 'vcpu_model' on Instance uuid 97af1277-b4bd-4a89-903b-4f70087f0535 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hztVspoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:47:40 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:47:40 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:47:40 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[491c1f6a-f7e7-4bc2-9b7b-9f46afb3124a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:47:40 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ed6d11-71e2-4969-89c9-05fdf417efc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628] added
Aug 09 16:47:40 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7284ce2c-db1a-4809-8601-093654b37006]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Cannot resize image /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.objects.instance [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'migration_context' on Instance uuid 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.163s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e1ad86-0b64-4fd2-80af-60240557c46a]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hztVspoH {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Ensure instance console log exists: /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hztVspoH" returned: 0 in 0.030s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e34173a-08ba-4782-a81d-99e340921609]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hztVspoH'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1d202f-e4fd-410f-ae22-367f45233820]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7d7749-2ac2-4b4e-8335-b738551b1654]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 16:47:40 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 16:47:40 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:47:40 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 16:47:40 user nova-compute[73091]: 
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Successfully created port: eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc414b1-cdac-4c25-9907-eab7ad33eb63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628, portal: 172.16.0.220,3260]
Aug 09 16:47:40 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628, portal: 172.16.0.220,3260] successful.
Aug 09 16:47:40 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[16efc617-12b2-4a0b-80cd-4dda8f972bf1]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[728f5859-95dc-46d5-966f-010d0db6fdbc]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:47:40 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:47:40 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.493s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[85abd3ed-c6fd-42ee-bf5a-ec5f81f43da7]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hztVspoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdtfsIbE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:47:40 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:47:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Successfully updated port: eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquired lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-afb8a2d8-5ad6-441c-9a38-a6ba65c67fc9 req-9ec43b85-389c-4fe4-9553-dbc286198f3b service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received event network-changed-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-afb8a2d8-5ad6-441c-9a38-a6ba65c67fc9 req-9ec43b85-389c-4fe4-9553-dbc286198f3b service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Refreshing instance network info cache due to event network-changed-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-afb8a2d8-5ad6-441c-9a38-a6ba65c67fc9 req-9ec43b85-389c-4fe4-9553-dbc286198f3b service nova] Acquiring lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.538s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] <== connect_volume: return (1541ms) {'type': 'block', 'scsi_wwn': '26430616535373835', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430616535373835', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.893s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:47:41 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:47:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:47:41 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-946441557',display_name='tempest-ServerActionsTestOtherA-server-946441557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-946441557',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILfado63mW6+CgjHmwYiNct4RkaQ/hFrQzjzGZX9fcd5tmDChxbl9riU31kjgrW3xhMcxzy/FY8sPsumtyuqQ7ittcRZasxYBvL6XWrt/5jr8BpeJz8IvTq6jqpzExzYw==',key_name='tempest-keypair-1434010925',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:45:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='38c913ceef2c4610a26bd19df29ee896',ramdisk_id='',reservation_id='r-yjp8agt5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-813213856',owner_user_name='tempest-ServerActionsTestOtherA-813213856-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:47:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8956fad221ec4dedb700f034d5230c06',uuid=97af1277-b4bd-4a89-903b-4f70087f0535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-597214137-network", "vif_mac": "fa:16:3e:d1:07:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converting VIF {"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-597214137-network", "vif_mac": "fa:16:3e:d1:07:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:07:07,bridge_name='br-int',has_traffic_filtering=True,id=a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ff67fb-2a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:47:41 user nova-compute[73091]:   <uuid>97af1277-b4bd-4a89-903b-4f70087f0535</uuid>
Aug 09 16:47:41 user nova-compute[73091]:   <name>instance-0000001e</name>
Aug 09 16:47:41 user nova-compute[73091]:   <memory>2097152</memory>
Aug 09 16:47:41 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:47:41 user nova-compute[73091]:   <metadata>
Aug 09 16:47:41 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:47:41 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:47:41 user nova-compute[73091]:       <nova:name>tempest-ServerActionsTestOtherA-server-946441557</nova:name>
Aug 09 16:47:41 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:47:39</nova:creationTime>
Aug 09 16:47:41 user nova-compute[73091]:       <nova:flavor name="m1.small">
Aug 09 16:47:41 user nova-compute[73091]:         <nova:memory>2048</nova:memory>
Aug 09 16:47:41 user nova-compute[73091]:         <nova:disk>20</nova:disk>
Aug 09 16:47:41 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:47:41 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:47:41 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:47:41 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:47:41 user nova-compute[73091]:       <nova:owner>
Aug 09 16:47:41 user nova-compute[73091]:         <nova:user uuid="8956fad221ec4dedb700f034d5230c06">tempest-ServerActionsTestOtherA-813213856-project-member</nova:user>
Aug 09 16:47:41 user nova-compute[73091]:         <nova:project uuid="38c913ceef2c4610a26bd19df29ee896">tempest-ServerActionsTestOtherA-813213856</nova:project>
Aug 09 16:47:41 user nova-compute[73091]:       </nova:owner>
Aug 09 16:47:41 user nova-compute[73091]:       <nova:ports>
Aug 09 16:47:41 user nova-compute[73091]:         <nova:port uuid="a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca">
Aug 09 16:47:41 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 16:47:41 user nova-compute[73091]:         </nova:port>
Aug 09 16:47:41 user nova-compute[73091]:       </nova:ports>
Aug 09 16:47:41 user nova-compute[73091]:     </nova:instance>
Aug 09 16:47:41 user nova-compute[73091]:   </metadata>
Aug 09 16:47:41 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:47:41 user nova-compute[73091]:     <system>
Aug 09 16:47:41 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:47:41 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:47:41 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:47:41 user nova-compute[73091]:       <entry name="serial">97af1277-b4bd-4a89-903b-4f70087f0535</entry>
Aug 09 16:47:41 user nova-compute[73091]:       <entry name="uuid">97af1277-b4bd-4a89-903b-4f70087f0535</entry>
Aug 09 16:47:41 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:47:41 user nova-compute[73091]:     </system>
Aug 09 16:47:41 user nova-compute[73091]:   </sysinfo>
Aug 09 16:47:41 user nova-compute[73091]:   <os>
Aug 09 16:47:41 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:47:41 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:47:41 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:47:41 user nova-compute[73091]:   </os>
Aug 09 16:47:41 user nova-compute[73091]:   <features>
Aug 09 16:47:41 user nova-compute[73091]:     <acpi/>
Aug 09 16:47:41 user nova-compute[73091]:     <apic/>
Aug 09 16:47:41 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:47:41 user nova-compute[73091]:   </features>
Aug 09 16:47:41 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:47:41 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:47:41 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:47:41 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:47:41 user nova-compute[73091]:   </clock>
Aug 09 16:47:41 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:47:41 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:47:41 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:47:41 user nova-compute[73091]:   </cpu>
Aug 09 16:47:41 user nova-compute[73091]:   <devices>
Aug 09 16:47:41 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:47:41 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:47:41 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 09 16:47:41 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:47:41 user nova-compute[73091]:       <serial>35539ace-9cd8-4004-bdba-ccd3d56a7628</serial>
Aug 09 16:47:41 user nova-compute[73091]:     </disk>
Aug 09 16:47:41 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:47:41 user nova-compute[73091]:       <mac address="fa:16:3e:d1:07:07"/>
Aug 09 16:47:41 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:47:41 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:47:41 user nova-compute[73091]:       <target dev="tapa0ff67fb-2a"/>
Aug 09 16:47:41 user nova-compute[73091]:     </interface>
Aug 09 16:47:41 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:47:41 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/97af1277-b4bd-4a89-903b-4f70087f0535/console.log" append="off"/>
Aug 09 16:47:41 user nova-compute[73091]:     </serial>
Aug 09 16:47:41 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:47:41 user nova-compute[73091]:     <video>
Aug 09 16:47:41 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:47:41 user nova-compute[73091]:     </video>
Aug 09 16:47:41 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:47:41 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:47:41 user nova-compute[73091]:     </rng>
Aug 09 16:47:41 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:47:41 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:47:41 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:47:41 user nova-compute[73091]:     </memballoon>
Aug 09 16:47:41 user nova-compute[73091]:   </devices>
Aug 09 16:47:41 user nova-compute[73091]: </domain>
Aug 09 16:47:41 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-946441557',display_name='tempest-ServerActionsTestOtherA-server-946441557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-946441557',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILfado63mW6+CgjHmwYiNct4RkaQ/hFrQzjzGZX9fcd5tmDChxbl9riU31kjgrW3xhMcxzy/FY8sPsumtyuqQ7ittcRZasxYBvL6XWrt/5jr8BpeJz8IvTq6jqpzExzYw==',key_name='tempest-keypair-1434010925',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:45:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='38c913ceef2c4610a26bd19df29ee896',ramdisk_id='',reservation_id='r-yjp8agt5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-813213856',owner_user_name='tempest-ServerActionsTestOtherA-813213856-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:47:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8956fad221ec4dedb700f034d5230c06',uuid=97af1277-b4bd-4a89-903b-4f70087f0535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-597214137-network", "vif_mac": "fa:16:3e:d1:07:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converting VIF {"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-597214137-network", "vif_mac": "fa:16:3e:d1:07:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:07:07,bridge_name='br-int',has_traffic_filtering=True,id=a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ff67fb-2a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG os_vif [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:07:07,bridge_name='br-int',has_traffic_filtering=True,id=a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ff67fb-2a') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ce6805-82cf-4a8e-bed7-ef3341bc10f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:47:41 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0ff67fb-2a, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0ff67fb-2a, col_values=(('external_ids', {'iface-id': 'a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:07:07', 'vm-uuid': '97af1277-b4bd-4a89-903b-4f70087f0535'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:41 user nova-compute[73091]: INFO os_vif [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:07:07,bridge_name='br-int',has_traffic_filtering=True,id=a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ff67fb-2a')
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c4e0e6-079f-4639-a4ca-8ea22598f163]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf] added
Aug 09 16:47:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Updating instance_info_cache with network_info: [{"id": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "address": "fa:16:3e:6e:98:76", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb647b7d-fa", "ovs_interfaceid": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff76da55-8643-4341-8fad-9bf5f774aede]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Releasing lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Instance network_info: |[{"id": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "address": "fa:16:3e:6e:98:76", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb647b7d-fa", "ovs_interfaceid": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-afb8a2d8-5ad6-441c-9a38-a6ba65c67fc9 req-9ec43b85-389c-4fe4-9553-dbc286198f3b service nova] Acquired lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.network.neutron [req-afb8a2d8-5ad6-441c-9a38-a6ba65c67fc9 req-9ec43b85-389c-4fe4-9553-dbc286198f3b service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Refreshing network info cache for port eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Start _get_guest_xml network_info=[{"id": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "address": "fa:16:3e:6e:98:76", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb647b7d-fa", "ovs_interfaceid": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c800fa-1c80-4b96-a3a4-e0e2748446f3]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SdtfsIbE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:41 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:47:41 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SdtfsIbE" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[909c0e86-8246-4aab-9dd5-d807cba7f539]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SdtfsIbE'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] No VIF found with MAC fa:16:3e:d1:07:07, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1022344144',display_name='tempest-ServerRescueNegativeTestJSON-server-1022344144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1022344144',id=33,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJeBceutq8beCoz7o5tRRL6nOu5QPrjWN+s6rvp9Fvssl1/IzP36PGvY7B+nY9X7lGk8okKCsSnHSaKD5G55lUhqdGH+XIHRSNC2lzJa8k3fRIhiL23Yb1SGPcolqezVw==',key_name='tempest-keypair-1565128997',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a03dd6b23c840c7b4a07f0235c1051b',ramdisk_id='',reservation_id='r-77ymisa2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-596687024',owner_user_name='tempest-ServerRescueNegativeTestJSON-596687024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:47:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef7727ab5d1b46d383bfc02750d29ec7',uuid=3ef6c7f1-c8c4-49e1-819a-e8196eae70e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "address": "fa:16:3e:6e:98:76", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb647b7d-fa", "ovs_interfaceid": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converting VIF {"id": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "address": "fa:16:3e:6e:98:76", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb647b7d-fa", "ovs_interfaceid": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:98:76,bridge_name='br-int',has_traffic_filtering=True,id=eb647b7d-fa5b-4876-99da-b3c3ef59c0e7,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb647b7d-fa') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.objects.instance [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a3c46c-cad4-473a-bcde-4da384b17d2d]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:47:41 user nova-compute[73091]:   <uuid>3ef6c7f1-c8c4-49e1-819a-e8196eae70e2</uuid>
Aug 09 16:47:41 user nova-compute[73091]:   <name>instance-00000021</name>
Aug 09 16:47:41 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:47:41 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:47:41 user nova-compute[73091]:   <metadata>
Aug 09 16:47:41 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:47:41 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:47:41 user nova-compute[73091]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1022344144</nova:name>
Aug 09 16:47:41 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:47:41</nova:creationTime>
Aug 09 16:47:41 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:47:41 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:47:41 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:47:41 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:47:41 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:47:41 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:47:41 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:47:41 user nova-compute[73091]:       <nova:owner>
Aug 09 16:47:41 user nova-compute[73091]:         <nova:user uuid="ef7727ab5d1b46d383bfc02750d29ec7">tempest-ServerRescueNegativeTestJSON-596687024-project-member</nova:user>
Aug 09 16:47:41 user nova-compute[73091]:         <nova:project uuid="1a03dd6b23c840c7b4a07f0235c1051b">tempest-ServerRescueNegativeTestJSON-596687024</nova:project>
Aug 09 16:47:41 user nova-compute[73091]:       </nova:owner>
Aug 09 16:47:41 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:47:41 user nova-compute[73091]:       <nova:ports>
Aug 09 16:47:41 user nova-compute[73091]:         <nova:port uuid="eb647b7d-fa5b-4876-99da-b3c3ef59c0e7">
Aug 09 16:47:41 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 16:47:41 user nova-compute[73091]:         </nova:port>
Aug 09 16:47:41 user nova-compute[73091]:       </nova:ports>
Aug 09 16:47:41 user nova-compute[73091]:     </nova:instance>
Aug 09 16:47:41 user nova-compute[73091]:   </metadata>
Aug 09 16:47:41 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:47:41 user nova-compute[73091]:     <system>
Aug 09 16:47:41 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:47:41 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:47:41 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:47:41 user nova-compute[73091]:       <entry name="serial">3ef6c7f1-c8c4-49e1-819a-e8196eae70e2</entry>
Aug 09 16:47:41 user nova-compute[73091]:       <entry name="uuid">3ef6c7f1-c8c4-49e1-819a-e8196eae70e2</entry>
Aug 09 16:47:41 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:47:41 user nova-compute[73091]:     </system>
Aug 09 16:47:41 user nova-compute[73091]:   </sysinfo>
Aug 09 16:47:41 user nova-compute[73091]:   <os>
Aug 09 16:47:41 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:47:41 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:47:41 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:47:41 user nova-compute[73091]:   </os>
Aug 09 16:47:41 user nova-compute[73091]:   <features>
Aug 09 16:47:41 user nova-compute[73091]:     <acpi/>
Aug 09 16:47:41 user nova-compute[73091]:     <apic/>
Aug 09 16:47:41 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:47:41 user nova-compute[73091]:   </features>
Aug 09 16:47:41 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:47:41 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:47:41 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:47:41 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:47:41 user nova-compute[73091]:   </clock>
Aug 09 16:47:41 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:47:41 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:47:41 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:47:41 user nova-compute[73091]:   </cpu>
Aug 09 16:47:41 user nova-compute[73091]:   <devices>
Aug 09 16:47:41 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:47:41 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:47:41 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk"/>
Aug 09 16:47:41 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:47:41 user nova-compute[73091]:     </disk>
Aug 09 16:47:41 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:47:41 user nova-compute[73091]:       <mac address="fa:16:3e:6e:98:76"/>
Aug 09 16:47:41 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:47:41 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:47:41 user nova-compute[73091]:       <target dev="tapeb647b7d-fa"/>
Aug 09 16:47:41 user nova-compute[73091]:     </interface>
Aug 09 16:47:41 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:47:41 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/console.log" append="off"/>
Aug 09 16:47:41 user nova-compute[73091]:     </serial>
Aug 09 16:47:41 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:47:41 user nova-compute[73091]:     <video>
Aug 09 16:47:41 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:47:41 user nova-compute[73091]:     </video>
Aug 09 16:47:41 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:47:41 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:47:41 user nova-compute[73091]:     </rng>
Aug 09 16:47:41 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:47:41 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:47:41 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:47:41 user nova-compute[73091]:     </memballoon>
Aug 09 16:47:41 user nova-compute[73091]:   </devices>
Aug 09 16:47:41 user nova-compute[73091]: </domain>
Aug 09 16:47:41 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1022344144',display_name='tempest-ServerRescueNegativeTestJSON-server-1022344144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1022344144',id=33,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJeBceutq8beCoz7o5tRRL6nOu5QPrjWN+s6rvp9Fvssl1/IzP36PGvY7B+nY9X7lGk8okKCsSnHSaKD5G55lUhqdGH+XIHRSNC2lzJa8k3fRIhiL23Yb1SGPcolqezVw==',key_name='tempest-keypair-1565128997',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a03dd6b23c840c7b4a07f0235c1051b',ramdisk_id='',reservation_id='r-77ymisa2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-596687024',owner_user_name='tempest-ServerRescueNegativeTestJSON-596687024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:47:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef7727ab5d1b46d383bfc02750d29ec7',uuid=3ef6c7f1-c8c4-49e1-819a-e8196eae70e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "address": "fa:16:3e:6e:98:76", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb647b7d-fa", "ovs_interfaceid": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converting VIF {"id": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "address": "fa:16:3e:6e:98:76", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb647b7d-fa", "ovs_interfaceid": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:98:76,bridge_name='br-int',has_traffic_filtering=True,id=eb647b7d-fa5b-4876-99da-b3c3ef59c0e7,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb647b7d-fa') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG os_vif [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:98:76,bridge_name='br-int',has_traffic_filtering=True,id=eb647b7d-fa5b-4876-99da-b3c3ef59c0e7,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb647b7d-fa') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb647b7d-fa, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb647b7d-fa, col_values=(('external_ids', {'iface-id': 'eb647b7d-fa5b-4876-99da-b3c3ef59c0e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:98:76', 'vm-uuid': '3ef6c7f1-c8c4-49e1-819a-e8196eae70e2'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f8d38f-f244-4625-a8d3-64dae3f251b0]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:47:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:47:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:41 user nova-compute[73091]: INFO os_vif [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:98:76,bridge_name='br-int',has_traffic_filtering=True,id=eb647b7d-fa5b-4876-99da-b3c3ef59c0e7,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb647b7d-fa')
Aug 09 16:47:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0912c58d-f5c4-4ed6-a029-2521e15f49ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf, portal: 172.16.0.220,3260]
Aug 09 16:47:42 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf, portal: 172.16.0.220,3260] successful.
Aug 09 16:47:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] No VIF found with MAC fa:16:3e:6e:98:76, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c871c3-9b91-40b0-bf30-595f61571953]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d555163-208d-46d9-80b3-637348e00ea1]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:47:42 user nova-compute[73091]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf (non-flash)
Aug 09 16:47:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:47:42 user nova-compute[73091]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf (non-flash)
Aug 09 16:47:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee6ba01-220e-4772-8368-15f354515dd3]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdtfsIbE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG nova.network.neutron [req-afb8a2d8-5ad6-441c-9a38-a6ba65c67fc9 req-9ec43b85-389c-4fe4-9553-dbc286198f3b service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Updated VIF entry in instance network info cache for port eb647b7d-fa5b-4876-99da-b3c3ef59c0e7. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG nova.network.neutron [req-afb8a2d8-5ad6-441c-9a38-a6ba65c67fc9 req-9ec43b85-389c-4fe4-9553-dbc286198f3b service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Updating instance_info_cache with network_info: [{"id": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "address": "fa:16:3e:6e:98:76", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb647b7d-fa", "ovs_interfaceid": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:47:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-afb8a2d8-5ad6-441c-9a38-a6ba65c67fc9 req-9ec43b85-389c-4fe4-9553-dbc286198f3b service nova] Releasing lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:47:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:47:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] <== connect_volume: return (2280ms) {'type': 'block', 'scsi_wwn': '23461373561323536', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:47:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461373561323536', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:47:43 user nova-compute[73091]: DEBUG nova.objects.instance [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lazy-loading 'flavor' on Instance uuid b9639ddc-0ff9-41d2-b647-3af5fce945c2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:47:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:47:43 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:47:43 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 09 16:47:43 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:47:43 user nova-compute[73091]:   <serial>93f39caf-2dbd-4472-b931-7d08ad5feaaf</serial>
Aug 09 16:47:43 user nova-compute[73091]: </disk>
Aug 09 16:47:43 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:47:43 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599648.199519, 97af1277-b4bd-4a89-903b-4f70087f0535 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:47:43 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] VM Stopped (Lifecycle Event)
Aug 09 16:47:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6146b4b4-c07b-4e3a-91f3-9bc91f705447 None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] No VIF found with MAC fa:16:3e:07:e7:b6, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-208ef0b1-ce11-45ec-902f-5e1f622caabd tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.800s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-943dc924-ca05-461a-a269-ccc0257cc3c2 req-03d1406a-c3fc-4fd0-9a8b-2a04265e715d service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Received event network-vif-plugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-943dc924-ca05-461a-a269-ccc0257cc3c2 req-03d1406a-c3fc-4fd0-9a8b-2a04265e715d service nova] Acquiring lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-943dc924-ca05-461a-a269-ccc0257cc3c2 req-03d1406a-c3fc-4fd0-9a8b-2a04265e715d service nova] Lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-943dc924-ca05-461a-a269-ccc0257cc3c2 req-03d1406a-c3fc-4fd0-9a8b-2a04265e715d service nova] Lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-943dc924-ca05-461a-a269-ccc0257cc3c2 req-03d1406a-c3fc-4fd0-9a8b-2a04265e715d service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] No waiting events found dispatching network-vif-plugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:47:44 user nova-compute[73091]: WARNING nova.compute.manager [req-943dc924-ca05-461a-a269-ccc0257cc3c2 req-03d1406a-c3fc-4fd0-9a8b-2a04265e715d service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Received unexpected event network-vif-plugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca for instance with vm_state active and task_state resize_finish.
Aug 09 16:47:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-fc231884-9542-4709-bfb3-a552560a243e req-b74dce83-bbb0-471f-ba7f-66a82d797849 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received event network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fc231884-9542-4709-bfb3-a552560a243e req-b74dce83-bbb0-471f-ba7f-66a82d797849 service nova] Acquiring lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fc231884-9542-4709-bfb3-a552560a243e req-b74dce83-bbb0-471f-ba7f-66a82d797849 service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fc231884-9542-4709-bfb3-a552560a243e req-b74dce83-bbb0-471f-ba7f-66a82d797849 service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-fc231884-9542-4709-bfb3-a552560a243e req-b74dce83-bbb0-471f-ba7f-66a82d797849 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] No waiting events found dispatching network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:47:44 user nova-compute[73091]: WARNING nova.compute.manager [req-fc231884-9542-4709-bfb3-a552560a243e req-b74dce83-bbb0-471f-ba7f-66a82d797849 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received unexpected event network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 for instance with vm_state building and task_state spawning.
Aug 09 16:47:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:46 user nova-compute[73091]: INFO nova.compute.manager [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Detaching volume 93f39caf-2dbd-4472-b931-7d08ad5feaaf
Aug 09 16:47:46 user nova-compute[73091]: INFO nova.virt.block_device [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Attempting to driver detach volume 93f39caf-2dbd-4472-b931-7d08ad5feaaf from mountpoint /dev/vdb
Aug 09 16:47:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Attempting to detach device vdb from instance b9639ddc-0ff9-41d2-b647-3af5fce945c2 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:47:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:47:46 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:47:46 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 09 16:47:46 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:47:46 user nova-compute[73091]:   <serial>93f39caf-2dbd-4472-b931-7d08ad5feaaf</serial>
Aug 09 16:47:46 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:47:46 user nova-compute[73091]: </disk>
Aug 09 16:47:46 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:47:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Successfully detached device vdb from instance b9639ddc-0ff9-41d2-b647-3af5fce945c2 from the persistent domain config.
Aug 09 16:47:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b9639ddc-0ff9-41d2-b647-3af5fce945c2 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:47:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:47:46 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:47:46 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 09 16:47:46 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:47:46 user nova-compute[73091]:   <serial>93f39caf-2dbd-4472-b931-7d08ad5feaaf</serial>
Aug 09 16:47:46 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:47:46 user nova-compute[73091]: </disk>
Aug 09 16:47:46 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:47:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-2be3564d-dc5f-471b-92f8-1fee437b1b03 req-05ebc19e-fe47-4a3d-858a-8693ed4ab0ea service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Received event network-vif-plugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:47:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2be3564d-dc5f-471b-92f8-1fee437b1b03 req-05ebc19e-fe47-4a3d-858a-8693ed4ab0ea service nova] Acquiring lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2be3564d-dc5f-471b-92f8-1fee437b1b03 req-05ebc19e-fe47-4a3d-858a-8693ed4ab0ea service nova] Lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2be3564d-dc5f-471b-92f8-1fee437b1b03 req-05ebc19e-fe47-4a3d-858a-8693ed4ab0ea service nova] Lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-2be3564d-dc5f-471b-92f8-1fee437b1b03 req-05ebc19e-fe47-4a3d-858a-8693ed4ab0ea service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] No waiting events found dispatching network-vif-plugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:47:46 user nova-compute[73091]: WARNING nova.compute.manager [req-2be3564d-dc5f-471b-92f8-1fee437b1b03 req-05ebc19e-fe47-4a3d-858a-8693ed4ab0ea service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Received unexpected event network-vif-plugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca for instance with vm_state active and task_state resize_finish.
Aug 09 16:47:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-ef7877ee-0873-46dd-96b7-b362a973582c req-56f62998-d8e2-4ee0-b916-c7ce7a95d85a service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received event network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ef7877ee-0873-46dd-96b7-b362a973582c req-56f62998-d8e2-4ee0-b916-c7ce7a95d85a service nova] Acquiring lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ef7877ee-0873-46dd-96b7-b362a973582c req-56f62998-d8e2-4ee0-b916-c7ce7a95d85a service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ef7877ee-0873-46dd-96b7-b362a973582c req-56f62998-d8e2-4ee0-b916-c7ce7a95d85a service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-ef7877ee-0873-46dd-96b7-b362a973582c req-56f62998-d8e2-4ee0-b916-c7ce7a95d85a service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] No waiting events found dispatching network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:47:47 user nova-compute[73091]: WARNING nova.compute.manager [req-ef7877ee-0873-46dd-96b7-b362a973582c req-56f62998-d8e2-4ee0-b916-c7ce7a95d85a service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received unexpected event network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 for instance with vm_state building and task_state spawning.
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691599667.0696213, b9639ddc-0ff9-41d2-b647-3af5fce945c2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b9639ddc-0ff9-41d2-b647-3af5fce945c2 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:47:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Successfully detached device vdb from instance b9639ddc-0ff9-41d2-b647-3af5fce945c2 from the live domain config.
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdtfsIbE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:47:47 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:47:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6e2fc7-1385-4c74-a891-bb612d1119d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4d95bc-f843-4103-aef8-686accd0e289]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:47:47 user nova-compute[73091]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf (non-flash)
Aug 09 16:47:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:47:47 user nova-compute[73091]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf (non-flash)
Aug 09 16:47:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0801c27a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0204ef-7d28-4e96-bb16-c15b359ad2a9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a6ff6d-4a1a-4648-aa1b-682b154a352e]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8ea908-c233-4a19-93cc-0e9e8b97f46b]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f7f427-c75c-4b72-a5a0-7ed1f84392b3]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb829ebd-fab4-4181-84ce-200ff274a6d8]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b211b5f5-da5b-48c1-b2d1-3732776f3ac4]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf, portal: 172.16.0.220,3260]
Aug 09 16:47:47 user nova-compute[73091]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf, portal: 172.16.0.220,3260] successful.
Aug 09 16:47:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599667.4227264, 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:47:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] VM Resumed (Lifecycle Event)
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f39caf-2dbd-4472-b931-7d08ad5feaaf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[29808116-f6bd-48c9-a961-f4047121c6a1]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] <== disconnect_volume: return (341ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:47:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Instance spawned successfully.
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:47:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Instance running successfully.
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Failed to set time: agent not configured {{(pid=73091) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8e2c05ea-09c5-4404-b5c6-d8988feb07d0 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] finish_migration finished successfully. {{(pid=73091) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:47:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599667.430184, 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:47:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] VM Started (Lifecycle Event)
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:47:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599667.4316576, 97af1277-b4bd-4a89-903b-4f70087f0535 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:47:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] VM Resumed (Lifecycle Event)
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:47:47 user nova-compute[73091]: INFO nova.compute.manager [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Took 8.06 seconds to spawn the instance on the hypervisor.
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:47:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599667.432145, 97af1277-b4bd-4a89-903b-4f70087f0535 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:47:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] VM Started (Lifecycle Event)
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:47:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:47:47 user nova-compute[73091]: INFO nova.compute.manager [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Took 8.97 seconds to build instance.
Aug 09 16:47:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9890613b-68ad-4b60-8ad7-feb92d3df108 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.076s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lazy-loading 'flavor' on Instance uuid b9639ddc-0ff9-41d2-b647-3af5fce945c2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:47:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e55ed25-d0d7-43e7-96d9-5c6a63235e0c tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.868s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:47:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:47:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:48:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:48:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:06 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:48:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:11 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:48:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:48:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "c3871ef4-45e7-4118-8227-e48cc857d481" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "c3871ef4-45e7-4118-8227-e48cc857d481" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:48:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "4a39f479-265c-49c3-86c4-a65fff2f06c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "4a39f479-265c-49c3-86c4-a65fff2f06c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "4a39f479-265c-49c3-86c4-a65fff2f06c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "4a39f479-265c-49c3-86c4-a65fff2f06c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "4a39f479-265c-49c3-86c4-a65fff2f06c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:12 user nova-compute[73091]: INFO nova.compute.manager [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Terminating instance
Aug 09 16:48:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:48:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:12 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:48:12 user nova-compute[73091]: INFO nova.compute.claims [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Claim successful on node user
Aug 09 16:48:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:48:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:48:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 16:48:12 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-7d5c9370-603b-4ab0-a513-39847f83e105 req-1ef5b403-035e-42f3-9094-92d5770e61ed service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Received event network-vif-unplugged-7c149e7c-01fc-4bfc-a69d-8c1841f904e9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7d5c9370-603b-4ab0-a513-39847f83e105 req-1ef5b403-035e-42f3-9094-92d5770e61ed service nova] Acquiring lock "4a39f479-265c-49c3-86c4-a65fff2f06c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7d5c9370-603b-4ab0-a513-39847f83e105 req-1ef5b403-035e-42f3-9094-92d5770e61ed service nova] Lock "4a39f479-265c-49c3-86c4-a65fff2f06c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7d5c9370-603b-4ab0-a513-39847f83e105 req-1ef5b403-035e-42f3-9094-92d5770e61ed service nova] Lock "4a39f479-265c-49c3-86c4-a65fff2f06c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-7d5c9370-603b-4ab0-a513-39847f83e105 req-1ef5b403-035e-42f3-9094-92d5770e61ed service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] No waiting events found dispatching network-vif-unplugged-7c149e7c-01fc-4bfc-a69d-8c1841f904e9 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-7d5c9370-603b-4ab0-a513-39847f83e105 req-1ef5b403-035e-42f3-9094-92d5770e61ed service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Received event network-vif-unplugged-7c149e7c-01fc-4bfc-a69d-8c1841f904e9 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:48:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:48:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Instance destroyed successfully.
Aug 09 16:48:13 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'resources' on Instance uuid 4a39f479-265c-49c3-86c4-a65fff2f06c4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1748631261',display_name='tempest-AttachVolumeNegativeTest-server-1748631261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1748631261',id=26,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLYGzKthf41kJWgs1eItgXBE4Y6m6IFtDLHIY7mbx+frJqx2Yp7ne3YHnedZDEYOqprhRc3EDjFjFBndAXrtclsHGulkjfmcIkZr/cpxMOlnt3LJfeqChutV9gD/NFJag==',key_name='tempest-keypair-1708049104',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:42:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27f2275630ce4d55bf02851df830b6bd',ramdisk_id='',reservation_id='r-ycmzjawr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-604747333',owner_user_name='tempest-AttachVolumeNegativeTest-604747333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:42:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a5c393d644c4c3f8e9cbb0805ba7c08',uuid=4a39f479-265c-49c3-86c4-a65fff2f06c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "address": "fa:16:3e:89:17:f3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c149e7c-01", "ovs_interfaceid": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converting VIF {"id": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "address": "fa:16:3e:89:17:f3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c149e7c-01", "ovs_interfaceid": "7c149e7c-01fc-4bfc-a69d-8c1841f904e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:17:f3,bridge_name='br-int',has_traffic_filtering=True,id=7c149e7c-01fc-4bfc-a69d-8c1841f904e9,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c149e7c-01') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG os_vif [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:17:f3,bridge_name='br-int',has_traffic_filtering=True,id=7c149e7c-01fc-4bfc-a69d-8c1841f904e9,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c149e7c-01') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c149e7c-01, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:13 user nova-compute[73091]: INFO os_vif [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:17:f3,bridge_name='br-int',has_traffic_filtering=True,id=7c149e7c-01fc-4bfc-a69d-8c1841f904e9,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c149e7c-01')
Aug 09 16:48:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Deleting instance files /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4_del
Aug 09 16:48:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Deletion of /opt/stack/data/nova/instances/4a39f479-265c-49c3-86c4-a65fff2f06c4_del complete
Aug 09 16:48:13 user nova-compute[73091]: DEBUG nova.policy [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b831573c2594072890b548abda013e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39308f2160f14a1cb5ee136458054726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:48:13 user nova-compute[73091]: INFO nova.compute.manager [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 16:48:13 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:48:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Creating image(s)
Aug 09 16:48:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "/opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "/opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk 1073741824" returned: 0 in 0.067s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.154s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:14 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:48:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:14 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Cannot resize image /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:48:14 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'migration_context' on Instance uuid c3871ef4-45e7-4118-8227-e48cc857d481 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:48:14 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Successfully created port: 1d3f6a45-6b36-4603-b510-442d6ba16232 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:48:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:48:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Ensure instance console log exists: /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:48:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:14 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:48:14 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Took 1.24 seconds to deallocate network for instance.
Aug 09 16:48:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Successfully updated port: 1d3f6a45-6b36-4603-b510-442d6ba16232 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "refresh_cache-c3871ef4-45e7-4118-8227-e48cc857d481" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquired lock "refresh_cache-c3871ef4-45e7-4118-8227-e48cc857d481" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-bcf8a2cf-87d6-4a75-ae85-903fc11e0e4b req-b3cd2e09-2e4e-41de-9897-abaf4d32352b service nova] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Received event network-changed-1d3f6a45-6b36-4603-b510-442d6ba16232 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-bcf8a2cf-87d6-4a75-ae85-903fc11e0e4b req-b3cd2e09-2e4e-41de-9897-abaf4d32352b service nova] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Refreshing instance network info cache due to event network-changed-1d3f6a45-6b36-4603-b510-442d6ba16232. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bcf8a2cf-87d6-4a75-ae85-903fc11e0e4b req-b3cd2e09-2e4e-41de-9897-abaf4d32352b service nova] Acquiring lock "refresh_cache-c3871ef4-45e7-4118-8227-e48cc857d481" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:48:15 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Deleted allocations for instance 4a39f479-265c-49c3-86c4-a65fff2f06c4
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-969c7d68-4356-47ea-aab7-7174b3046db1 req-2e3b027f-63f7-4f98-b9c6-408eaaa3943e service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Received event network-vif-plugged-7c149e7c-01fc-4bfc-a69d-8c1841f904e9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-969c7d68-4356-47ea-aab7-7174b3046db1 req-2e3b027f-63f7-4f98-b9c6-408eaaa3943e service nova] Acquiring lock "4a39f479-265c-49c3-86c4-a65fff2f06c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-969c7d68-4356-47ea-aab7-7174b3046db1 req-2e3b027f-63f7-4f98-b9c6-408eaaa3943e service nova] Lock "4a39f479-265c-49c3-86c4-a65fff2f06c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-969c7d68-4356-47ea-aab7-7174b3046db1 req-2e3b027f-63f7-4f98-b9c6-408eaaa3943e service nova] Lock "4a39f479-265c-49c3-86c4-a65fff2f06c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-969c7d68-4356-47ea-aab7-7174b3046db1 req-2e3b027f-63f7-4f98-b9c6-408eaaa3943e service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] No waiting events found dispatching network-vif-plugged-7c149e7c-01fc-4bfc-a69d-8c1841f904e9 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:48:15 user nova-compute[73091]: WARNING nova.compute.manager [req-969c7d68-4356-47ea-aab7-7174b3046db1 req-2e3b027f-63f7-4f98-b9c6-408eaaa3943e service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Received unexpected event network-vif-plugged-7c149e7c-01fc-4bfc-a69d-8c1841f904e9 for instance with vm_state deleted and task_state None.
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-969c7d68-4356-47ea-aab7-7174b3046db1 req-2e3b027f-63f7-4f98-b9c6-408eaaa3943e service nova] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Received event network-vif-deleted-7c149e7c-01fc-4bfc-a69d-8c1841f904e9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7ca24c4d-a6ab-477d-bad5-60f70a754330 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "4a39f479-265c-49c3-86c4-a65fff2f06c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.656s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Updating instance_info_cache with network_info: [{"id": "1d3f6a45-6b36-4603-b510-442d6ba16232", "address": "fa:16:3e:78:8d:86", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3f6a45-6b", "ovs_interfaceid": "1d3f6a45-6b36-4603-b510-442d6ba16232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Releasing lock "refresh_cache-c3871ef4-45e7-4118-8227-e48cc857d481" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Instance network_info: |[{"id": "1d3f6a45-6b36-4603-b510-442d6ba16232", "address": "fa:16:3e:78:8d:86", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3f6a45-6b", "ovs_interfaceid": "1d3f6a45-6b36-4603-b510-442d6ba16232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bcf8a2cf-87d6-4a75-ae85-903fc11e0e4b req-b3cd2e09-2e4e-41de-9897-abaf4d32352b service nova] Acquired lock "refresh_cache-c3871ef4-45e7-4118-8227-e48cc857d481" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.network.neutron [req-bcf8a2cf-87d6-4a75-ae85-903fc11e0e4b req-b3cd2e09-2e4e-41de-9897-abaf4d32352b service nova] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Refreshing network info cache for port 1d3f6a45-6b36-4603-b510-442d6ba16232 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Start _get_guest_xml network_info=[{"id": "1d3f6a45-6b36-4603-b510-442d6ba16232", "address": "fa:16:3e:78:8d:86", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3f6a45-6b", "ovs_interfaceid": "1d3f6a45-6b36-4603-b510-442d6ba16232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:48:15 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:48:15 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1649553508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1649553508',id=34,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39308f2160f14a1cb5ee136458054726',ramdisk_id='',reservation_id='r-cgrda13f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:48:14Z,user_data=None,user_id='1b831573c2594072890b548abda013e3',uuid=c3871ef4-45e7-4118-8227-e48cc857d481,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d3f6a45-6b36-4603-b510-442d6ba16232", "address": "fa:16:3e:78:8d:86", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3f6a45-6b", "ovs_interfaceid": "1d3f6a45-6b36-4603-b510-442d6ba16232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converting VIF {"id": "1d3f6a45-6b36-4603-b510-442d6ba16232", "address": "fa:16:3e:78:8d:86", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3f6a45-6b", "ovs_interfaceid": "1d3f6a45-6b36-4603-b510-442d6ba16232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:8d:86,bridge_name='br-int',has_traffic_filtering=True,id=1d3f6a45-6b36-4603-b510-442d6ba16232,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3f6a45-6b') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'pci_devices' on Instance uuid c3871ef4-45e7-4118-8227-e48cc857d481 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:48:15 user nova-compute[73091]:   <uuid>c3871ef4-45e7-4118-8227-e48cc857d481</uuid>
Aug 09 16:48:15 user nova-compute[73091]:   <name>instance-00000022</name>
Aug 09 16:48:15 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:48:15 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:48:15 user nova-compute[73091]:   <metadata>
Aug 09 16:48:15 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:48:15 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:48:15 user nova-compute[73091]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1649553508</nova:name>
Aug 09 16:48:15 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:48:15</nova:creationTime>
Aug 09 16:48:15 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:48:15 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:48:15 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:48:15 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:48:15 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:48:15 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:48:15 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:48:15 user nova-compute[73091]:       <nova:owner>
Aug 09 16:48:15 user nova-compute[73091]:         <nova:user uuid="1b831573c2594072890b548abda013e3">tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member</nova:user>
Aug 09 16:48:15 user nova-compute[73091]:         <nova:project uuid="39308f2160f14a1cb5ee136458054726">tempest-ServerBootFromVolumeStableRescueTest-1999746022</nova:project>
Aug 09 16:48:15 user nova-compute[73091]:       </nova:owner>
Aug 09 16:48:15 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:48:15 user nova-compute[73091]:       <nova:ports>
Aug 09 16:48:15 user nova-compute[73091]:         <nova:port uuid="1d3f6a45-6b36-4603-b510-442d6ba16232">
Aug 09 16:48:15 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 16:48:15 user nova-compute[73091]:         </nova:port>
Aug 09 16:48:15 user nova-compute[73091]:       </nova:ports>
Aug 09 16:48:15 user nova-compute[73091]:     </nova:instance>
Aug 09 16:48:15 user nova-compute[73091]:   </metadata>
Aug 09 16:48:15 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:48:15 user nova-compute[73091]:     <system>
Aug 09 16:48:15 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:48:15 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:48:15 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:48:15 user nova-compute[73091]:       <entry name="serial">c3871ef4-45e7-4118-8227-e48cc857d481</entry>
Aug 09 16:48:15 user nova-compute[73091]:       <entry name="uuid">c3871ef4-45e7-4118-8227-e48cc857d481</entry>
Aug 09 16:48:15 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:48:15 user nova-compute[73091]:     </system>
Aug 09 16:48:15 user nova-compute[73091]:   </sysinfo>
Aug 09 16:48:15 user nova-compute[73091]:   <os>
Aug 09 16:48:15 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:48:15 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:48:15 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:48:15 user nova-compute[73091]:   </os>
Aug 09 16:48:15 user nova-compute[73091]:   <features>
Aug 09 16:48:15 user nova-compute[73091]:     <acpi/>
Aug 09 16:48:15 user nova-compute[73091]:     <apic/>
Aug 09 16:48:15 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:48:15 user nova-compute[73091]:   </features>
Aug 09 16:48:15 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:48:15 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:48:15 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:48:15 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:48:15 user nova-compute[73091]:   </clock>
Aug 09 16:48:15 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:48:15 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:48:15 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:48:15 user nova-compute[73091]:   </cpu>
Aug 09 16:48:15 user nova-compute[73091]:   <devices>
Aug 09 16:48:15 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:48:15 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:48:15 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk"/>
Aug 09 16:48:15 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:48:15 user nova-compute[73091]:     </disk>
Aug 09 16:48:15 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:48:15 user nova-compute[73091]:       <mac address="fa:16:3e:78:8d:86"/>
Aug 09 16:48:15 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:48:15 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:48:15 user nova-compute[73091]:       <target dev="tap1d3f6a45-6b"/>
Aug 09 16:48:15 user nova-compute[73091]:     </interface>
Aug 09 16:48:15 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:48:15 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/console.log" append="off"/>
Aug 09 16:48:15 user nova-compute[73091]:     </serial>
Aug 09 16:48:15 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:48:15 user nova-compute[73091]:     <video>
Aug 09 16:48:15 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:48:15 user nova-compute[73091]:     </video>
Aug 09 16:48:15 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:48:15 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:48:15 user nova-compute[73091]:     </rng>
Aug 09 16:48:15 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:48:15 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:48:15 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:48:15 user nova-compute[73091]:     </memballoon>
Aug 09 16:48:15 user nova-compute[73091]:   </devices>
Aug 09 16:48:15 user nova-compute[73091]: </domain>
Aug 09 16:48:15 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1649553508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1649553508',id=34,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39308f2160f14a1cb5ee136458054726',ramdisk_id='',reservation_id='r-cgrda13f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:48:14Z,user_data=None,user_id='1b831573c2594072890b548abda013e3',uuid=c3871ef4-45e7-4118-8227-e48cc857d481,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d3f6a45-6b36-4603-b510-442d6ba16232", "address": "fa:16:3e:78:8d:86", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3f6a45-6b", "ovs_interfaceid": "1d3f6a45-6b36-4603-b510-442d6ba16232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converting VIF {"id": "1d3f6a45-6b36-4603-b510-442d6ba16232", "address": "fa:16:3e:78:8d:86", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3f6a45-6b", "ovs_interfaceid": "1d3f6a45-6b36-4603-b510-442d6ba16232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:8d:86,bridge_name='br-int',has_traffic_filtering=True,id=1d3f6a45-6b36-4603-b510-442d6ba16232,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3f6a45-6b') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG os_vif [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:8d:86,bridge_name='br-int',has_traffic_filtering=True,id=1d3f6a45-6b36-4603-b510-442d6ba16232,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3f6a45-6b') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d3f6a45-6b, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d3f6a45-6b, col_values=(('external_ids', {'iface-id': '1d3f6a45-6b36-4603-b510-442d6ba16232', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:8d:86', 'vm-uuid': 'c3871ef4-45e7-4118-8227-e48cc857d481'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:15 user nova-compute[73091]: INFO os_vif [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:8d:86,bridge_name='br-int',has_traffic_filtering=True,id=1d3f6a45-6b36-4603-b510-442d6ba16232,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3f6a45-6b')
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] No VIF found with MAC fa:16:3e:78:8d:86, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:48:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:48:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-bcf8a2cf-87d6-4a75-ae85-903fc11e0e4b req-b3cd2e09-2e4e-41de-9897-abaf4d32352b service nova] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Updated VIF entry in instance network info cache for port 1d3f6a45-6b36-4603-b510-442d6ba16232. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:48:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-bcf8a2cf-87d6-4a75-ae85-903fc11e0e4b req-b3cd2e09-2e4e-41de-9897-abaf4d32352b service nova] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Updating instance_info_cache with network_info: [{"id": "1d3f6a45-6b36-4603-b510-442d6ba16232", "address": "fa:16:3e:78:8d:86", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3f6a45-6b", "ovs_interfaceid": "1d3f6a45-6b36-4603-b510-442d6ba16232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:48:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bcf8a2cf-87d6-4a75-ae85-903fc11e0e4b req-b3cd2e09-2e4e-41de-9897-abaf4d32352b service nova] Releasing lock "refresh_cache-c3871ef4-45e7-4118-8227-e48cc857d481" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:48:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-5db621ca-6c77-4753-9cf6-bdb1c9e4cf55 req-796a10ce-b922-4f70-adca-d20e3cce2dc8 service nova] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Received event network-vif-plugged-1d3f6a45-6b36-4603-b510-442d6ba16232 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:48:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5db621ca-6c77-4753-9cf6-bdb1c9e4cf55 req-796a10ce-b922-4f70-adca-d20e3cce2dc8 service nova] Acquiring lock "c3871ef4-45e7-4118-8227-e48cc857d481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5db621ca-6c77-4753-9cf6-bdb1c9e4cf55 req-796a10ce-b922-4f70-adca-d20e3cce2dc8 service nova] Lock "c3871ef4-45e7-4118-8227-e48cc857d481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5db621ca-6c77-4753-9cf6-bdb1c9e4cf55 req-796a10ce-b922-4f70-adca-d20e3cce2dc8 service nova] Lock "c3871ef4-45e7-4118-8227-e48cc857d481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-5db621ca-6c77-4753-9cf6-bdb1c9e4cf55 req-796a10ce-b922-4f70-adca-d20e3cce2dc8 service nova] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] No waiting events found dispatching network-vif-plugged-1d3f6a45-6b36-4603-b510-442d6ba16232 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:48:17 user nova-compute[73091]: WARNING nova.compute.manager [req-5db621ca-6c77-4753-9cf6-bdb1c9e4cf55 req-796a10ce-b922-4f70-adca-d20e3cce2dc8 service nova] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Received unexpected event network-vif-plugged-1d3f6a45-6b36-4603-b510-442d6ba16232 for instance with vm_state building and task_state spawning.
Aug 09 16:48:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:48:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:48:19 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599699.362352, c3871ef4-45e7-4118-8227-e48cc857d481 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:48:19 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] VM Resumed (Lifecycle Event)
Aug 09 16:48:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:48:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:48:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Instance spawned successfully.
Aug 09 16:48:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:48:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:48:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:48:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:48:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:48:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:48:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:48:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:48:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:48:19 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:48:19 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599699.3638823, c3871ef4-45e7-4118-8227-e48cc857d481 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:48:19 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] VM Started (Lifecycle Event)
Aug 09 16:48:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-5a938604-518c-4406-b264-3957ccbfd484 req-397612e0-e3cf-4ee0-915a-b0aa8a00f3ba service nova] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Received event network-vif-plugged-1d3f6a45-6b36-4603-b510-442d6ba16232 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:48:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5a938604-518c-4406-b264-3957ccbfd484 req-397612e0-e3cf-4ee0-915a-b0aa8a00f3ba service nova] Acquiring lock "c3871ef4-45e7-4118-8227-e48cc857d481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5a938604-518c-4406-b264-3957ccbfd484 req-397612e0-e3cf-4ee0-915a-b0aa8a00f3ba service nova] Lock "c3871ef4-45e7-4118-8227-e48cc857d481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5a938604-518c-4406-b264-3957ccbfd484 req-397612e0-e3cf-4ee0-915a-b0aa8a00f3ba service nova] Lock "c3871ef4-45e7-4118-8227-e48cc857d481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-5a938604-518c-4406-b264-3957ccbfd484 req-397612e0-e3cf-4ee0-915a-b0aa8a00f3ba service nova] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] No waiting events found dispatching network-vif-plugged-1d3f6a45-6b36-4603-b510-442d6ba16232 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:48:19 user nova-compute[73091]: WARNING nova.compute.manager [req-5a938604-518c-4406-b264-3957ccbfd484 req-397612e0-e3cf-4ee0-915a-b0aa8a00f3ba service nova] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Received unexpected event network-vif-plugged-1d3f6a45-6b36-4603-b510-442d6ba16232 for instance with vm_state building and task_state spawning.
Aug 09 16:48:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:48:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:48:19 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:48:19 user nova-compute[73091]: INFO nova.compute.manager [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Took 5.91 seconds to spawn the instance on the hypervisor.
Aug 09 16:48:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:48:19 user nova-compute[73091]: INFO nova.compute.manager [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Took 6.74 seconds to build instance.
Aug 09 16:48:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a9b7a463-c57a-4f39-9f77-6e7fb1b5da59 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "c3871ef4-45e7-4118-8227-e48cc857d481" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.929s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:48:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:48:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:48:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "66ca58dc-1701-4a50-be5c-de255e1fbf96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "66ca58dc-1701-4a50-be5c-de255e1fbf96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:48:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:48:22 user nova-compute[73091]: INFO nova.compute.claims [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Claim successful on node user
Aug 09 16:48:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:22 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:48:22 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.987s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:48:23 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:48:23 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7628MB free_disk=25.256221771240234GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:48:23 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Applying migration context for instance 97af1277-b4bd-4a89-903b-4f70087f0535 as it has an incoming, in-progress migration e6bc1e93-7c64-4de8-ae72-95a59498e872. Migration status is finished {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 16:48:23 user nova-compute[73091]: INFO nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Updating resource usage from migration e6bc1e93-7c64-4de8-ae72-95a59498e872
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f939fe27-017a-481e-babc-147bf98e0132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8fc884a8-24bb-488a-baeb-ef2b1faf239d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance b9639ddc-0ff9-41d2-b647-3af5fce945c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c142dbba-1e7f-4381-91a5-876b55e11a64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Migration e6bc1e93-7c64-4de8-ae72-95a59498e872 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 97af1277-b4bd-4a89-903b-4f70087f0535 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c3871ef4-45e7-4118-8227-e48cc857d481 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 66ca58dc-1701-4a50-be5c-de255e1fbf96 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.policy [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69ccebf0e9d54502a2318c809ce11369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d3dfd232d54594808dad271baa5192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:48:23 user nova-compute[73091]: INFO nova.virt.block_device [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Booting with volume 6c363878-100f-4807-8700-e096df141b1c at /dev/vda
Aug 09 16:48:23 user nova-compute[73091]: DEBUG os_brick.utils [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b514c59-7056-40df-a5e6-6721cbd05892]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[028f38eb-0c3f-458d-8235-26435bf09245]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[112c22fb-1e49-485b-92dd-614116b9950c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[be16e34a-95ec-4c0e-969b-23acd93f5b13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:48:23 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:48:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c770296-0938-4a0c-813b-a9d48b9bac11]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG os_brick.utils [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Updating existing volume attachment record: cf6766c7-5741-4bc8-96dd-7d2e62521999 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Successfully created port: 064be756-0cdb-4755-a870-5d466c14e32e {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:48:24 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:48:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Successfully updated port: 064be756-0cdb-4755-a870-5d466c14e32e {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:48:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "refresh_cache-66ca58dc-1701-4a50-be5c-de255e1fbf96" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:48:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquired lock "refresh_cache-66ca58dc-1701-4a50-be5c-de255e1fbf96" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:48:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:48:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-057b66f4-adf2-41d2-ae39-c6d460f57fef req-0be49477-ce6f-4bbe-b1a0-5b7ae3587a50 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Received event network-changed-064be756-0cdb-4755-a870-5d466c14e32e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:48:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-057b66f4-adf2-41d2-ae39-c6d460f57fef req-0be49477-ce6f-4bbe-b1a0-5b7ae3587a50 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Refreshing instance network info cache due to event network-changed-064be756-0cdb-4755-a870-5d466c14e32e. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:48:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-057b66f4-adf2-41d2-ae39-c6d460f57fef req-0be49477-ce6f-4bbe-b1a0-5b7ae3587a50 service nova] Acquiring lock "refresh_cache-66ca58dc-1701-4a50-be5c-de255e1fbf96" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:48:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:48:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Updating instance_info_cache with network_info: [{"id": "064be756-0cdb-4755-a870-5d466c14e32e", "address": "fa:16:3e:db:50:ee", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap064be756-0c", "ovs_interfaceid": "064be756-0cdb-4755-a870-5d466c14e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:48:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Releasing lock "refresh_cache-66ca58dc-1701-4a50-be5c-de255e1fbf96" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:48:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Instance network_info: |[{"id": "064be756-0cdb-4755-a870-5d466c14e32e", "address": "fa:16:3e:db:50:ee", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap064be756-0c", "ovs_interfaceid": "064be756-0cdb-4755-a870-5d466c14e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:48:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-057b66f4-adf2-41d2-ae39-c6d460f57fef req-0be49477-ce6f-4bbe-b1a0-5b7ae3587a50 service nova] Acquired lock "refresh_cache-66ca58dc-1701-4a50-be5c-de255e1fbf96" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:48:25 user nova-compute[73091]: DEBUG nova.network.neutron [req-057b66f4-adf2-41d2-ae39-c6d460f57fef req-0be49477-ce6f-4bbe-b1a0-5b7ae3587a50 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Refreshing network info cache for port 064be756-0cdb-4755-a870-5d466c14e32e {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:48:26 user nova-compute[73091]: DEBUG nova.network.neutron [req-057b66f4-adf2-41d2-ae39-c6d460f57fef req-0be49477-ce6f-4bbe-b1a0-5b7ae3587a50 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Updated VIF entry in instance network info cache for port 064be756-0cdb-4755-a870-5d466c14e32e. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:48:26 user nova-compute[73091]: DEBUG nova.network.neutron [req-057b66f4-adf2-41d2-ae39-c6d460f57fef req-0be49477-ce6f-4bbe-b1a0-5b7ae3587a50 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Updating instance_info_cache with network_info: [{"id": "064be756-0cdb-4755-a870-5d466c14e32e", "address": "fa:16:3e:db:50:ee", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap064be756-0c", "ovs_interfaceid": "064be756-0cdb-4755-a870-5d466c14e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:48:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-057b66f4-adf2-41d2-ae39-c6d460f57fef req-0be49477-ce6f-4bbe-b1a0-5b7ae3587a50 service nova] Releasing lock "refresh_cache-66ca58dc-1701-4a50-be5c-de255e1fbf96" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:48:28 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599693.4513402, 4a39f479-265c-49c3-86c4-a65fff2f06c4 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:48:28 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] VM Stopped (Lifecycle Event)
Aug 09 16:48:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-bf215a14-0b52-4953-92e2-ce3bc1e99fe9 None None] [instance: 4a39f479-265c-49c3-86c4-a65fff2f06c4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:48:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:48:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:48:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 16:48:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:48:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:48:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:48:37 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Creating image(s)
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Ensure instance console log exists: /opt/stack/data/nova/instances/66ca58dc-1701-4a50-be5c-de255e1fbf96/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Start _get_guest_xml network_info=[{"id": "064be756-0cdb-4755-a870-5d466c14e32e", "address": "fa:16:3e:db:50:ee", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap064be756-0c", "ovs_interfaceid": "064be756-0cdb-4755-a870-5d466c14e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'cf6766c7-5741-4bc8-96dd-7d2e62521999', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XypTsJzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '66ca58dc-1701-4a50-be5c-de255e1fbf96', 'attached_at': '', 'detached_at': '', 'volume_id': '6c363878-100f-4807-8700-e096df141b1c', 'serial': '6c363878-100f-4807-8700-e096df141b1c'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:48:37 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:48:37 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XypTsJzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:48:37 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:48:37 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:48:37 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d058371b-fee5-4aa9-9cd5-13ac190ecd3b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:48:37 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1820d78a-c019-4ea8-8eea-c34410d66d0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c] added
Aug 09 16:48:37 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1f339a-1b5d-4bdd-82f4-dbdec2f1bdb7]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a744e193-7c5a-46dd-a6a8-786f1c636aa3]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XypTsJzG {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XypTsJzG" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[114e85cf-5eda-4391-9214-05bbf68c08b2]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XypTsJzG'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1aad94a-73b3-4764-81bd-392aa63cd6a0]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dfbc12-f226-43fe-b0f7-6d7f19dd0b2d]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:48:37 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:48:37 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[222b72a4-cf7a-413f-bb84-97216825ea8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c, portal: 172.16.0.220,3260]
Aug 09 16:48:37 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c, portal: 172.16.0.220,3260] successful.
Aug 09 16:48:37 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eedf16b-f3d4-4e00-9568-8df3df966835]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fc7878-ca8a-472a-9220-d413ab975c55]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:48:37 user nova-compute[73091]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:48:37 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:48:37 user nova-compute[73091]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:48:37 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd103243-c0b9-4b99-ba0f-8786b94f8973]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:48:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XypTsJzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:48:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:48:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23362383137393366', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:48:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362383137393366', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:48:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1075965977',display_name='tempest-TestVolumeBootPattern-server-1075965977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1075965977',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSSzWQUVuDlac0eUgyT2z4iM1Y0qg2BfVrMrtynGR00pxQ570GYD8As3UZF1alKpRXt3lDEuXxBRenfT0VFniILv2ftKfjpM7Z1J3bJewWzw1Fr2JnxHpTfKfQmiSEWpw==',key_name='tempest-TestVolumeBootPattern-2063534983',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d3dfd232d54594808dad271baa5192',ramdisk_id='',reservation_id='r-vbzqi3u1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1605875873',owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:48:23Z,user_data=None,user_id='69ccebf0e9d54502a2318c809ce11369',uuid=66ca58dc-1701-4a50-be5c-de255e1fbf96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "064be756-0cdb-4755-a870-5d466c14e32e", "address": "fa:16:3e:db:50:ee", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap064be756-0c", "ovs_interfaceid": "064be756-0cdb-4755-a870-5d466c14e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:48:38 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converting VIF {"id": "064be756-0cdb-4755-a870-5d466c14e32e", "address": "fa:16:3e:db:50:ee", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap064be756-0c", "ovs_interfaceid": "064be756-0cdb-4755-a870-5d466c14e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:48:38 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:50:ee,bridge_name='br-int',has_traffic_filtering=True,id=064be756-0cdb-4755-a870-5d466c14e32e,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap064be756-0c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:48:38 user nova-compute[73091]: DEBUG nova.objects.instance [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lazy-loading 'pci_devices' on Instance uuid 66ca58dc-1701-4a50-be5c-de255e1fbf96 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:48:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:48:38 user nova-compute[73091]:   <uuid>66ca58dc-1701-4a50-be5c-de255e1fbf96</uuid>
Aug 09 16:48:38 user nova-compute[73091]:   <name>instance-00000023</name>
Aug 09 16:48:38 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:48:38 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:48:38 user nova-compute[73091]:   <metadata>
Aug 09 16:48:38 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:48:38 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:48:38 user nova-compute[73091]:       <nova:name>tempest-TestVolumeBootPattern-server-1075965977</nova:name>
Aug 09 16:48:38 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:48:37</nova:creationTime>
Aug 09 16:48:38 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:48:38 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:48:38 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:48:38 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:48:38 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:48:38 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:48:38 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:48:38 user nova-compute[73091]:       <nova:owner>
Aug 09 16:48:38 user nova-compute[73091]:         <nova:user uuid="69ccebf0e9d54502a2318c809ce11369">tempest-TestVolumeBootPattern-1605875873-project-member</nova:user>
Aug 09 16:48:38 user nova-compute[73091]:         <nova:project uuid="64d3dfd232d54594808dad271baa5192">tempest-TestVolumeBootPattern-1605875873</nova:project>
Aug 09 16:48:38 user nova-compute[73091]:       </nova:owner>
Aug 09 16:48:38 user nova-compute[73091]:       <nova:ports>
Aug 09 16:48:38 user nova-compute[73091]:         <nova:port uuid="064be756-0cdb-4755-a870-5d466c14e32e">
Aug 09 16:48:38 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 16:48:38 user nova-compute[73091]:         </nova:port>
Aug 09 16:48:38 user nova-compute[73091]:       </nova:ports>
Aug 09 16:48:38 user nova-compute[73091]:     </nova:instance>
Aug 09 16:48:38 user nova-compute[73091]:   </metadata>
Aug 09 16:48:38 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:48:38 user nova-compute[73091]:     <system>
Aug 09 16:48:38 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:48:38 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:48:38 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:48:38 user nova-compute[73091]:       <entry name="serial">66ca58dc-1701-4a50-be5c-de255e1fbf96</entry>
Aug 09 16:48:38 user nova-compute[73091]:       <entry name="uuid">66ca58dc-1701-4a50-be5c-de255e1fbf96</entry>
Aug 09 16:48:38 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:48:38 user nova-compute[73091]:     </system>
Aug 09 16:48:38 user nova-compute[73091]:   </sysinfo>
Aug 09 16:48:38 user nova-compute[73091]:   <os>
Aug 09 16:48:38 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:48:38 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:48:38 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:48:38 user nova-compute[73091]:   </os>
Aug 09 16:48:38 user nova-compute[73091]:   <features>
Aug 09 16:48:38 user nova-compute[73091]:     <acpi/>
Aug 09 16:48:38 user nova-compute[73091]:     <apic/>
Aug 09 16:48:38 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:48:38 user nova-compute[73091]:   </features>
Aug 09 16:48:38 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:48:38 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:48:38 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:48:38 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:48:38 user nova-compute[73091]:   </clock>
Aug 09 16:48:38 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:48:38 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:48:38 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:48:38 user nova-compute[73091]:   </cpu>
Aug 09 16:48:38 user nova-compute[73091]:   <devices>
Aug 09 16:48:38 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:48:38 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:48:38 user nova-compute[73091]:       <source dev="/dev/sdc"/>
Aug 09 16:48:38 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:48:38 user nova-compute[73091]:       <serial>6c363878-100f-4807-8700-e096df141b1c</serial>
Aug 09 16:48:38 user nova-compute[73091]:     </disk>
Aug 09 16:48:38 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:48:38 user nova-compute[73091]:       <mac address="fa:16:3e:db:50:ee"/>
Aug 09 16:48:38 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:48:38 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:48:38 user nova-compute[73091]:       <target dev="tap064be756-0c"/>
Aug 09 16:48:38 user nova-compute[73091]:     </interface>
Aug 09 16:48:38 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:48:38 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/66ca58dc-1701-4a50-be5c-de255e1fbf96/console.log" append="off"/>
Aug 09 16:48:38 user nova-compute[73091]:     </serial>
Aug 09 16:48:38 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:48:38 user nova-compute[73091]:     <video>
Aug 09 16:48:38 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:48:38 user nova-compute[73091]:     </video>
Aug 09 16:48:38 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:48:38 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:48:38 user nova-compute[73091]:     </rng>
Aug 09 16:48:38 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:48:38 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:48:38 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:48:38 user nova-compute[73091]:     </memballoon>
Aug 09 16:48:38 user nova-compute[73091]:   </devices>
Aug 09 16:48:38 user nova-compute[73091]: </domain>
Aug 09 16:48:38 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:48:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1075965977',display_name='tempest-TestVolumeBootPattern-server-1075965977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1075965977',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSSzWQUVuDlac0eUgyT2z4iM1Y0qg2BfVrMrtynGR00pxQ570GYD8As3UZF1alKpRXt3lDEuXxBRenfT0VFniILv2ftKfjpM7Z1J3bJewWzw1Fr2JnxHpTfKfQmiSEWpw==',key_name='tempest-TestVolumeBootPattern-2063534983',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d3dfd232d54594808dad271baa5192',ramdisk_id='',reservation_id='r-vbzqi3u1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1605875873',owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:48:23Z,user_data=None,user_id='69ccebf0e9d54502a2318c809ce11369',uuid=66ca58dc-1701-4a50-be5c-de255e1fbf96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "064be756-0cdb-4755-a870-5d466c14e32e", "address": "fa:16:3e:db:50:ee", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap064be756-0c", "ovs_interfaceid": "064be756-0cdb-4755-a870-5d466c14e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:48:39 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converting VIF {"id": "064be756-0cdb-4755-a870-5d466c14e32e", "address": "fa:16:3e:db:50:ee", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap064be756-0c", "ovs_interfaceid": "064be756-0cdb-4755-a870-5d466c14e32e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:48:39 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:50:ee,bridge_name='br-int',has_traffic_filtering=True,id=064be756-0cdb-4755-a870-5d466c14e32e,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap064be756-0c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:48:39 user nova-compute[73091]: DEBUG os_vif [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:50:ee,bridge_name='br-int',has_traffic_filtering=True,id=064be756-0cdb-4755-a870-5d466c14e32e,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap064be756-0c') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:48:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:48:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:48:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap064be756-0c, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:48:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap064be756-0c, col_values=(('external_ids', {'iface-id': '064be756-0cdb-4755-a870-5d466c14e32e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:50:ee', 'vm-uuid': '66ca58dc-1701-4a50-be5c-de255e1fbf96'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:48:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:48:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:39 user nova-compute[73091]: INFO os_vif [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:50:ee,bridge_name='br-int',has_traffic_filtering=True,id=064be756-0cdb-4755-a870-5d466c14e32e,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap064be756-0c')
Aug 09 16:48:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:48:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] No VIF found with MAC fa:16:3e:db:50:ee, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:48:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-63a647bb-4fcc-41d0-b5de-56b7b258221e req-34e586cd-4f09-427c-a183-59b85b386050 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Received event network-vif-plugged-064be756-0cdb-4755-a870-5d466c14e32e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:48:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-63a647bb-4fcc-41d0-b5de-56b7b258221e req-34e586cd-4f09-427c-a183-59b85b386050 service nova] Acquiring lock "66ca58dc-1701-4a50-be5c-de255e1fbf96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-63a647bb-4fcc-41d0-b5de-56b7b258221e req-34e586cd-4f09-427c-a183-59b85b386050 service nova] Lock "66ca58dc-1701-4a50-be5c-de255e1fbf96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-63a647bb-4fcc-41d0-b5de-56b7b258221e req-34e586cd-4f09-427c-a183-59b85b386050 service nova] Lock "66ca58dc-1701-4a50-be5c-de255e1fbf96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-63a647bb-4fcc-41d0-b5de-56b7b258221e req-34e586cd-4f09-427c-a183-59b85b386050 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] No waiting events found dispatching network-vif-plugged-064be756-0cdb-4755-a870-5d466c14e32e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:48:40 user nova-compute[73091]: WARNING nova.compute.manager [req-63a647bb-4fcc-41d0-b5de-56b7b258221e req-34e586cd-4f09-427c-a183-59b85b386050 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Received unexpected event network-vif-plugged-064be756-0cdb-4755-a870-5d466c14e32e for instance with vm_state building and task_state spawning.
Aug 09 16:48:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-a0d40bf4-3e8c-4c18-865b-07c702777880 req-bc3fe501-fc24-4635-9336-a6b825909032 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Received event network-vif-plugged-064be756-0cdb-4755-a870-5d466c14e32e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:48:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a0d40bf4-3e8c-4c18-865b-07c702777880 req-bc3fe501-fc24-4635-9336-a6b825909032 service nova] Acquiring lock "66ca58dc-1701-4a50-be5c-de255e1fbf96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a0d40bf4-3e8c-4c18-865b-07c702777880 req-bc3fe501-fc24-4635-9336-a6b825909032 service nova] Lock "66ca58dc-1701-4a50-be5c-de255e1fbf96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a0d40bf4-3e8c-4c18-865b-07c702777880 req-bc3fe501-fc24-4635-9336-a6b825909032 service nova] Lock "66ca58dc-1701-4a50-be5c-de255e1fbf96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-a0d40bf4-3e8c-4c18-865b-07c702777880 req-bc3fe501-fc24-4635-9336-a6b825909032 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] No waiting events found dispatching network-vif-plugged-064be756-0cdb-4755-a870-5d466c14e32e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:48:42 user nova-compute[73091]: WARNING nova.compute.manager [req-a0d40bf4-3e8c-4c18-865b-07c702777880 req-bc3fe501-fc24-4635-9336-a6b825909032 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Received unexpected event network-vif-plugged-064be756-0cdb-4755-a870-5d466c14e32e for instance with vm_state building and task_state spawning.
Aug 09 16:48:42 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599722.8393145, 66ca58dc-1701-4a50-be5c-de255e1fbf96 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:48:42 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] VM Resumed (Lifecycle Event)
Aug 09 16:48:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:48:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:48:42 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Instance spawned successfully.
Aug 09 16:48:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:48:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:48:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:48:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:48:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:48:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:48:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:48:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:48:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:48:42 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:48:42 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599722.8405845, 66ca58dc-1701-4a50-be5c-de255e1fbf96 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:48:42 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] VM Started (Lifecycle Event)
Aug 09 16:48:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:48:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:48:42 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:48:42 user nova-compute[73091]: INFO nova.compute.manager [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Took 5.40 seconds to spawn the instance on the hypervisor.
Aug 09 16:48:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:48:43 user nova-compute[73091]: INFO nova.compute.manager [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Took 21.07 seconds to build instance.
Aug 09 16:48:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-41fd3f88-a420-4a03-99a8-6eabd7a47d38 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "66ca58dc-1701-4a50-be5c-de255e1fbf96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.168s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:48:45 user nova-compute[73091]: INFO nova.compute.manager [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] instance snapshotting
Aug 09 16:48:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Beginning live snapshot process
Aug 09 16:48:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json -f qcow2" returned: 0 in 0.151s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json -f qcow2" returned: 0 in 0.148s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplkgs_6e_/59a767a3c919442195ddbab12816151d.delta 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplkgs_6e_/59a767a3c919442195ddbab12816151d.delta 1073741824" returned: 0 in 0.067s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 16:48:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:48:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] COPY block job progress, current cursor: 17498112 final cursor: 75563008 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:48:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:48:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 16:48:48 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 16:48:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplkgs_6e_/59a767a3c919442195ddbab12816151d.delta /opt/stack/data/nova/instances/snapshots/tmplkgs_6e_/59a767a3c919442195ddbab12816151d {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplkgs_6e_/59a767a3c919442195ddbab12816151d.delta /opt/stack/data/nova/instances/snapshots/tmplkgs_6e_/59a767a3c919442195ddbab12816151d" returned: 0 in 0.477s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:48 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Snapshot extracted, beginning image upload
Aug 09 16:48:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:51 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Snapshot image upload complete
Aug 09 16:48:51 user nova-compute[73091]: INFO nova.compute.manager [None req-8204a48b-2444-40f8-97de-0851b99bb36a tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Took 5.72 seconds to snapshot the instance on the hypervisor.
Aug 09 16:48:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "12689fb0-5e5e-4421-8dd1-859bd5461963" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:48:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:53 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:48:53 user nova-compute[73091]: INFO nova.compute.claims [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Claim successful on node user
Aug 09 16:48:53 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:48:53 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:48:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:48:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:48:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:48:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:48:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:48:53 user nova-compute[73091]: DEBUG nova.policy [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50cd847d1eb74f15bca467f2ce19941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79c356957db41aaa4e38a994523ba49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:48:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:48:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:48:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Creating image(s)
Aug 09 16:48:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "/opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "/opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "/opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "fc4a122f62154ce70545b4b30726ed4b293d2e8a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "fc4a122f62154ce70545b4b30726ed4b293d2e8a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc4a122f62154ce70545b4b30726ed4b293d2e8a.part --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Successfully created port: 639d4d2b-0348-4dc8-91f0-9b6907984a13 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:48:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc4a122f62154ce70545b4b30726ed4b293d2e8a.part --force-share --output=json" returned: 0 in 0.161s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:54 user nova-compute[73091]: DEBUG nova.virt.images [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] 0bbd95ca-209a-417c-84e1-bf013da6260a was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 16:48:54 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 16:48:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fc4a122f62154ce70545b4b30726ed4b293d2e8a.part /opt/stack/data/nova/instances/_base/fc4a122f62154ce70545b4b30726ed4b293d2e8a.converted {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fc4a122f62154ce70545b4b30726ed4b293d2e8a.part /opt/stack/data/nova/instances/_base/fc4a122f62154ce70545b4b30726ed4b293d2e8a.converted" returned: 0 in 0.485s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc4a122f62154ce70545b4b30726ed4b293d2e8a.converted --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc4a122f62154ce70545b4b30726ed4b293d2e8a.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "fc4a122f62154ce70545b4b30726ed4b293d2e8a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.678s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc4a122f62154ce70545b4b30726ed4b293d2e8a --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc4a122f62154ce70545b4b30726ed4b293d2e8a --force-share --output=json" returned: 0 in 0.208s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "fc4a122f62154ce70545b4b30726ed4b293d2e8a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "fc4a122f62154ce70545b4b30726ed4b293d2e8a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc4a122f62154ce70545b4b30726ed4b293d2e8a --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Successfully updated port: 639d4d2b-0348-4dc8-91f0-9b6907984a13 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-2c745645-47e5-4e5d-9ca5-b7e438701c8b req-dcf13d26-53e4-4ee6-88c2-45d01de95e45 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Received event network-changed-639d4d2b-0348-4dc8-91f0-9b6907984a13 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-2c745645-47e5-4e5d-9ca5-b7e438701c8b req-dcf13d26-53e4-4ee6-88c2-45d01de95e45 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Refreshing instance network info cache due to event network-changed-639d4d2b-0348-4dc8-91f0-9b6907984a13. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2c745645-47e5-4e5d-9ca5-b7e438701c8b req-dcf13d26-53e4-4ee6-88c2-45d01de95e45 service nova] Acquiring lock "refresh_cache-12689fb0-5e5e-4421-8dd1-859bd5461963" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2c745645-47e5-4e5d-9ca5-b7e438701c8b req-dcf13d26-53e4-4ee6-88c2-45d01de95e45 service nova] Acquired lock "refresh_cache-12689fb0-5e5e-4421-8dd1-859bd5461963" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-2c745645-47e5-4e5d-9ca5-b7e438701c8b req-dcf13d26-53e4-4ee6-88c2-45d01de95e45 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Refreshing network info cache for port 639d4d2b-0348-4dc8-91f0-9b6907984a13 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "refresh_cache-12689fb0-5e5e-4421-8dd1-859bd5461963" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-2c745645-47e5-4e5d-9ca5-b7e438701c8b req-dcf13d26-53e4-4ee6-88c2-45d01de95e45 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc4a122f62154ce70545b4b30726ed4b293d2e8a --force-share --output=json" returned: 0 in 0.150s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc4a122f62154ce70545b4b30726ed4b293d2e8a,backing_fmt=raw /opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc4a122f62154ce70545b4b30726ed4b293d2e8a,backing_fmt=raw /opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963/disk 1073741824" returned: 0 in 0.056s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "fc4a122f62154ce70545b4b30726ed4b293d2e8a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc4a122f62154ce70545b4b30726ed4b293d2e8a --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc4a122f62154ce70545b4b30726ed4b293d2e8a --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.objects.instance [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lazy-loading 'migration_context' on Instance uuid 12689fb0-5e5e-4421-8dd1-859bd5461963 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Ensure instance console log exists: /opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.network.neutron [req-2c745645-47e5-4e5d-9ca5-b7e438701c8b req-dcf13d26-53e4-4ee6-88c2-45d01de95e45 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2c745645-47e5-4e5d-9ca5-b7e438701c8b req-dcf13d26-53e4-4ee6-88c2-45d01de95e45 service nova] Releasing lock "refresh_cache-12689fb0-5e5e-4421-8dd1-859bd5461963" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquired lock "refresh_cache-12689fb0-5e5e-4421-8dd1-859bd5461963" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Updating instance_info_cache with network_info: [{"id": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "address": "fa:16:3e:74:bf:53", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap639d4d2b-03", "ovs_interfaceid": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Releasing lock "refresh_cache-12689fb0-5e5e-4421-8dd1-859bd5461963" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Instance network_info: |[{"id": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "address": "fa:16:3e:74:bf:53", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap639d4d2b-03", "ovs_interfaceid": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Start _get_guest_xml network_info=[{"id": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "address": "fa:16:3e:74:bf:53", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap639d4d2b-03", "ovs_interfaceid": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='134e43be00c88ce8052f8832c044e238',container_format='bare',created_at=2023-08-09T16:48:45Z,direct_url=<?>,disk_format='qcow2',id=0bbd95ca-209a-417c-84e1-bf013da6260a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-527172781',owner='c79c356957db41aaa4e38a994523ba49',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T16:48:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': '0bbd95ca-209a-417c-84e1-bf013da6260a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:48:56 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:48:56 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='134e43be00c88ce8052f8832c044e238',container_format='bare',created_at=2023-08-09T16:48:45Z,direct_url=<?>,disk_format='qcow2',id=0bbd95ca-209a-417c-84e1-bf013da6260a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-527172781',owner='c79c356957db41aaa4e38a994523ba49',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T16:48:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1353293834',display_name='tempest-TestStampPattern-server-1353293834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1353293834',id=36,image_ref='0bbd95ca-209a-417c-84e1-bf013da6260a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6P3Qr1VZMAIk6RrDyvvqyhQ7LZCS0nJ47xUsRbhRFY0D/71qjjhLa1dc7eKXbzOlylR7y7dZ2Cb+Q/d0qINaFIYFTtHe5bUCqpIXOHo2fHfUg3zDl3U8Cw2AlPHLav2Q==',key_name='tempest-TestStampPattern-1375898526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c79c356957db41aaa4e38a994523ba49',ramdisk_id='',reservation_id='r-yzjf0pt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b9639ddc-0ff9-41d2-b647-3af5fce945c2',image_min_disk='1',image_min_ram='0',image_owner_id='c79c356957db41aaa4e38a994523ba49',image_owner_project_name='tempest-TestStampPattern-1011496614',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1011496614-project-member',image_user_id='50cd847d1eb74f15bca467f2ce19941f',network_allocated='True',owner_project_name='tempest-TestStampPattern-1011496614',owner_user_name='tempest-TestStampPattern-1011496614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:48:54Z,user_data=None,user_id='50cd847d1eb74f15bca467f2ce19941f',uuid=12689fb0-5e5e-4421-8dd1-859bd5461963,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "address": "fa:16:3e:74:bf:53", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap639d4d2b-03", "ovs_interfaceid": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Converting VIF {"id": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "address": "fa:16:3e:74:bf:53", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap639d4d2b-03", "ovs_interfaceid": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:bf:53,bridge_name='br-int',has_traffic_filtering=True,id=639d4d2b-0348-4dc8-91f0-9b6907984a13,network=Network(7a19d9ac-eff2-4fff-b74e-caad307b52ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap639d4d2b-03') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.objects.instance [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lazy-loading 'pci_devices' on Instance uuid 12689fb0-5e5e-4421-8dd1-859bd5461963 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:48:56 user nova-compute[73091]:   <uuid>12689fb0-5e5e-4421-8dd1-859bd5461963</uuid>
Aug 09 16:48:56 user nova-compute[73091]:   <name>instance-00000024</name>
Aug 09 16:48:56 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:48:56 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:48:56 user nova-compute[73091]:   <metadata>
Aug 09 16:48:56 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:48:56 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:48:56 user nova-compute[73091]:       <nova:name>tempest-TestStampPattern-server-1353293834</nova:name>
Aug 09 16:48:56 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:48:56</nova:creationTime>
Aug 09 16:48:56 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:48:56 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:48:56 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:48:56 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:48:56 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:48:56 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:48:56 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:48:56 user nova-compute[73091]:       <nova:owner>
Aug 09 16:48:56 user nova-compute[73091]:         <nova:user uuid="50cd847d1eb74f15bca467f2ce19941f">tempest-TestStampPattern-1011496614-project-member</nova:user>
Aug 09 16:48:56 user nova-compute[73091]:         <nova:project uuid="c79c356957db41aaa4e38a994523ba49">tempest-TestStampPattern-1011496614</nova:project>
Aug 09 16:48:56 user nova-compute[73091]:       </nova:owner>
Aug 09 16:48:56 user nova-compute[73091]:       <nova:root type="image" uuid="0bbd95ca-209a-417c-84e1-bf013da6260a"/>
Aug 09 16:48:56 user nova-compute[73091]:       <nova:ports>
Aug 09 16:48:56 user nova-compute[73091]:         <nova:port uuid="639d4d2b-0348-4dc8-91f0-9b6907984a13">
Aug 09 16:48:56 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 16:48:56 user nova-compute[73091]:         </nova:port>
Aug 09 16:48:56 user nova-compute[73091]:       </nova:ports>
Aug 09 16:48:56 user nova-compute[73091]:     </nova:instance>
Aug 09 16:48:56 user nova-compute[73091]:   </metadata>
Aug 09 16:48:56 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:48:56 user nova-compute[73091]:     <system>
Aug 09 16:48:56 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:48:56 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:48:56 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:48:56 user nova-compute[73091]:       <entry name="serial">12689fb0-5e5e-4421-8dd1-859bd5461963</entry>
Aug 09 16:48:56 user nova-compute[73091]:       <entry name="uuid">12689fb0-5e5e-4421-8dd1-859bd5461963</entry>
Aug 09 16:48:56 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:48:56 user nova-compute[73091]:     </system>
Aug 09 16:48:56 user nova-compute[73091]:   </sysinfo>
Aug 09 16:48:56 user nova-compute[73091]:   <os>
Aug 09 16:48:56 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:48:56 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:48:56 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:48:56 user nova-compute[73091]:   </os>
Aug 09 16:48:56 user nova-compute[73091]:   <features>
Aug 09 16:48:56 user nova-compute[73091]:     <acpi/>
Aug 09 16:48:56 user nova-compute[73091]:     <apic/>
Aug 09 16:48:56 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:48:56 user nova-compute[73091]:   </features>
Aug 09 16:48:56 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:48:56 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:48:56 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:48:56 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:48:56 user nova-compute[73091]:   </clock>
Aug 09 16:48:56 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:48:56 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:48:56 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:48:56 user nova-compute[73091]:   </cpu>
Aug 09 16:48:56 user nova-compute[73091]:   <devices>
Aug 09 16:48:56 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:48:56 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:48:56 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963/disk"/>
Aug 09 16:48:56 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:48:56 user nova-compute[73091]:     </disk>
Aug 09 16:48:56 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:48:56 user nova-compute[73091]:       <mac address="fa:16:3e:74:bf:53"/>
Aug 09 16:48:56 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:48:56 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:48:56 user nova-compute[73091]:       <target dev="tap639d4d2b-03"/>
Aug 09 16:48:56 user nova-compute[73091]:     </interface>
Aug 09 16:48:56 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:48:56 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963/console.log" append="off"/>
Aug 09 16:48:56 user nova-compute[73091]:     </serial>
Aug 09 16:48:56 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:48:56 user nova-compute[73091]:     <video>
Aug 09 16:48:56 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:48:56 user nova-compute[73091]:     </video>
Aug 09 16:48:56 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:48:56 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:48:56 user nova-compute[73091]:     </rng>
Aug 09 16:48:56 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:48:56 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:48:56 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:48:56 user nova-compute[73091]:     </memballoon>
Aug 09 16:48:56 user nova-compute[73091]:   </devices>
Aug 09 16:48:56 user nova-compute[73091]: </domain>
Aug 09 16:48:56 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1353293834',display_name='tempest-TestStampPattern-server-1353293834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1353293834',id=36,image_ref='0bbd95ca-209a-417c-84e1-bf013da6260a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6P3Qr1VZMAIk6RrDyvvqyhQ7LZCS0nJ47xUsRbhRFY0D/71qjjhLa1dc7eKXbzOlylR7y7dZ2Cb+Q/d0qINaFIYFTtHe5bUCqpIXOHo2fHfUg3zDl3U8Cw2AlPHLav2Q==',key_name='tempest-TestStampPattern-1375898526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c79c356957db41aaa4e38a994523ba49',ramdisk_id='',reservation_id='r-yzjf0pt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b9639ddc-0ff9-41d2-b647-3af5fce945c2',image_min_disk='1',image_min_ram='0',image_owner_id='c79c356957db41aaa4e38a994523ba49',image_owner_project_name='tempest-TestStampPattern-1011496614',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1011496614-project-member',image_user_id='50cd847d1eb74f15bca467f2ce19941f',network_allocated='True',owner_project_name='tempest-TestStampPattern-1011496614',owner_user_name='tempest-TestStampPattern-1011496614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:48:54Z,user_data=None,user_id='50cd847d1eb74f15bca467f2ce19941f',uuid=12689fb0-5e5e-4421-8dd1-859bd5461963,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "address": "fa:16:3e:74:bf:53", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap639d4d2b-03", "ovs_interfaceid": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Converting VIF {"id": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "address": "fa:16:3e:74:bf:53", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap639d4d2b-03", "ovs_interfaceid": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:bf:53,bridge_name='br-int',has_traffic_filtering=True,id=639d4d2b-0348-4dc8-91f0-9b6907984a13,network=Network(7a19d9ac-eff2-4fff-b74e-caad307b52ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap639d4d2b-03') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG os_vif [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:bf:53,bridge_name='br-int',has_traffic_filtering=True,id=639d4d2b-0348-4dc8-91f0-9b6907984a13,network=Network(7a19d9ac-eff2-4fff-b74e-caad307b52ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap639d4d2b-03') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap639d4d2b-03, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap639d4d2b-03, col_values=(('external_ids', {'iface-id': '639d4d2b-0348-4dc8-91f0-9b6907984a13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:bf:53', 'vm-uuid': '12689fb0-5e5e-4421-8dd1-859bd5461963'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:56 user nova-compute[73091]: INFO os_vif [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:bf:53,bridge_name='br-int',has_traffic_filtering=True,id=639d4d2b-0348-4dc8-91f0-9b6907984a13,network=Network(7a19d9ac-eff2-4fff-b74e-caad307b52ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap639d4d2b-03')
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:48:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] No VIF found with MAC fa:16:3e:74:bf:53, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:48:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-ace15f3d-8b9c-4afe-9323-313c2a1c561e req-8d0c1feb-b635-48ef-8bb2-bb1ac13afd6c service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Received event network-vif-plugged-639d4d2b-0348-4dc8-91f0-9b6907984a13 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:48:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ace15f3d-8b9c-4afe-9323-313c2a1c561e req-8d0c1feb-b635-48ef-8bb2-bb1ac13afd6c service nova] Acquiring lock "12689fb0-5e5e-4421-8dd1-859bd5461963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:48:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ace15f3d-8b9c-4afe-9323-313c2a1c561e req-8d0c1feb-b635-48ef-8bb2-bb1ac13afd6c service nova] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:48:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ace15f3d-8b9c-4afe-9323-313c2a1c561e req-8d0c1feb-b635-48ef-8bb2-bb1ac13afd6c service nova] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:48:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-ace15f3d-8b9c-4afe-9323-313c2a1c561e req-8d0c1feb-b635-48ef-8bb2-bb1ac13afd6c service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] No waiting events found dispatching network-vif-plugged-639d4d2b-0348-4dc8-91f0-9b6907984a13 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:48:58 user nova-compute[73091]: WARNING nova.compute.manager [req-ace15f3d-8b9c-4afe-9323-313c2a1c561e req-8d0c1feb-b635-48ef-8bb2-bb1ac13afd6c service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Received unexpected event network-vif-plugged-639d4d2b-0348-4dc8-91f0-9b6907984a13 for instance with vm_state building and task_state spawning.
Aug 09 16:48:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:48:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:00 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599740.1521244, 12689fb0-5e5e-4421-8dd1-859bd5461963 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:49:00 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] VM Resumed (Lifecycle Event)
Aug 09 16:49:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:49:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:49:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Instance spawned successfully.
Aug 09 16:49:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:49:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:49:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:49:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:49:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:49:00 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:49:00 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599740.1534655, 12689fb0-5e5e-4421-8dd1-859bd5461963 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:49:00 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] VM Started (Lifecycle Event)
Aug 09 16:49:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-472d69ef-a874-4a3d-8265-72bbc70b0b74 req-2ebb726e-57d7-4449-86a1-0d1cffd8aa18 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Received event network-vif-plugged-639d4d2b-0348-4dc8-91f0-9b6907984a13 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:49:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-472d69ef-a874-4a3d-8265-72bbc70b0b74 req-2ebb726e-57d7-4449-86a1-0d1cffd8aa18 service nova] Acquiring lock "12689fb0-5e5e-4421-8dd1-859bd5461963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-472d69ef-a874-4a3d-8265-72bbc70b0b74 req-2ebb726e-57d7-4449-86a1-0d1cffd8aa18 service nova] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-472d69ef-a874-4a3d-8265-72bbc70b0b74 req-2ebb726e-57d7-4449-86a1-0d1cffd8aa18 service nova] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-472d69ef-a874-4a3d-8265-72bbc70b0b74 req-2ebb726e-57d7-4449-86a1-0d1cffd8aa18 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] No waiting events found dispatching network-vif-plugged-639d4d2b-0348-4dc8-91f0-9b6907984a13 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:49:00 user nova-compute[73091]: WARNING nova.compute.manager [req-472d69ef-a874-4a3d-8265-72bbc70b0b74 req-2ebb726e-57d7-4449-86a1-0d1cffd8aa18 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Received unexpected event network-vif-plugged-639d4d2b-0348-4dc8-91f0-9b6907984a13 for instance with vm_state building and task_state spawning.
Aug 09 16:49:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:49:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:49:00 user nova-compute[73091]: INFO nova.compute.manager [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Took 6.42 seconds to spawn the instance on the hypervisor.
Aug 09 16:49:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:49:00 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:49:00 user nova-compute[73091]: INFO nova.compute.manager [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Took 7.37 seconds to build instance.
Aug 09 16:49:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27b03f99-f44c-42aa-833e-c8f2ac9f6ea6 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.471s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "c142dbba-1e7f-4381-91a5-876b55e11a64" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG nova.objects.instance [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lazy-loading 'flavor' on Instance uuid c142dbba-1e7f-4381-91a5-876b55e11a64 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "c142dbba-1e7f-4381-91a5-876b55e11a64" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:04 user nova-compute[73091]: INFO nova.compute.manager [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Attaching volume ee4430ff-491a-4834-abb8-e57f3f4f2a9a to /dev/vdb
Aug 09 16:49:04 user nova-compute[73091]: DEBUG os_brick.utils [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e157d4b8-c6ec-4de3-82fb-55fed060c2d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a755b445-267f-453b-b622-058f69eb8f6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01fd06e-3304-4ba2-b1dc-cdc4ddf84882]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[252c10f3-3607-4027-ac80-2caa4b15e573]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:49:04 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:49:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9680d5-1aa3-4915-b8be-be611de363a9]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG os_brick.utils [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:49:04 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Updating existing volume attachment record: c7d28070-97b9-42f6-acea-2653ce96240b {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:49:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "925f656c-f94a-4707-b1d9-b750cd83a010" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "925f656c-f94a-4707-b1d9-b750cd83a010" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:49:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:49:07 user nova-compute[73091]: INFO nova.compute.claims [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Claim successful on node user
Aug 09 16:49:07 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:49:07 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:49:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:49:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:49:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:49:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:49:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:49:07 user nova-compute[73091]: DEBUG nova.policy [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a5c393d644c4c3f8e9cbb0805ba7c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f2275630ce4d55bf02851df830b6bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:49:07 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:49:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:49:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:49:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Creating image(s)
Aug 09 16:49:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "/opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "/opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "/opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk 1073741824" returned: 0 in 0.066s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Cannot resize image /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'migration_context' on Instance uuid 925f656c-f94a-4707-b1d9-b750cd83a010 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Ensure instance console log exists: /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Successfully created port: 1d105b3b-29db-489d-992c-fc3e9f58f914 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:49:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 16:49:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Successfully updated port: 1d105b3b-29db-489d-992c-fc3e9f58f914 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:49:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "refresh_cache-925f656c-f94a-4707-b1d9-b750cd83a010" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:49:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquired lock "refresh_cache-925f656c-f94a-4707-b1d9-b750cd83a010" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:49:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:49:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:49:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-9dbafa5a-e176-421d-8b51-00a6c454a4dc req-214e0bad-e890-4299-9e1c-7574c54e5b36 service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Received event network-changed-1d105b3b-29db-489d-992c-fc3e9f58f914 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:49:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-9dbafa5a-e176-421d-8b51-00a6c454a4dc req-214e0bad-e890-4299-9e1c-7574c54e5b36 service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Refreshing instance network info cache due to event network-changed-1d105b3b-29db-489d-992c-fc3e9f58f914. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:49:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9dbafa5a-e176-421d-8b51-00a6c454a4dc req-214e0bad-e890-4299-9e1c-7574c54e5b36 service nova] Acquiring lock "refresh_cache-925f656c-f94a-4707-b1d9-b750cd83a010" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:49:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Updating instance_info_cache with network_info: [{"id": "1d105b3b-29db-489d-992c-fc3e9f58f914", "address": "fa:16:3e:e3:2c:a3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d105b3b-29", "ovs_interfaceid": "1d105b3b-29db-489d-992c-fc3e9f58f914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Releasing lock "refresh_cache-925f656c-f94a-4707-b1d9-b750cd83a010" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Instance network_info: |[{"id": "1d105b3b-29db-489d-992c-fc3e9f58f914", "address": "fa:16:3e:e3:2c:a3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d105b3b-29", "ovs_interfaceid": "1d105b3b-29db-489d-992c-fc3e9f58f914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9dbafa5a-e176-421d-8b51-00a6c454a4dc req-214e0bad-e890-4299-9e1c-7574c54e5b36 service nova] Acquired lock "refresh_cache-925f656c-f94a-4707-b1d9-b750cd83a010" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.network.neutron [req-9dbafa5a-e176-421d-8b51-00a6c454a4dc req-214e0bad-e890-4299-9e1c-7574c54e5b36 service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Refreshing network info cache for port 1d105b3b-29db-489d-992c-fc3e9f58f914 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Start _get_guest_xml network_info=[{"id": "1d105b3b-29db-489d-992c-fc3e9f58f914", "address": "fa:16:3e:e3:2c:a3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d105b3b-29", "ovs_interfaceid": "1d105b3b-29db-489d-992c-fc3e9f58f914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:49:10 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:49:10 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-378958278',display_name='tempest-AttachVolumeNegativeTest-server-378958278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-378958278',id=37,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAAhtlt1zH3c512v4rMI07WPJ4R0gFaQZp5osmQkO4+Zr+CrxcY9ojXjbnXZAuxCu80ApxLcFBQqvTDbS2vXt4vm0har9YPIEizY3esPsH8y2Kog4xPg/1X6tTTEypV4g==',key_name='tempest-keypair-1669128727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27f2275630ce4d55bf02851df830b6bd',ramdisk_id='',reservation_id='r-00gvts8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-604747333',owner_user_name='tempest-AttachVolumeNegativeTest-604747333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a5c393d644c4c3f8e9cbb0805ba7c08',uuid=925f656c-f94a-4707-b1d9-b750cd83a010,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d105b3b-29db-489d-992c-fc3e9f58f914", "address": "fa:16:3e:e3:2c:a3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d105b3b-29", "ovs_interfaceid": "1d105b3b-29db-489d-992c-fc3e9f58f914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converting VIF {"id": "1d105b3b-29db-489d-992c-fc3e9f58f914", "address": "fa:16:3e:e3:2c:a3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d105b3b-29", "ovs_interfaceid": "1d105b3b-29db-489d-992c-fc3e9f58f914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:2c:a3,bridge_name='br-int',has_traffic_filtering=True,id=1d105b3b-29db-489d-992c-fc3e9f58f914,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d105b3b-29') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.objects.instance [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'pci_devices' on Instance uuid 925f656c-f94a-4707-b1d9-b750cd83a010 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:49:10 user nova-compute[73091]:   <uuid>925f656c-f94a-4707-b1d9-b750cd83a010</uuid>
Aug 09 16:49:10 user nova-compute[73091]:   <name>instance-00000025</name>
Aug 09 16:49:10 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:49:10 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:49:10 user nova-compute[73091]:   <metadata>
Aug 09 16:49:10 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:49:10 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:49:10 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeNegativeTest-server-378958278</nova:name>
Aug 09 16:49:10 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:49:10</nova:creationTime>
Aug 09 16:49:10 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:49:10 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:49:10 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:49:10 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:49:10 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:49:10 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:49:10 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:49:10 user nova-compute[73091]:       <nova:owner>
Aug 09 16:49:10 user nova-compute[73091]:         <nova:user uuid="8a5c393d644c4c3f8e9cbb0805ba7c08">tempest-AttachVolumeNegativeTest-604747333-project-member</nova:user>
Aug 09 16:49:10 user nova-compute[73091]:         <nova:project uuid="27f2275630ce4d55bf02851df830b6bd">tempest-AttachVolumeNegativeTest-604747333</nova:project>
Aug 09 16:49:10 user nova-compute[73091]:       </nova:owner>
Aug 09 16:49:10 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:49:10 user nova-compute[73091]:       <nova:ports>
Aug 09 16:49:10 user nova-compute[73091]:         <nova:port uuid="1d105b3b-29db-489d-992c-fc3e9f58f914">
Aug 09 16:49:10 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 16:49:10 user nova-compute[73091]:         </nova:port>
Aug 09 16:49:10 user nova-compute[73091]:       </nova:ports>
Aug 09 16:49:10 user nova-compute[73091]:     </nova:instance>
Aug 09 16:49:10 user nova-compute[73091]:   </metadata>
Aug 09 16:49:10 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:49:10 user nova-compute[73091]:     <system>
Aug 09 16:49:10 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:49:10 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:49:10 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:49:10 user nova-compute[73091]:       <entry name="serial">925f656c-f94a-4707-b1d9-b750cd83a010</entry>
Aug 09 16:49:10 user nova-compute[73091]:       <entry name="uuid">925f656c-f94a-4707-b1d9-b750cd83a010</entry>
Aug 09 16:49:10 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:49:10 user nova-compute[73091]:     </system>
Aug 09 16:49:10 user nova-compute[73091]:   </sysinfo>
Aug 09 16:49:10 user nova-compute[73091]:   <os>
Aug 09 16:49:10 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:49:10 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:49:10 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:49:10 user nova-compute[73091]:   </os>
Aug 09 16:49:10 user nova-compute[73091]:   <features>
Aug 09 16:49:10 user nova-compute[73091]:     <acpi/>
Aug 09 16:49:10 user nova-compute[73091]:     <apic/>
Aug 09 16:49:10 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:49:10 user nova-compute[73091]:   </features>
Aug 09 16:49:10 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:49:10 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:49:10 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:49:10 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:49:10 user nova-compute[73091]:   </clock>
Aug 09 16:49:10 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:49:10 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:49:10 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:49:10 user nova-compute[73091]:   </cpu>
Aug 09 16:49:10 user nova-compute[73091]:   <devices>
Aug 09 16:49:10 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:49:10 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:49:10 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk"/>
Aug 09 16:49:10 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:49:10 user nova-compute[73091]:     </disk>
Aug 09 16:49:10 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:49:10 user nova-compute[73091]:       <mac address="fa:16:3e:e3:2c:a3"/>
Aug 09 16:49:10 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:49:10 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:49:10 user nova-compute[73091]:       <target dev="tap1d105b3b-29"/>
Aug 09 16:49:10 user nova-compute[73091]:     </interface>
Aug 09 16:49:10 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:49:10 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/console.log" append="off"/>
Aug 09 16:49:10 user nova-compute[73091]:     </serial>
Aug 09 16:49:10 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:49:10 user nova-compute[73091]:     <video>
Aug 09 16:49:10 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:49:10 user nova-compute[73091]:     </video>
Aug 09 16:49:10 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:49:10 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:49:10 user nova-compute[73091]:     </rng>
Aug 09 16:49:10 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:49:10 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:49:10 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:49:10 user nova-compute[73091]:     </memballoon>
Aug 09 16:49:10 user nova-compute[73091]:   </devices>
Aug 09 16:49:10 user nova-compute[73091]: </domain>
Aug 09 16:49:10 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-378958278',display_name='tempest-AttachVolumeNegativeTest-server-378958278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-378958278',id=37,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAAhtlt1zH3c512v4rMI07WPJ4R0gFaQZp5osmQkO4+Zr+CrxcY9ojXjbnXZAuxCu80ApxLcFBQqvTDbS2vXt4vm0har9YPIEizY3esPsH8y2Kog4xPg/1X6tTTEypV4g==',key_name='tempest-keypair-1669128727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27f2275630ce4d55bf02851df830b6bd',ramdisk_id='',reservation_id='r-00gvts8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-604747333',owner_user_name='tempest-AttachVolumeNegativeTest-604747333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a5c393d644c4c3f8e9cbb0805ba7c08',uuid=925f656c-f94a-4707-b1d9-b750cd83a010,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d105b3b-29db-489d-992c-fc3e9f58f914", "address": "fa:16:3e:e3:2c:a3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d105b3b-29", "ovs_interfaceid": "1d105b3b-29db-489d-992c-fc3e9f58f914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converting VIF {"id": "1d105b3b-29db-489d-992c-fc3e9f58f914", "address": "fa:16:3e:e3:2c:a3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d105b3b-29", "ovs_interfaceid": "1d105b3b-29db-489d-992c-fc3e9f58f914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:2c:a3,bridge_name='br-int',has_traffic_filtering=True,id=1d105b3b-29db-489d-992c-fc3e9f58f914,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d105b3b-29') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG os_vif [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:2c:a3,bridge_name='br-int',has_traffic_filtering=True,id=1d105b3b-29db-489d-992c-fc3e9f58f914,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d105b3b-29') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d105b3b-29, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d105b3b-29, col_values=(('external_ids', {'iface-id': '1d105b3b-29db-489d-992c-fc3e9f58f914', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:2c:a3', 'vm-uuid': '925f656c-f94a-4707-b1d9-b750cd83a010'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:10 user nova-compute[73091]: INFO os_vif [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:2c:a3,bridge_name='br-int',has_traffic_filtering=True,id=1d105b3b-29db-489d-992c-fc3e9f58f914,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d105b3b-29')
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] No VIF found with MAC fa:16:3e:e3:2c:a3, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.network.neutron [req-9dbafa5a-e176-421d-8b51-00a6c454a4dc req-214e0bad-e890-4299-9e1c-7574c54e5b36 service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Updated VIF entry in instance network info cache for port 1d105b3b-29db-489d-992c-fc3e9f58f914. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.network.neutron [req-9dbafa5a-e176-421d-8b51-00a6c454a4dc req-214e0bad-e890-4299-9e1c-7574c54e5b36 service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Updating instance_info_cache with network_info: [{"id": "1d105b3b-29db-489d-992c-fc3e9f58f914", "address": "fa:16:3e:e3:2c:a3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d105b3b-29", "ovs_interfaceid": "1d105b3b-29db-489d-992c-fc3e9f58f914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9dbafa5a-e176-421d-8b51-00a6c454a4dc req-214e0bad-e890-4299-9e1c-7574c54e5b36 service nova] Releasing lock "refresh_cache-925f656c-f94a-4707-b1d9-b750cd83a010" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 16:49:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 16:49:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-c1ac3a6b-e3c6-4179-9c97-d466bbc3ef69 req-bcd6cc75-674f-48f6-a2e1-b99c7a138c31 service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Received event network-vif-plugged-1d105b3b-29db-489d-992c-fc3e9f58f914 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:49:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c1ac3a6b-e3c6-4179-9c97-d466bbc3ef69 req-bcd6cc75-674f-48f6-a2e1-b99c7a138c31 service nova] Acquiring lock "925f656c-f94a-4707-b1d9-b750cd83a010-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c1ac3a6b-e3c6-4179-9c97-d466bbc3ef69 req-bcd6cc75-674f-48f6-a2e1-b99c7a138c31 service nova] Lock "925f656c-f94a-4707-b1d9-b750cd83a010-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c1ac3a6b-e3c6-4179-9c97-d466bbc3ef69 req-bcd6cc75-674f-48f6-a2e1-b99c7a138c31 service nova] Lock "925f656c-f94a-4707-b1d9-b750cd83a010-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-c1ac3a6b-e3c6-4179-9c97-d466bbc3ef69 req-bcd6cc75-674f-48f6-a2e1-b99c7a138c31 service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] No waiting events found dispatching network-vif-plugged-1d105b3b-29db-489d-992c-fc3e9f58f914 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:49:11 user nova-compute[73091]: WARNING nova.compute.manager [req-c1ac3a6b-e3c6-4179-9c97-d466bbc3ef69 req-bcd6cc75-674f-48f6-a2e1-b99c7a138c31 service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Received unexpected event network-vif-plugged-1d105b3b-29db-489d-992c-fc3e9f58f914 for instance with vm_state building and task_state spawning.
Aug 09 16:49:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rmdafnPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:49:13 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:49:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:49:13 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:49:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:49:13 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:49:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2e8bd0-e985-4c27-9421-228bf430be25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:49:13 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599753.93689, 925f656c-f94a-4707-b1d9-b750cd83a010 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:49:13 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] VM Resumed (Lifecycle Event)
Aug 09 16:49:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-0bb3c89f-7aaf-49cc-9ef2-788d60cfe692 req-8771ecc0-0f5f-4137-9f46-3df3ce7348a8 service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Received event network-vif-plugged-1d105b3b-29db-489d-992c-fc3e9f58f914 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0bb3c89f-7aaf-49cc-9ef2-788d60cfe692 req-8771ecc0-0f5f-4137-9f46-3df3ce7348a8 service nova] Acquiring lock "925f656c-f94a-4707-b1d9-b750cd83a010-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0bb3c89f-7aaf-49cc-9ef2-788d60cfe692 req-8771ecc0-0f5f-4137-9f46-3df3ce7348a8 service nova] Lock "925f656c-f94a-4707-b1d9-b750cd83a010-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0bb3c89f-7aaf-49cc-9ef2-788d60cfe692 req-8771ecc0-0f5f-4137-9f46-3df3ce7348a8 service nova] Lock "925f656c-f94a-4707-b1d9-b750cd83a010-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-0bb3c89f-7aaf-49cc-9ef2-788d60cfe692 req-8771ecc0-0f5f-4137-9f46-3df3ce7348a8 service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] No waiting events found dispatching network-vif-plugged-1d105b3b-29db-489d-992c-fc3e9f58f914 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:49:13 user nova-compute[73091]: WARNING nova.compute.manager [req-0bb3c89f-7aaf-49cc-9ef2-788d60cfe692 req-8771ecc0-0f5f-4137-9f46-3df3ce7348a8 service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Received unexpected event network-vif-plugged-1d105b3b-29db-489d-992c-fc3e9f58f914 for instance with vm_state building and task_state spawning.
Aug 09 16:49:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:49:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Instance spawned successfully.
Aug 09 16:49:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a73a3a6-6476-4a8a-b33e-c973d573135c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a] added
Aug 09 16:49:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddd14e5-90ce-4218-a962-a3a9eff14695]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:49:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:14 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:49:14 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599753.947415, 925f656c-f94a-4707-b1d9-b750cd83a010 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:49:14 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] VM Started (Lifecycle Event)
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[93eb9225-7436-4cec-bd80-c441019f144d]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rmdafnPh {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rmdafnPh" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38f29da-ce05-4afa-af27-25f695f44c15]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rmdafnPh'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:14 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:49:14 user nova-compute[73091]: INFO nova.compute.manager [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Took 6.19 seconds to spawn the instance on the hypervisor.
Aug 09 16:49:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d89cbf-cbcb-4b0c-bf5b-fb077af3f553]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd76c85c-7cfe-46ab-914c-13dd4d780964]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:49:14 user nova-compute[73091]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:49:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:49:14 user nova-compute[73091]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:49:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:14 user nova-compute[73091]: INFO nova.compute.manager [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Took 7.06 seconds to build instance.
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1302e2c1-d1e6-44cb-8313-2ad56a9d0f6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a, portal: 172.16.0.220,3260]
Aug 09 16:49:14 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a, portal: 172.16.0.220,3260] successful.
Aug 09 16:49:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07c5a66a-65c7-40c7-b72c-efa30cd9013d tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "925f656c-f94a-4707-b1d9-b750cd83a010" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.211s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10d4b6d-c3e4-441c-9b58-be82facecd61]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9aa8f1-85ae-4bc7-80c7-a06c241bc8a9]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:49:14 user nova-compute[73091]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:49:14 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:49:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:49:14 user nova-compute[73091]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:49:14 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:49:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8388e307-dad0-460b-b7d2-f99b02a0f92c]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rmdafnPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-f939fe27-017a-481e-babc-147bf98e0132" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-f939fe27-017a-481e-babc-147bf98e0132" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:49:14 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid f939fe27-017a-481e-babc-147bf98e0132 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '26565363934643336', 'path': '/dev/sdd'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565363934643336', 'path': '/dev/sdd'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG nova.objects.instance [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lazy-loading 'flavor' on Instance uuid c142dbba-1e7f-4381-91a5-876b55e11a64 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:49:15 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:49:15 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 09 16:49:15 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:49:15 user nova-compute[73091]:   <serial>ee4430ff-491a-4834-abb8-e57f3f4f2a9a</serial>
Aug 09 16:49:15 user nova-compute[73091]: </disk>
Aug 09 16:49:15 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] Updating instance_info_cache with network_info: [{"id": "c830ef2e-da54-4321-905f-845e0440a759", "address": "fa:16:3e:b5:68:3c", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc830ef2e-da", "ovs_interfaceid": "c830ef2e-da54-4321-905f-845e0440a759", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-f939fe27-017a-481e-babc-147bf98e0132" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "97af1277-b4bd-4a89-903b-4f70087f0535" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "97af1277-b4bd-4a89-903b-4f70087f0535" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Going to confirm migration 2 {{(pid=73091) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] No VIF found with MAC fa:16:3e:af:49:2e, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquired lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:49:15 user nova-compute[73091]: DEBUG nova.objects.instance [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lazy-loading 'info_cache' on Instance uuid 97af1277-b4bd-4a89-903b-4f70087f0535 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:49:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-036a95b5-4765-4509-886a-7db2cd5113f7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.701s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Updating instance_info_cache with network_info: [{"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:49:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Releasing lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:49:16 user nova-compute[73091]: DEBUG nova.objects.instance [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lazy-loading 'migration_context' on Instance uuid 97af1277-b4bd-4a89-903b-4f70087f0535 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:49:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:16 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Refreshing inventories for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 16:49:16 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Updating ProviderTree inventory for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 16:49:16 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Updating inventory in ProviderTree for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 16:49:16 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Refreshing aggregate associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 16:49:16 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Refreshing trait associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, traits: HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 16:49:17 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:49:17 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:49:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.797s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:17 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Deleted allocation for migration e6bc1e93-7c64-4de8-ae72-95a59498e872
Aug 09 16:49:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-21b73852-1556-423c-902d-1fc6dabab374 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "97af1277-b4bd-4a89-903b-4f70087f0535" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.059s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:49:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:49:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-6d665d53-27af-4571-aba8-49cea6baf7dd req-b88ce03b-4778-42e9-bf19-1b0535624d35 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received event network-changed-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:49:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-6d665d53-27af-4571-aba8-49cea6baf7dd req-b88ce03b-4778-42e9-bf19-1b0535624d35 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Refreshing instance network info cache due to event network-changed-84392ff0-9f13-41e4-adb9-c3a5db7677a5. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:49:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6d665d53-27af-4571-aba8-49cea6baf7dd req-b88ce03b-4778-42e9-bf19-1b0535624d35 service nova] Acquiring lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:49:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6d665d53-27af-4571-aba8-49cea6baf7dd req-b88ce03b-4778-42e9-bf19-1b0535624d35 service nova] Acquired lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:49:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-6d665d53-27af-4571-aba8-49cea6baf7dd req-b88ce03b-4778-42e9-bf19-1b0535624d35 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Refreshing network info cache for port 84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:49:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:49:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:20 user nova-compute[73091]: DEBUG nova.network.neutron [req-6d665d53-27af-4571-aba8-49cea6baf7dd req-b88ce03b-4778-42e9-bf19-1b0535624d35 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Updated VIF entry in instance network info cache for port 84392ff0-9f13-41e4-adb9-c3a5db7677a5. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:49:20 user nova-compute[73091]: DEBUG nova.network.neutron [req-6d665d53-27af-4571-aba8-49cea6baf7dd req-b88ce03b-4778-42e9-bf19-1b0535624d35 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Updating instance_info_cache with network_info: [{"id": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "address": "fa:16:3e:af:49:2e", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84392ff0-9f", "ovs_interfaceid": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:49:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6d665d53-27af-4571-aba8-49cea6baf7dd req-b88ce03b-4778-42e9-bf19-1b0535624d35 service nova] Releasing lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:49:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:49:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:49:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:49:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:49:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:49:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-c4832b19-025b-4f0c-813b-b624b6ab4917 req-ab7fbcb6-4610-440b-98ca-c0ef100cca30 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received event network-changed-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:49:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-c4832b19-025b-4f0c-813b-b624b6ab4917 req-ab7fbcb6-4610-440b-98ca-c0ef100cca30 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Refreshing instance network info cache due to event network-changed-84392ff0-9f13-41e4-adb9-c3a5db7677a5. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:49:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c4832b19-025b-4f0c-813b-b624b6ab4917 req-ab7fbcb6-4610-440b-98ca-c0ef100cca30 service nova] Acquiring lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:49:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c4832b19-025b-4f0c-813b-b624b6ab4917 req-ab7fbcb6-4610-440b-98ca-c0ef100cca30 service nova] Acquired lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:49:21 user nova-compute[73091]: DEBUG nova.network.neutron [req-c4832b19-025b-4f0c-813b-b624b6ab4917 req-ab7fbcb6-4610-440b-98ca-c0ef100cca30 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Refreshing network info cache for port 84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:49:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG nova.network.neutron [req-c4832b19-025b-4f0c-813b-b624b6ab4917 req-ab7fbcb6-4610-440b-98ca-c0ef100cca30 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Updated VIF entry in instance network info cache for port 84392ff0-9f13-41e4-adb9-c3a5db7677a5. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG nova.network.neutron [req-c4832b19-025b-4f0c-813b-b624b6ab4917 req-ab7fbcb6-4610-440b-98ca-c0ef100cca30 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Updating instance_info_cache with network_info: [{"id": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "address": "fa:16:3e:af:49:2e", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84392ff0-9f", "ovs_interfaceid": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c4832b19-025b-4f0c-813b-b624b6ab4917 req-ab7fbcb6-4610-440b-98ca-c0ef100cca30 service nova] Releasing lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-758126e2-3419-4bb7-8695-e34bf724dea7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "c142dbba-1e7f-4381-91a5-876b55e11a64" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-758126e2-3419-4bb7-8695-e34bf724dea7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:22 user nova-compute[73091]: INFO nova.compute.manager [None req-758126e2-3419-4bb7-8695-e34bf724dea7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Rebooting instance
Aug 09 16:49:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-758126e2-3419-4bb7-8695-e34bf724dea7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-758126e2-3419-4bb7-8695-e34bf724dea7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquired lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG nova.network.neutron [None req-758126e2-3419-4bb7-8695-e34bf724dea7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-758126e2-3419-4bb7-8695-e34bf724dea7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Updating instance_info_cache with network_info: [{"id": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "address": "fa:16:3e:af:49:2e", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84392ff0-9f", "ovs_interfaceid": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:49:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-758126e2-3419-4bb7-8695-e34bf724dea7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Releasing lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:49:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-758126e2-3419-4bb7-8695-e34bf724dea7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:49:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:24 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:49:24 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:49:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7202MB free_disk=25.070228576660156GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:49:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:49:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f939fe27-017a-481e-babc-147bf98e0132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:49:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8fc884a8-24bb-488a-baeb-ef2b1faf239d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:49:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance b9639ddc-0ff9-41d2-b647-3af5fce945c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:49:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c142dbba-1e7f-4381-91a5-876b55e11a64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:49:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 97af1277-b4bd-4a89-903b-4f70087f0535 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:49:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:49:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c3871ef4-45e7-4118-8227-e48cc857d481 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:49:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 66ca58dc-1701-4a50-be5c-de255e1fbf96 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:49:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 12689fb0-5e5e-4421-8dd1-859bd5461963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:49:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 925f656c-f94a-4707-b1d9-b750cd83a010 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:49:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:49:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:49:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:25 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:49:25 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:49:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:49:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:49:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-3c36d971-b95a-4d8d-8310-08cd12e5c6d1 req-5eb9d91f-e4c8-402a-a2ff-69fa40983661 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received event network-vif-unplugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3c36d971-b95a-4d8d-8310-08cd12e5c6d1 req-5eb9d91f-e4c8-402a-a2ff-69fa40983661 service nova] Acquiring lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3c36d971-b95a-4d8d-8310-08cd12e5c6d1 req-5eb9d91f-e4c8-402a-a2ff-69fa40983661 service nova] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3c36d971-b95a-4d8d-8310-08cd12e5c6d1 req-5eb9d91f-e4c8-402a-a2ff-69fa40983661 service nova] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-3c36d971-b95a-4d8d-8310-08cd12e5c6d1 req-5eb9d91f-e4c8-402a-a2ff-69fa40983661 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] No waiting events found dispatching network-vif-unplugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:49:26 user nova-compute[73091]: WARNING nova.compute.manager [req-3c36d971-b95a-4d8d-8310-08cd12e5c6d1 req-5eb9d91f-e4c8-402a-a2ff-69fa40983661 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received unexpected event network-vif-unplugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 for instance with vm_state active and task_state reboot_started.
Aug 09 16:49:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-758126e2-3419-4bb7-8695-e34bf724dea7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Instance shutdown successfully.
Aug 09 16:49:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-5d703620-e51d-4e26-86c4-b8bb401cbe10 req-3ea3a930-8996-4347-8d23-68d56fb28d56 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received event network-vif-plugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:49:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5d703620-e51d-4e26-86c4-b8bb401cbe10 req-3ea3a930-8996-4347-8d23-68d56fb28d56 service nova] Acquiring lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5d703620-e51d-4e26-86c4-b8bb401cbe10 req-3ea3a930-8996-4347-8d23-68d56fb28d56 service nova] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5d703620-e51d-4e26-86c4-b8bb401cbe10 req-3ea3a930-8996-4347-8d23-68d56fb28d56 service nova] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-5d703620-e51d-4e26-86c4-b8bb401cbe10 req-3ea3a930-8996-4347-8d23-68d56fb28d56 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] No waiting events found dispatching network-vif-plugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:49:28 user nova-compute[73091]: WARNING nova.compute.manager [req-5d703620-e51d-4e26-86c4-b8bb401cbe10 req-3ea3a930-8996-4347-8d23-68d56fb28d56 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received unexpected event network-vif-plugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 for instance with vm_state active and task_state reboot_started.
Aug 09 16:49:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-5d703620-e51d-4e26-86c4-b8bb401cbe10 req-3ea3a930-8996-4347-8d23-68d56fb28d56 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received event network-vif-plugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:49:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5d703620-e51d-4e26-86c4-b8bb401cbe10 req-3ea3a930-8996-4347-8d23-68d56fb28d56 service nova] Acquiring lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5d703620-e51d-4e26-86c4-b8bb401cbe10 req-3ea3a930-8996-4347-8d23-68d56fb28d56 service nova] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5d703620-e51d-4e26-86c4-b8bb401cbe10 req-3ea3a930-8996-4347-8d23-68d56fb28d56 service nova] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-5d703620-e51d-4e26-86c4-b8bb401cbe10 req-3ea3a930-8996-4347-8d23-68d56fb28d56 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] No waiting events found dispatching network-vif-plugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:49:28 user nova-compute[73091]: WARNING nova.compute.manager [req-5d703620-e51d-4e26-86c4-b8bb401cbe10 req-3ea3a930-8996-4347-8d23-68d56fb28d56 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received unexpected event network-vif-plugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 for instance with vm_state active and task_state reboot_started.
Aug 09 16:49:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-5d703620-e51d-4e26-86c4-b8bb401cbe10 req-3ea3a930-8996-4347-8d23-68d56fb28d56 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received event network-vif-plugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:49:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5d703620-e51d-4e26-86c4-b8bb401cbe10 req-3ea3a930-8996-4347-8d23-68d56fb28d56 service nova] Acquiring lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5d703620-e51d-4e26-86c4-b8bb401cbe10 req-3ea3a930-8996-4347-8d23-68d56fb28d56 service nova] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5d703620-e51d-4e26-86c4-b8bb401cbe10 req-3ea3a930-8996-4347-8d23-68d56fb28d56 service nova] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-5d703620-e51d-4e26-86c4-b8bb401cbe10 req-3ea3a930-8996-4347-8d23-68d56fb28d56 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] No waiting events found dispatching network-vif-plugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:49:28 user nova-compute[73091]: WARNING nova.compute.manager [req-5d703620-e51d-4e26-86c4-b8bb401cbe10 req-3ea3a930-8996-4347-8d23-68d56fb28d56 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received unexpected event network-vif-plugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 for instance with vm_state active and task_state reboot_started.
Aug 09 16:49:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-9c29900b-721e-493b-9026-2de2239db95f req-a6bb5916-7a70-4ad2-9ae5-c1512734628d service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received event network-changed-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:49:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-9c29900b-721e-493b-9026-2de2239db95f req-a6bb5916-7a70-4ad2-9ae5-c1512734628d service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Refreshing instance network info cache due to event network-changed-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:49:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9c29900b-721e-493b-9026-2de2239db95f req-a6bb5916-7a70-4ad2-9ae5-c1512734628d service nova] Acquiring lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:49:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9c29900b-721e-493b-9026-2de2239db95f req-a6bb5916-7a70-4ad2-9ae5-c1512734628d service nova] Acquired lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:49:29 user nova-compute[73091]: DEBUG nova.network.neutron [req-9c29900b-721e-493b-9026-2de2239db95f req-a6bb5916-7a70-4ad2-9ae5-c1512734628d service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Refreshing network info cache for port eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:49:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Removed pending event for c142dbba-1e7f-4381-91a5-876b55e11a64 due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 16:49:30 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599770.2518868, c142dbba-1e7f-4381-91a5-876b55e11a64 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:49:30 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] VM Resumed (Lifecycle Event)
Aug 09 16:49:30 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Instance running successfully.
Aug 09 16:49:30 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-758126e2-3419-4bb7-8695-e34bf724dea7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Instance soft rebooted successfully.
Aug 09 16:49:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-758126e2-3419-4bb7-8695-e34bf724dea7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:49:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:49:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:49:30 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 09 16:49:30 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599770.2521715, c142dbba-1e7f-4381-91a5-876b55e11a64 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:49:30 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] VM Started (Lifecycle Event)
Aug 09 16:49:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:49:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-758126e2-3419-4bb7-8695-e34bf724dea7 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.760s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:49:30 user nova-compute[73091]: DEBUG nova.network.neutron [req-9c29900b-721e-493b-9026-2de2239db95f req-a6bb5916-7a70-4ad2-9ae5-c1512734628d service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Updated VIF entry in instance network info cache for port eb647b7d-fa5b-4876-99da-b3c3ef59c0e7. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:49:30 user nova-compute[73091]: DEBUG nova.network.neutron [req-9c29900b-721e-493b-9026-2de2239db95f req-a6bb5916-7a70-4ad2-9ae5-c1512734628d service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Updating instance_info_cache with network_info: [{"id": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "address": "fa:16:3e:6e:98:76", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb647b7d-fa", "ovs_interfaceid": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:49:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9c29900b-721e-493b-9026-2de2239db95f req-a6bb5916-7a70-4ad2-9ae5-c1512734628d service nova] Releasing lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG nova.objects.instance [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'flavor' on Instance uuid 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:31 user nova-compute[73091]: INFO nova.compute.manager [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Attaching volume ae31d517-103e-4833-850a-d27291be1344 to /dev/vdb
Aug 09 16:49:31 user nova-compute[73091]: DEBUG os_brick.utils [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fce95b-f457-431e-8095-b4ee523a4ec0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[89049ddc-7611-4541-8d88-c69d4bc73239]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[003aa75c-1fc1-462c-87d9-6c1cefe9aa75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a428ec6b-ddb5-40b2-be68-ed1afa7c49ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:49:31 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:49:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb54d5b0-bddb-44cf-aadb-82573eb0c3a5]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG os_brick.utils [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:49:31 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Updating existing volume attachment record: 20cf756b-6870-400b-afa4-4cafd4dedaee {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:49:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_power_states {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid f939fe27-017a-481e-babc-147bf98e0132 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid 8fc884a8-24bb-488a-baeb-ef2b1faf239d {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid 97af1277-b4bd-4a89-903b-4f70087f0535 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid b9639ddc-0ff9-41d2-b647-3af5fce945c2 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid c142dbba-1e7f-4381-91a5-876b55e11a64 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid c3871ef4-45e7-4118-8227-e48cc857d481 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid 66ca58dc-1701-4a50-be5c-de255e1fbf96 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid 12689fb0-5e5e-4421-8dd1-859bd5461963 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid 925f656c-f94a-4707-b1d9-b750cd83a010 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid 18d8e887-0f91-42e1-ba79-13db5aa9b84b {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "f939fe27-017a-481e-babc-147bf98e0132" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "f939fe27-017a-481e-babc-147bf98e0132" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "97af1277-b4bd-4a89-903b-4f70087f0535" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "97af1277-b4bd-4a89-903b-4f70087f0535" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "c142dbba-1e7f-4381-91a5-876b55e11a64" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "c3871ef4-45e7-4118-8227-e48cc857d481" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "c3871ef4-45e7-4118-8227-e48cc857d481" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "66ca58dc-1701-4a50-be5c-de255e1fbf96" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "66ca58dc-1701-4a50-be5c-de255e1fbf96" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "12689fb0-5e5e-4421-8dd1-859bd5461963" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "925f656c-f94a-4707-b1d9-b750cd83a010" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "925f656c-f94a-4707-b1d9-b750cd83a010" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "f939fe27-017a-481e-babc-147bf98e0132" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "97af1277-b4bd-4a89-903b-4f70087f0535" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "c3871ef4-45e7-4118-8227-e48cc857d481" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "66ca58dc-1701-4a50-be5c-de255e1fbf96" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "925f656c-f94a-4707-b1d9-b750cd83a010" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:49:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:49:40 user nova-compute[73091]: INFO nova.compute.claims [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Claim successful on node user
Aug 09 16:49:41 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgKJYwTS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:49:41 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:49:41 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:49:41 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[215f5b67-6d59-4e1d-996e-9457ce1d921f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:49:41 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[91508e60-b0b3-420d-b347-4c32e7e19521]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344] added
Aug 09 16:49:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG nova.network.neutron [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7c3891-c379-4c7a-a36b-0e9317595057]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:49:41 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d665116c-5bcc-4201-aa2b-a3fec7ea0dcb]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgKJYwTS {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgKJYwTS" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1360c52-e406-414a-851d-8834aa000749]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VgKJYwTS'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d221c4-f9d8-48fb-81b0-415cb065b964]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG nova.policy [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77d81649b61a40ee87e4fc3c7cc56c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6982c498eeb94d8381a610cb59694191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[76af8979-9d95-4624-97aa-81ff4fab73ea]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:49:41 user nova-compute[73091]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:49:41 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:49:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:49:41 user nova-compute[73091]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:49:41 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:49:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:49:41 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Creating image(s)
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "/opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "/opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "/opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1880ba-957f-4bfc-9818-abf528dd4a60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344, portal: 172.16.0.220,3260]
Aug 09 16:49:41 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344, portal: 172.16.0.220,3260] successful.
Aug 09 16:49:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[408f54ca-5044-43a5-9dc5-6d1c75b41f44]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04bf253-405f-41b3-b76f-341bb498358c]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:49:41 user nova-compute[73091]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:49:41 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:49:41 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:49:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:49:41 user nova-compute[73091]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:49:41 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:49:41 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:49:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecbb03b-a807-4473-abdc-8ca5bb8d2237]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.144s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5/disk 1073741824" returned: 0 in 0.053s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.149s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:49:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:42 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Cannot resize image /opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:49:42 user nova-compute[73091]: DEBUG nova.objects.instance [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lazy-loading 'migration_context' on Instance uuid 0367cec8-7472-4e57-9ef9-d8cee9ad57c5 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:49:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:49:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Ensure instance console log exists: /opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:49:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Successfully created port: 7f0dfb31-4d50-4a36-b838-7151f4893a02 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:49:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:49:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgKJYwTS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:49:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:49:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '26165666661313061', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:49:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165666661313061', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:49:42 user nova-compute[73091]: DEBUG nova.objects.instance [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'flavor' on Instance uuid 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:49:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:49:42 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:49:42 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 09 16:49:42 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:49:42 user nova-compute[73091]:   <serial>ae31d517-103e-4833-850a-d27291be1344</serial>
Aug 09 16:49:42 user nova-compute[73091]: </disk>
Aug 09 16:49:42 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.network.neutron [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Successfully updated port: 7f0dfb31-4d50-4a36-b838-7151f4893a02 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] No VIF found with MAC fa:16:3e:6e:98:76, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "refresh_cache-0367cec8-7472-4e57-9ef9-d8cee9ad57c5" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquired lock "refresh_cache-0367cec8-7472-4e57-9ef9-d8cee9ad57c5" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.network.neutron [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-6a67283f-b92f-4be2-bf20-99e25db6d0ff req-0f2ea6f7-f832-4307-a482-b7c4aa99bc9e service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Received event network-changed-7f0dfb31-4d50-4a36-b838-7151f4893a02 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-6a67283f-b92f-4be2-bf20-99e25db6d0ff req-0f2ea6f7-f832-4307-a482-b7c4aa99bc9e service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Refreshing instance network info cache due to event network-changed-7f0dfb31-4d50-4a36-b838-7151f4893a02. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6a67283f-b92f-4be2-bf20-99e25db6d0ff req-0f2ea6f7-f832-4307-a482-b7c4aa99bc9e service nova] Acquiring lock "refresh_cache-0367cec8-7472-4e57-9ef9-d8cee9ad57c5" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.network.neutron [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-71500c0d-5047-4b64-a8b6-f7124d935799 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.712s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.659s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.network.neutron [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Updating instance_info_cache with network_info: [{"id": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "address": "fa:16:3e:dc:a0:74", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f0dfb31-4d", "ovs_interfaceid": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Releasing lock "refresh_cache-0367cec8-7472-4e57-9ef9-d8cee9ad57c5" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Instance network_info: |[{"id": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "address": "fa:16:3e:dc:a0:74", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f0dfb31-4d", "ovs_interfaceid": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6a67283f-b92f-4be2-bf20-99e25db6d0ff req-0f2ea6f7-f832-4307-a482-b7c4aa99bc9e service nova] Acquired lock "refresh_cache-0367cec8-7472-4e57-9ef9-d8cee9ad57c5" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-6a67283f-b92f-4be2-bf20-99e25db6d0ff req-0f2ea6f7-f832-4307-a482-b7c4aa99bc9e service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Refreshing network info cache for port 7f0dfb31-4d50-4a36-b838-7151f4893a02 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Start _get_guest_xml network_info=[{"id": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "address": "fa:16:3e:dc:a0:74", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f0dfb31-4d", "ovs_interfaceid": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:49:43 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:49:43 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1067024379',display_name='tempest-VolumesSnapshotTestJSON-instance-1067024379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1067024379',id=38,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTOHJXWY8Amk8D9MJn1isq6BrynY6QbXlCy4agJnYj7Wm1dpIa9Te5vfNyegfLojoccJGvIAEkP68OZei24EijDFTG3wifrgD1G8cp/rQcmOAwFlY8q1k8NoW+YYaritA==',key_name='tempest-keypair-760846969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6982c498eeb94d8381a610cb59694191',ramdisk_id='',reservation_id='r-sn34wljy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-472009357',owner_user_name='tempest-VolumesSnapshotTestJSON-472009357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:49:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77d81649b61a40ee87e4fc3c7cc56c7d',uuid=0367cec8-7472-4e57-9ef9-d8cee9ad57c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "address": "fa:16:3e:dc:a0:74", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f0dfb31-4d", "ovs_interfaceid": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Converting VIF {"id": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "address": "fa:16:3e:dc:a0:74", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f0dfb31-4d", "ovs_interfaceid": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:a0:74,bridge_name='br-int',has_traffic_filtering=True,id=7f0dfb31-4d50-4a36-b838-7151f4893a02,network=Network(8b1a154d-9ae1-4829-a3f1-001cf4ae3658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f0dfb31-4d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.objects.instance [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lazy-loading 'pci_devices' on Instance uuid 0367cec8-7472-4e57-9ef9-d8cee9ad57c5 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:49:43 user nova-compute[73091]:   <uuid>0367cec8-7472-4e57-9ef9-d8cee9ad57c5</uuid>
Aug 09 16:49:43 user nova-compute[73091]:   <name>instance-00000026</name>
Aug 09 16:49:43 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:49:43 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:49:43 user nova-compute[73091]:   <metadata>
Aug 09 16:49:43 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:49:43 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:49:43 user nova-compute[73091]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1067024379</nova:name>
Aug 09 16:49:43 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:49:43</nova:creationTime>
Aug 09 16:49:43 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:49:43 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:49:43 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:49:43 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:49:43 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:49:43 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:49:43 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:49:43 user nova-compute[73091]:       <nova:owner>
Aug 09 16:49:43 user nova-compute[73091]:         <nova:user uuid="77d81649b61a40ee87e4fc3c7cc56c7d">tempest-VolumesSnapshotTestJSON-472009357-project-member</nova:user>
Aug 09 16:49:43 user nova-compute[73091]:         <nova:project uuid="6982c498eeb94d8381a610cb59694191">tempest-VolumesSnapshotTestJSON-472009357</nova:project>
Aug 09 16:49:43 user nova-compute[73091]:       </nova:owner>
Aug 09 16:49:43 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:49:43 user nova-compute[73091]:       <nova:ports>
Aug 09 16:49:43 user nova-compute[73091]:         <nova:port uuid="7f0dfb31-4d50-4a36-b838-7151f4893a02">
Aug 09 16:49:43 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 16:49:43 user nova-compute[73091]:         </nova:port>
Aug 09 16:49:43 user nova-compute[73091]:       </nova:ports>
Aug 09 16:49:43 user nova-compute[73091]:     </nova:instance>
Aug 09 16:49:43 user nova-compute[73091]:   </metadata>
Aug 09 16:49:43 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:49:43 user nova-compute[73091]:     <system>
Aug 09 16:49:43 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:49:43 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:49:43 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:49:43 user nova-compute[73091]:       <entry name="serial">0367cec8-7472-4e57-9ef9-d8cee9ad57c5</entry>
Aug 09 16:49:43 user nova-compute[73091]:       <entry name="uuid">0367cec8-7472-4e57-9ef9-d8cee9ad57c5</entry>
Aug 09 16:49:43 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:49:43 user nova-compute[73091]:     </system>
Aug 09 16:49:43 user nova-compute[73091]:   </sysinfo>
Aug 09 16:49:43 user nova-compute[73091]:   <os>
Aug 09 16:49:43 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:49:43 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:49:43 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:49:43 user nova-compute[73091]:   </os>
Aug 09 16:49:43 user nova-compute[73091]:   <features>
Aug 09 16:49:43 user nova-compute[73091]:     <acpi/>
Aug 09 16:49:43 user nova-compute[73091]:     <apic/>
Aug 09 16:49:43 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:49:43 user nova-compute[73091]:   </features>
Aug 09 16:49:43 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:49:43 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:49:43 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:49:43 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:49:43 user nova-compute[73091]:   </clock>
Aug 09 16:49:43 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:49:43 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:49:43 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:49:43 user nova-compute[73091]:   </cpu>
Aug 09 16:49:43 user nova-compute[73091]:   <devices>
Aug 09 16:49:43 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:49:43 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:49:43 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5/disk"/>
Aug 09 16:49:43 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:49:43 user nova-compute[73091]:     </disk>
Aug 09 16:49:43 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:49:43 user nova-compute[73091]:       <mac address="fa:16:3e:dc:a0:74"/>
Aug 09 16:49:43 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:49:43 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:49:43 user nova-compute[73091]:       <target dev="tap7f0dfb31-4d"/>
Aug 09 16:49:43 user nova-compute[73091]:     </interface>
Aug 09 16:49:43 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:49:43 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5/console.log" append="off"/>
Aug 09 16:49:43 user nova-compute[73091]:     </serial>
Aug 09 16:49:43 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:49:43 user nova-compute[73091]:     <video>
Aug 09 16:49:43 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:49:43 user nova-compute[73091]:     </video>
Aug 09 16:49:43 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:49:43 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:49:43 user nova-compute[73091]:     </rng>
Aug 09 16:49:43 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:49:43 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:49:43 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:49:43 user nova-compute[73091]:     </memballoon>
Aug 09 16:49:43 user nova-compute[73091]:   </devices>
Aug 09 16:49:43 user nova-compute[73091]: </domain>
Aug 09 16:49:43 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1067024379',display_name='tempest-VolumesSnapshotTestJSON-instance-1067024379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1067024379',id=38,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTOHJXWY8Amk8D9MJn1isq6BrynY6QbXlCy4agJnYj7Wm1dpIa9Te5vfNyegfLojoccJGvIAEkP68OZei24EijDFTG3wifrgD1G8cp/rQcmOAwFlY8q1k8NoW+YYaritA==',key_name='tempest-keypair-760846969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6982c498eeb94d8381a610cb59694191',ramdisk_id='',reservation_id='r-sn34wljy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-472009357',owner_user_name='tempest-VolumesSnapshotTestJSON-472009357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:49:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77d81649b61a40ee87e4fc3c7cc56c7d',uuid=0367cec8-7472-4e57-9ef9-d8cee9ad57c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "address": "fa:16:3e:dc:a0:74", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f0dfb31-4d", "ovs_interfaceid": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Converting VIF {"id": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "address": "fa:16:3e:dc:a0:74", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f0dfb31-4d", "ovs_interfaceid": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:a0:74,bridge_name='br-int',has_traffic_filtering=True,id=7f0dfb31-4d50-4a36-b838-7151f4893a02,network=Network(8b1a154d-9ae1-4829-a3f1-001cf4ae3658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f0dfb31-4d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG os_vif [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:a0:74,bridge_name='br-int',has_traffic_filtering=True,id=7f0dfb31-4d50-4a36-b838-7151f4893a02,network=Network(8b1a154d-9ae1-4829-a3f1-001cf4ae3658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f0dfb31-4d') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f0dfb31-4d, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f0dfb31-4d, col_values=(('external_ids', {'iface-id': '7f0dfb31-4d50-4a36-b838-7151f4893a02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:a0:74', 'vm-uuid': '0367cec8-7472-4e57-9ef9-d8cee9ad57c5'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:43 user nova-compute[73091]: INFO os_vif [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:a0:74,bridge_name='br-int',has_traffic_filtering=True,id=7f0dfb31-4d50-4a36-b838-7151f4893a02,network=Network(8b1a154d-9ae1-4829-a3f1-001cf4ae3658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f0dfb31-4d')
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] No VIF found with MAC fa:16:3e:dc:a0:74, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:49:43 user nova-compute[73091]: INFO nova.compute.manager [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Rescuing
Aug 09 16:49:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquired lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-6a67283f-b92f-4be2-bf20-99e25db6d0ff req-0f2ea6f7-f832-4307-a482-b7c4aa99bc9e service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Updated VIF entry in instance network info cache for port 7f0dfb31-4d50-4a36-b838-7151f4893a02. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-6a67283f-b92f-4be2-bf20-99e25db6d0ff req-0f2ea6f7-f832-4307-a482-b7c4aa99bc9e service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Updating instance_info_cache with network_info: [{"id": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "address": "fa:16:3e:dc:a0:74", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f0dfb31-4d", "ovs_interfaceid": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:49:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6a67283f-b92f-4be2-bf20-99e25db6d0ff req-0f2ea6f7-f832-4307-a482-b7c4aa99bc9e service nova] Releasing lock "refresh_cache-0367cec8-7472-4e57-9ef9-d8cee9ad57c5" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:49:44 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Updating instance_info_cache with network_info: [{"id": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "address": "fa:16:3e:6e:98:76", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb647b7d-fa", "ovs_interfaceid": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:49:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Releasing lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:49:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-b881a327-24c3-43ac-aa18-e5547bb5765e req-dbd31990-c5eb-44f9-aaa8-79b4bc060130 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received event network-vif-unplugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:49:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b881a327-24c3-43ac-aa18-e5547bb5765e req-dbd31990-c5eb-44f9-aaa8-79b4bc060130 service nova] Acquiring lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b881a327-24c3-43ac-aa18-e5547bb5765e req-dbd31990-c5eb-44f9-aaa8-79b4bc060130 service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b881a327-24c3-43ac-aa18-e5547bb5765e req-dbd31990-c5eb-44f9-aaa8-79b4bc060130 service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-b881a327-24c3-43ac-aa18-e5547bb5765e req-dbd31990-c5eb-44f9-aaa8-79b4bc060130 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] No waiting events found dispatching network-vif-unplugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:49:44 user nova-compute[73091]: WARNING nova.compute.manager [req-b881a327-24c3-43ac-aa18-e5547bb5765e req-dbd31990-c5eb-44f9-aaa8-79b4bc060130 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received unexpected event network-vif-unplugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 for instance with vm_state active and task_state rescuing.
Aug 09 16:49:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Instance destroyed successfully.
Aug 09 16:49:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Attempting rescue
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73091) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 16:49:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Creating image(s)
Aug 09 16:49:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "/opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "/opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk.rescue {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk.rescue" returned: 0 in 0.054s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'migration_context' on Instance uuid 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Start _get_guest_xml network_info=[{"id": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "address": "fa:16:3e:6e:98:76", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "vif_mac": "fa:16:3e:6e:98:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb647b7d-fa", "ovs_interfaceid": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'resources' on Instance uuid 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'numa_topology' on Instance uuid 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:49:45 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:49:45 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1022344144',display_name='tempest-ServerRescueNegativeTestJSON-server-1022344144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1022344144',id=33,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJeBceutq8beCoz7o5tRRL6nOu5QPrjWN+s6rvp9Fvssl1/IzP36PGvY7B+nY9X7lGk8okKCsSnHSaKD5G55lUhqdGH+XIHRSNC2lzJa8k3fRIhiL23Yb1SGPcolqezVw==',key_name='tempest-keypair-1565128997',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:47:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a03dd6b23c840c7b4a07f0235c1051b',ramdisk_id='',reservation_id='r-77ymisa2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-596687024',owner_user_name='tempest-ServerRescueNegativeTestJSON-596687024-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef7727ab5d1b46d383bfc02750d29ec7',uuid=3ef6c7f1-c8c4-49e1-819a-e8196eae70e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "address": "fa:16:3e:6e:98:76", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "vif_mac": "fa:16:3e:6e:98:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb647b7d-fa", "ovs_interfaceid": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converting VIF {"id": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "address": "fa:16:3e:6e:98:76", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "vif_mac": "fa:16:3e:6e:98:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb647b7d-fa", "ovs_interfaceid": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:98:76,bridge_name='br-int',has_traffic_filtering=True,id=eb647b7d-fa5b-4876-99da-b3c3ef59c0e7,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb647b7d-fa') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:49:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:49:45 user nova-compute[73091]:   <uuid>3ef6c7f1-c8c4-49e1-819a-e8196eae70e2</uuid>
Aug 09 16:49:45 user nova-compute[73091]:   <name>instance-00000021</name>
Aug 09 16:49:45 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:49:45 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:49:45 user nova-compute[73091]:   <metadata>
Aug 09 16:49:45 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:49:45 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:49:45 user nova-compute[73091]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1022344144</nova:name>
Aug 09 16:49:45 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:49:45</nova:creationTime>
Aug 09 16:49:45 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:49:45 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:49:45 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:49:45 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:49:45 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:49:45 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:49:45 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:49:45 user nova-compute[73091]:       <nova:owner>
Aug 09 16:49:45 user nova-compute[73091]:         <nova:user uuid="ef7727ab5d1b46d383bfc02750d29ec7">tempest-ServerRescueNegativeTestJSON-596687024-project-member</nova:user>
Aug 09 16:49:45 user nova-compute[73091]:         <nova:project uuid="1a03dd6b23c840c7b4a07f0235c1051b">tempest-ServerRescueNegativeTestJSON-596687024</nova:project>
Aug 09 16:49:45 user nova-compute[73091]:       </nova:owner>
Aug 09 16:49:45 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:49:45 user nova-compute[73091]:       <nova:ports>
Aug 09 16:49:45 user nova-compute[73091]:         <nova:port uuid="eb647b7d-fa5b-4876-99da-b3c3ef59c0e7">
Aug 09 16:49:45 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 16:49:45 user nova-compute[73091]:         </nova:port>
Aug 09 16:49:45 user nova-compute[73091]:       </nova:ports>
Aug 09 16:49:45 user nova-compute[73091]:     </nova:instance>
Aug 09 16:49:45 user nova-compute[73091]:   </metadata>
Aug 09 16:49:45 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:49:45 user nova-compute[73091]:     <system>
Aug 09 16:49:45 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:49:45 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:49:45 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:49:45 user nova-compute[73091]:       <entry name="serial">3ef6c7f1-c8c4-49e1-819a-e8196eae70e2</entry>
Aug 09 16:49:45 user nova-compute[73091]:       <entry name="uuid">3ef6c7f1-c8c4-49e1-819a-e8196eae70e2</entry>
Aug 09 16:49:45 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:49:45 user nova-compute[73091]:     </system>
Aug 09 16:49:45 user nova-compute[73091]:   </sysinfo>
Aug 09 16:49:45 user nova-compute[73091]:   <os>
Aug 09 16:49:45 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:49:45 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:49:45 user nova-compute[73091]:   </os>
Aug 09 16:49:45 user nova-compute[73091]:   <features>
Aug 09 16:49:45 user nova-compute[73091]:     <acpi/>
Aug 09 16:49:45 user nova-compute[73091]:     <apic/>
Aug 09 16:49:45 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:49:45 user nova-compute[73091]:   </features>
Aug 09 16:49:45 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:49:45 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:49:45 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:49:45 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:49:45 user nova-compute[73091]:   </clock>
Aug 09 16:49:45 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:49:45 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:49:45 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:49:45 user nova-compute[73091]:   </cpu>
Aug 09 16:49:45 user nova-compute[73091]:   <devices>
Aug 09 16:49:45 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:49:45 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:49:45 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk.rescue"/>
Aug 09 16:49:45 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:49:45 user nova-compute[73091]:     </disk>
Aug 09 16:49:45 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:49:45 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:49:45 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk"/>
Aug 09 16:49:45 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 09 16:49:45 user nova-compute[73091]:     </disk>
Aug 09 16:49:45 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:49:45 user nova-compute[73091]:       <mac address="fa:16:3e:6e:98:76"/>
Aug 09 16:49:45 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:49:45 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:49:45 user nova-compute[73091]:       <target dev="tapeb647b7d-fa"/>
Aug 09 16:49:45 user nova-compute[73091]:     </interface>
Aug 09 16:49:45 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:49:45 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/console.log" append="off"/>
Aug 09 16:49:45 user nova-compute[73091]:     </serial>
Aug 09 16:49:45 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:49:45 user nova-compute[73091]:     <video>
Aug 09 16:49:45 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:49:45 user nova-compute[73091]:     </video>
Aug 09 16:49:45 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:49:45 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:49:45 user nova-compute[73091]:     </rng>
Aug 09 16:49:45 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:49:45 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:49:45 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:49:45 user nova-compute[73091]:     </memballoon>
Aug 09 16:49:45 user nova-compute[73091]:   </devices>
Aug 09 16:49:45 user nova-compute[73091]: </domain>
Aug 09 16:49:45 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:49:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Instance destroyed successfully.
Aug 09 16:49:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:49:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:49:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] No VIF found with MAC fa:16:3e:6e:98:76, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:49:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc4de2bd-5536-475b-8222-e5183511db49 req-41d6692e-7abc-4032-a494-b49937c3ef3e service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received event network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:49:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc4de2bd-5536-475b-8222-e5183511db49 req-41d6692e-7abc-4032-a494-b49937c3ef3e service nova] Acquiring lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc4de2bd-5536-475b-8222-e5183511db49 req-41d6692e-7abc-4032-a494-b49937c3ef3e service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc4de2bd-5536-475b-8222-e5183511db49 req-41d6692e-7abc-4032-a494-b49937c3ef3e service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc4de2bd-5536-475b-8222-e5183511db49 req-41d6692e-7abc-4032-a494-b49937c3ef3e service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] No waiting events found dispatching network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:49:46 user nova-compute[73091]: WARNING nova.compute.manager [req-cc4de2bd-5536-475b-8222-e5183511db49 req-41d6692e-7abc-4032-a494-b49937c3ef3e service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received unexpected event network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 for instance with vm_state active and task_state rescuing.
Aug 09 16:49:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc4de2bd-5536-475b-8222-e5183511db49 req-41d6692e-7abc-4032-a494-b49937c3ef3e service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Received event network-vif-plugged-7f0dfb31-4d50-4a36-b838-7151f4893a02 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:49:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc4de2bd-5536-475b-8222-e5183511db49 req-41d6692e-7abc-4032-a494-b49937c3ef3e service nova] Acquiring lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc4de2bd-5536-475b-8222-e5183511db49 req-41d6692e-7abc-4032-a494-b49937c3ef3e service nova] Lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc4de2bd-5536-475b-8222-e5183511db49 req-41d6692e-7abc-4032-a494-b49937c3ef3e service nova] Lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc4de2bd-5536-475b-8222-e5183511db49 req-41d6692e-7abc-4032-a494-b49937c3ef3e service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] No waiting events found dispatching network-vif-plugged-7f0dfb31-4d50-4a36-b838-7151f4893a02 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:49:46 user nova-compute[73091]: WARNING nova.compute.manager [req-cc4de2bd-5536-475b-8222-e5183511db49 req-41d6692e-7abc-4032-a494-b49937c3ef3e service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Received unexpected event network-vif-plugged-7f0dfb31-4d50-4a36-b838-7151f4893a02 for instance with vm_state building and task_state spawning.
Aug 09 16:49:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc4de2bd-5536-475b-8222-e5183511db49 req-41d6692e-7abc-4032-a494-b49937c3ef3e service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Received event network-vif-plugged-7f0dfb31-4d50-4a36-b838-7151f4893a02 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:49:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc4de2bd-5536-475b-8222-e5183511db49 req-41d6692e-7abc-4032-a494-b49937c3ef3e service nova] Acquiring lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc4de2bd-5536-475b-8222-e5183511db49 req-41d6692e-7abc-4032-a494-b49937c3ef3e service nova] Lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc4de2bd-5536-475b-8222-e5183511db49 req-41d6692e-7abc-4032-a494-b49937c3ef3e service nova] Lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:46 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc4de2bd-5536-475b-8222-e5183511db49 req-41d6692e-7abc-4032-a494-b49937c3ef3e service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] No waiting events found dispatching network-vif-plugged-7f0dfb31-4d50-4a36-b838-7151f4893a02 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:49:46 user nova-compute[73091]: WARNING nova.compute.manager [req-cc4de2bd-5536-475b-8222-e5183511db49 req-41d6692e-7abc-4032-a494-b49937c3ef3e service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Received unexpected event network-vif-plugged-7f0dfb31-4d50-4a36-b838-7151f4893a02 for instance with vm_state building and task_state spawning.
Aug 09 16:49:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:47 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599787.407941, 0367cec8-7472-4e57-9ef9-d8cee9ad57c5 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:49:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] VM Resumed (Lifecycle Event)
Aug 09 16:49:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:49:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:49:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:49:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Instance spawned successfully.
Aug 09 16:49:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:49:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:49:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:49:47 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599787.4120765, 0367cec8-7472-4e57-9ef9-d8cee9ad57c5 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:49:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] VM Started (Lifecycle Event)
Aug 09 16:49:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:49:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:49:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:49:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:49:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:49:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:49:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:49:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:49:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:49:47 user nova-compute[73091]: INFO nova.compute.manager [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Took 6.17 seconds to spawn the instance on the hypervisor.
Aug 09 16:49:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:49:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:47 user nova-compute[73091]: INFO nova.compute.manager [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Took 7.14 seconds to build instance.
Aug 09 16:49:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-88129ae4-0f39-4953-a9a5-091a7be7de7a tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.310s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-cbcce355-a27f-4307-9ebd-93b152b20507 req-93be2876-56b7-4b30-a892-ebc12ecfe003 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received event network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:49:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cbcce355-a27f-4307-9ebd-93b152b20507 req-93be2876-56b7-4b30-a892-ebc12ecfe003 service nova] Acquiring lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cbcce355-a27f-4307-9ebd-93b152b20507 req-93be2876-56b7-4b30-a892-ebc12ecfe003 service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cbcce355-a27f-4307-9ebd-93b152b20507 req-93be2876-56b7-4b30-a892-ebc12ecfe003 service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-cbcce355-a27f-4307-9ebd-93b152b20507 req-93be2876-56b7-4b30-a892-ebc12ecfe003 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] No waiting events found dispatching network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:49:48 user nova-compute[73091]: WARNING nova.compute.manager [req-cbcce355-a27f-4307-9ebd-93b152b20507 req-93be2876-56b7-4b30-a892-ebc12ecfe003 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received unexpected event network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 for instance with vm_state active and task_state rescuing.
Aug 09 16:49:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-cbcce355-a27f-4307-9ebd-93b152b20507 req-93be2876-56b7-4b30-a892-ebc12ecfe003 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received event network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:49:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cbcce355-a27f-4307-9ebd-93b152b20507 req-93be2876-56b7-4b30-a892-ebc12ecfe003 service nova] Acquiring lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:49:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cbcce355-a27f-4307-9ebd-93b152b20507 req-93be2876-56b7-4b30-a892-ebc12ecfe003 service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:49:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cbcce355-a27f-4307-9ebd-93b152b20507 req-93be2876-56b7-4b30-a892-ebc12ecfe003 service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:49:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-cbcce355-a27f-4307-9ebd-93b152b20507 req-93be2876-56b7-4b30-a892-ebc12ecfe003 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] No waiting events found dispatching network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:49:48 user nova-compute[73091]: WARNING nova.compute.manager [req-cbcce355-a27f-4307-9ebd-93b152b20507 req-93be2876-56b7-4b30-a892-ebc12ecfe003 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received unexpected event network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 for instance with vm_state active and task_state rescuing.
Aug 09 16:49:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Removed pending event for 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 16:49:49 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599789.4597704, 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:49:49 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] VM Resumed (Lifecycle Event)
Aug 09 16:49:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a65a16b8-3bc5-4c84-8326-f1043d17cddd tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:49:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:49:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:49:49 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 16:49:49 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599789.4614716, 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:49:49 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] VM Started (Lifecycle Event)
Aug 09 16:49:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:49:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:49:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:49:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:50:03 user nova-compute[73091]: INFO nova.compute.manager [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] instance snapshotting
Aug 09 16:50:03 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Beginning live snapshot process
Aug 09 16:50:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.151s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4qkalmsp/fdf78a59817a4db8b2eec9198a2baf4a.delta 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4qkalmsp/fdf78a59817a4db8b2eec9198a2baf4a.delta 1073741824" returned: 0 in 0.056s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 16:50:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:50:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] COPY block job progress, current cursor: 28246016 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:50:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:50:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 16:50:06 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 16:50:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4qkalmsp/fdf78a59817a4db8b2eec9198a2baf4a.delta /opt/stack/data/nova/instances/snapshots/tmp4qkalmsp/fdf78a59817a4db8b2eec9198a2baf4a {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4qkalmsp/fdf78a59817a4db8b2eec9198a2baf4a.delta /opt/stack/data/nova/instances/snapshots/tmp4qkalmsp/fdf78a59817a4db8b2eec9198a2baf4a" returned: 0 in 0.561s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Snapshot extracted, beginning image upload
Aug 09 16:50:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:09 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Snapshot image upload complete
Aug 09 16:50:09 user nova-compute[73091]: INFO nova.compute.manager [None req-f0ff1030-962d-4530-90f2-1981334e7a07 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Took 5.44 seconds to snapshot the instance on the hypervisor.
Aug 09 16:50:09 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:50:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-e491afd9-e183-43e3-bed1-3212fe05285c req-aba63dec-f2e6-402c-be0d-9dc96140e923 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Received event network-changed-064be756-0cdb-4755-a870-5d466c14e32e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:50:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-e491afd9-e183-43e3-bed1-3212fe05285c req-aba63dec-f2e6-402c-be0d-9dc96140e923 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Refreshing instance network info cache due to event network-changed-064be756-0cdb-4755-a870-5d466c14e32e. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:50:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e491afd9-e183-43e3-bed1-3212fe05285c req-aba63dec-f2e6-402c-be0d-9dc96140e923 service nova] Acquiring lock "refresh_cache-66ca58dc-1701-4a50-be5c-de255e1fbf96" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:50:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e491afd9-e183-43e3-bed1-3212fe05285c req-aba63dec-f2e6-402c-be0d-9dc96140e923 service nova] Acquired lock "refresh_cache-66ca58dc-1701-4a50-be5c-de255e1fbf96" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:50:14 user nova-compute[73091]: DEBUG nova.network.neutron [req-e491afd9-e183-43e3-bed1-3212fe05285c req-aba63dec-f2e6-402c-be0d-9dc96140e923 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Refreshing network info cache for port 064be756-0cdb-4755-a870-5d466c14e32e {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:50:14 user nova-compute[73091]: DEBUG nova.network.neutron [req-e491afd9-e183-43e3-bed1-3212fe05285c req-aba63dec-f2e6-402c-be0d-9dc96140e923 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Updated VIF entry in instance network info cache for port 064be756-0cdb-4755-a870-5d466c14e32e. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:50:14 user nova-compute[73091]: DEBUG nova.network.neutron [req-e491afd9-e183-43e3-bed1-3212fe05285c req-aba63dec-f2e6-402c-be0d-9dc96140e923 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Updating instance_info_cache with network_info: [{"id": "064be756-0cdb-4755-a870-5d466c14e32e", "address": "fa:16:3e:db:50:ee", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap064be756-0c", "ovs_interfaceid": "064be756-0cdb-4755-a870-5d466c14e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:50:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e491afd9-e183-43e3-bed1-3212fe05285c req-aba63dec-f2e6-402c-be0d-9dc96140e923 service nova] Releasing lock "refresh_cache-66ca58dc-1701-4a50-be5c-de255e1fbf96" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:50:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "66ca58dc-1701-4a50-be5c-de255e1fbf96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:50:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "66ca58dc-1701-4a50-be5c-de255e1fbf96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:50:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "66ca58dc-1701-4a50-be5c-de255e1fbf96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:50:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "66ca58dc-1701-4a50-be5c-de255e1fbf96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:50:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "66ca58dc-1701-4a50-be5c-de255e1fbf96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:50:14 user nova-compute[73091]: INFO nova.compute.manager [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Terminating instance
Aug 09 16:50:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:50:14 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:50:14 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:50:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:50:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:15 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Instance destroyed successfully.
Aug 09 16:50:15 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lazy-loading 'resources' on Instance uuid 66ca58dc-1701-4a50-be5c-de255e1fbf96 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1075965977',display_name='tempest-TestVolumeBootPattern-server-1075965977',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1075965977',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSSzWQUVuDlac0eUgyT2z4iM1Y0qg2BfVrMrtynGR00pxQ570GYD8As3UZF1alKpRXt3lDEuXxBRenfT0VFniILv2ftKfjpM7Z1J3bJewWzw1Fr2JnxHpTfKfQmiSEWpw==',key_name='tempest-TestVolumeBootPattern-2063534983',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:48:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64d3dfd232d54594808dad271baa5192',ramdisk_id='',reservation_id='r-vbzqi3u1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1605875873',owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:48:43Z,user_data=None,user_id='69ccebf0e9d54502a2318c809ce11369',uuid=66ca58dc-1701-4a50-be5c-de255e1fbf96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "064be756-0cdb-4755-a870-5d466c14e32e", "address": "fa:16:3e:db:50:ee", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap064be756-0c", "ovs_interfaceid": "064be756-0cdb-4755-a870-5d466c14e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converting VIF {"id": "064be756-0cdb-4755-a870-5d466c14e32e", "address": "fa:16:3e:db:50:ee", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap064be756-0c", "ovs_interfaceid": "064be756-0cdb-4755-a870-5d466c14e32e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:50:ee,bridge_name='br-int',has_traffic_filtering=True,id=064be756-0cdb-4755-a870-5d466c14e32e,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap064be756-0c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG os_vif [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:50:ee,bridge_name='br-int',has_traffic_filtering=True,id=064be756-0cdb-4755-a870-5d466c14e32e,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap064be756-0c') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap064be756-0c, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:50:15 user nova-compute[73091]: INFO os_vif [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:50:ee,bridge_name='br-int',has_traffic_filtering=True,id=064be756-0cdb-4755-a870-5d466c14e32e,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap064be756-0c')
Aug 09 16:50:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XypTsJzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:50:15 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:50:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a29cb2-75cd-409d-9f6d-6aa051e5d512]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[435e7b97-2bba-46cd-8335-a4589ffeea28]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:50:15 user nova-compute[73091]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:50:15 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:50:15 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:50:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:50:15 user nova-compute[73091]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:50:15 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:50:15 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:50:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0801c23b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c88010d-998d-4925-a001-a3a68f3bda09]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6abaa5-17c5-4b54-aa56-42da06d90b21]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d6c4d2-5ac4-4d5f-a799-742b15187bb6]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c6eade-0e13-4c37-9cce-52fcebd09390]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_673d03de', '/dev/disk/by-id/scsi-1SCST_BIO673d03de-3b81793fcf8646db', '/dev/disk/by-id/scsi-23362383137393366') {{(pid=83925) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a75ec76-f273-40c7-b325-b5aa14d46064]: (4, None) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[832ceceb-46b7-4a53-83a1-085218fb6af4]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f048bee1-bfff-4964-9221-8eb3fbb8e88c]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c, portal: 172.16.0.220,3260]
Aug 09 16:50:15 user nova-compute[73091]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c, portal: 172.16.0.220,3260] successful.
Aug 09 16:50:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[807944fe-0c7e-42a1-a514-88b9096c0e70]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] <== disconnect_volume: return (313ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:50:15 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Deleting instance files /opt/stack/data/nova/instances/66ca58dc-1701-4a50-be5c-de255e1fbf96_del
Aug 09 16:50:15 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Deletion of /opt/stack/data/nova/instances/66ca58dc-1701-4a50-be5c-de255e1fbf96_del complete
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-8fc884a8-24bb-488a-baeb-ef2b1faf239d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-8fc884a8-24bb-488a-baeb-ef2b1faf239d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:50:15 user nova-compute[73091]: INFO nova.compute.manager [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 09 16:50:15 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:50:15 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:50:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-84ea2282-10f2-4035-8079-38cdc9d8b0ca req-39586e65-8f56-4c3b-8472-6db2902bbf30 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Received event network-vif-unplugged-064be756-0cdb-4755-a870-5d466c14e32e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:50:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-84ea2282-10f2-4035-8079-38cdc9d8b0ca req-39586e65-8f56-4c3b-8472-6db2902bbf30 service nova] Acquiring lock "66ca58dc-1701-4a50-be5c-de255e1fbf96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:50:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-84ea2282-10f2-4035-8079-38cdc9d8b0ca req-39586e65-8f56-4c3b-8472-6db2902bbf30 service nova] Lock "66ca58dc-1701-4a50-be5c-de255e1fbf96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:50:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-84ea2282-10f2-4035-8079-38cdc9d8b0ca req-39586e65-8f56-4c3b-8472-6db2902bbf30 service nova] Lock "66ca58dc-1701-4a50-be5c-de255e1fbf96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:50:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-84ea2282-10f2-4035-8079-38cdc9d8b0ca req-39586e65-8f56-4c3b-8472-6db2902bbf30 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] No waiting events found dispatching network-vif-unplugged-064be756-0cdb-4755-a870-5d466c14e32e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:50:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-84ea2282-10f2-4035-8079-38cdc9d8b0ca req-39586e65-8f56-4c3b-8472-6db2902bbf30 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Received event network-vif-unplugged-064be756-0cdb-4755-a870-5d466c14e32e for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:50:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-84ea2282-10f2-4035-8079-38cdc9d8b0ca req-39586e65-8f56-4c3b-8472-6db2902bbf30 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Received event network-vif-plugged-064be756-0cdb-4755-a870-5d466c14e32e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:50:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-84ea2282-10f2-4035-8079-38cdc9d8b0ca req-39586e65-8f56-4c3b-8472-6db2902bbf30 service nova] Acquiring lock "66ca58dc-1701-4a50-be5c-de255e1fbf96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:50:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-84ea2282-10f2-4035-8079-38cdc9d8b0ca req-39586e65-8f56-4c3b-8472-6db2902bbf30 service nova] Lock "66ca58dc-1701-4a50-be5c-de255e1fbf96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:50:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-84ea2282-10f2-4035-8079-38cdc9d8b0ca req-39586e65-8f56-4c3b-8472-6db2902bbf30 service nova] Lock "66ca58dc-1701-4a50-be5c-de255e1fbf96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:50:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-84ea2282-10f2-4035-8079-38cdc9d8b0ca req-39586e65-8f56-4c3b-8472-6db2902bbf30 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] No waiting events found dispatching network-vif-plugged-064be756-0cdb-4755-a870-5d466c14e32e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:50:16 user nova-compute[73091]: WARNING nova.compute.manager [req-84ea2282-10f2-4035-8079-38cdc9d8b0ca req-39586e65-8f56-4c3b-8472-6db2902bbf30 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Received unexpected event network-vif-plugged-064be756-0cdb-4755-a870-5d466c14e32e for instance with vm_state active and task_state deleting.
Aug 09 16:50:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Updating instance_info_cache with network_info: [{"id": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "address": "fa:16:3e:b3:de:fe", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ffdd03-c8", "ovs_interfaceid": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:50:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-8fc884a8-24bb-488a-baeb-ef2b1faf239d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:50:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:50:17 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:50:17 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Took 1.54 seconds to deallocate network for instance.
Aug 09 16:50:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-60041f87-69ea-41c1-8f65-2abad2fb4e94 req-c2548a32-6990-476f-95d2-025a3ed8b822 service nova] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Received event network-vif-deleted-064be756-0cdb-4755-a870-5d466c14e32e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:50:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:50:18 user nova-compute[73091]: INFO nova.compute.manager [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Took 0.75 seconds to detach 1 volumes for instance.
Aug 09 16:50:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:50:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:50:18 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:50:18 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:50:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:50:18 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Deleted allocations for instance 66ca58dc-1701-4a50-be5c-de255e1fbf96
Aug 09 16:50:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2fec39d5-2cee-4d32-bdd9-bad132aeadc7 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "66ca58dc-1701-4a50-be5c-de255e1fbf96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.977s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:50:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:50:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:50:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:50:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:50:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:50:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:50:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:50:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:50:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:50:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:50:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:25 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:50:25 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:50:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7043MB free_disk=24.960086822509766GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f939fe27-017a-481e-babc-147bf98e0132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8fc884a8-24bb-488a-baeb-ef2b1faf239d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance b9639ddc-0ff9-41d2-b647-3af5fce945c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c142dbba-1e7f-4381-91a5-876b55e11a64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 97af1277-b4bd-4a89-903b-4f70087f0535 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c3871ef4-45e7-4118-8227-e48cc857d481 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 12689fb0-5e5e-4421-8dd1-859bd5461963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 925f656c-f94a-4707-b1d9-b750cd83a010 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 0367cec8-7472-4e57-9ef9-d8cee9ad57c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:50:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:50:26 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:50:26 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:50:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:50:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:50:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:50:30 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599815.571982, 66ca58dc-1701-4a50-be5c-de255e1fbf96 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:50:30 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] VM Stopped (Lifecycle Event)
Aug 09 16:50:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3aef4053-2426-4a3f-a9fe-898c5c6864a7 None None] [instance: 66ca58dc-1701-4a50-be5c-de255e1fbf96] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:50:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:50:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:50:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 16:50:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:50:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:50:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:50:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-ce343b52-c935-4385-b5ce-0082a50787aa req-3cb696ec-f6f9-47e4-8b59-91cc165fb8d2 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Received event network-changed-639d4d2b-0348-4dc8-91f0-9b6907984a13 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:50:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-ce343b52-c935-4385-b5ce-0082a50787aa req-3cb696ec-f6f9-47e4-8b59-91cc165fb8d2 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Refreshing instance network info cache due to event network-changed-639d4d2b-0348-4dc8-91f0-9b6907984a13. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:50:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce343b52-c935-4385-b5ce-0082a50787aa req-3cb696ec-f6f9-47e4-8b59-91cc165fb8d2 service nova] Acquiring lock "refresh_cache-12689fb0-5e5e-4421-8dd1-859bd5461963" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:50:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce343b52-c935-4385-b5ce-0082a50787aa req-3cb696ec-f6f9-47e4-8b59-91cc165fb8d2 service nova] Acquired lock "refresh_cache-12689fb0-5e5e-4421-8dd1-859bd5461963" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:50:45 user nova-compute[73091]: DEBUG nova.network.neutron [req-ce343b52-c935-4385-b5ce-0082a50787aa req-3cb696ec-f6f9-47e4-8b59-91cc165fb8d2 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Refreshing network info cache for port 639d4d2b-0348-4dc8-91f0-9b6907984a13 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:50:45 user nova-compute[73091]: DEBUG nova.network.neutron [req-ce343b52-c935-4385-b5ce-0082a50787aa req-3cb696ec-f6f9-47e4-8b59-91cc165fb8d2 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Updated VIF entry in instance network info cache for port 639d4d2b-0348-4dc8-91f0-9b6907984a13. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:50:45 user nova-compute[73091]: DEBUG nova.network.neutron [req-ce343b52-c935-4385-b5ce-0082a50787aa req-3cb696ec-f6f9-47e4-8b59-91cc165fb8d2 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Updating instance_info_cache with network_info: [{"id": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "address": "fa:16:3e:74:bf:53", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap639d4d2b-03", "ovs_interfaceid": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:50:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce343b52-c935-4385-b5ce-0082a50787aa req-3cb696ec-f6f9-47e4-8b59-91cc165fb8d2 service nova] Releasing lock "refresh_cache-12689fb0-5e5e-4421-8dd1-859bd5461963" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:50:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:50:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 16:50:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:50:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:50:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "12689fb0-5e5e-4421-8dd1-859bd5461963" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:50:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:50:45 user nova-compute[73091]: DEBUG nova.objects.instance [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lazy-loading 'flavor' on Instance uuid 12689fb0-5e5e-4421-8dd1-859bd5461963 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:50:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "12689fb0-5e5e-4421-8dd1-859bd5461963" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:50:46 user nova-compute[73091]: INFO nova.compute.manager [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Attaching volume c8a945da-9319-4473-a4cc-af78793c2ea9 to /dev/vdb
Aug 09 16:50:46 user nova-compute[73091]: DEBUG os_brick.utils [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bc7278-188f-4898-998e-309052749aca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d3b532-ab8a-4b90-aad4-46dbcc15e31a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d10cfd-317f-40ca-89cc-4c623320442c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c62115-8deb-4a96-b3cc-e1b5267eec46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:50:46 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:50:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8033fd47-7c84-4558-9da3-b5f457fb3b9f]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG os_brick.utils [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:50:46 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Updating existing volume attachment record: 6d424473-1e40-4bd0-b790-e9d07637b138 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:50:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQCXLIlb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:50:54 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:50:54 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:50:54 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[96421b4e-29d1-4b04-8106-0aca489f135a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:50:54 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4ffcf2-7786-481e-9498-143cf7883423]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9] added
Aug 09 16:50:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[91902665-c0f8-4315-ad06-5a4b6ae5250e]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[92168140-c70e-4a64-b512-69b32121675d]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQCXLIlb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQCXLIlb" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb883ab7-10c7-4fb6-bb65-dec34a841836]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eQCXLIlb'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e287e6fa-ed48-4c58-8c8e-f93a4e2571d8]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[39619c6e-c7e6-44df-9201-9734782be239]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:50:54 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:50:54 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:50:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:50:54 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:50:54 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:50:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c0537b-c03e-4723-b663-2acd56f0e9d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9, portal: 172.16.0.220,3260]
Aug 09 16:50:54 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9, portal: 172.16.0.220,3260] successful.
Aug 09 16:50:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.107s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbf272a-c0c0-4146-8465-d1ee7e133525]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae1ba44-cb91-40b2-bd12-2e9fccbf4c4f]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:50:54 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:50:54 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:50:54 user nova-compute[73091]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 (non-flash)
Aug 09 16:50:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:50:54 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:50:54 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:50:54 user nova-compute[73091]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 (non-flash)
Aug 09 16:50:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[158694c2-362c-4133-b01f-c4323fe838ae]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:54 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:50:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:55 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:50:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQCXLIlb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:50:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:50:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26364373864636536', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:50:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364373864636536', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:50:55 user nova-compute[73091]: DEBUG nova.objects.instance [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lazy-loading 'flavor' on Instance uuid 12689fb0-5e5e-4421-8dd1-859bd5461963 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:50:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:50:55 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:50:55 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 09 16:50:55 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:50:55 user nova-compute[73091]:   <serial>c8a945da-9319-4473-a4cc-af78793c2ea9</serial>
Aug 09 16:50:55 user nova-compute[73091]: </disk>
Aug 09 16:50:55 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:50:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:50:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:50:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:50:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] No VIF found with MAC fa:16:3e:74:bf:53, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:50:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-140265e0-c134-4fe3-863d-8f079c935a06 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.240s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:50:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "12689fb0-5e5e-4421-8dd1-859bd5461963" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:50:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:50:57 user nova-compute[73091]: INFO nova.compute.manager [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Detaching volume c8a945da-9319-4473-a4cc-af78793c2ea9
Aug 09 16:50:58 user nova-compute[73091]: INFO nova.virt.block_device [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Attempting to driver detach volume c8a945da-9319-4473-a4cc-af78793c2ea9 from mountpoint /dev/vdb
Aug 09 16:50:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Attempting to detach device vdb from instance 12689fb0-5e5e-4421-8dd1-859bd5461963 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:50:58 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:50:58 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 09 16:50:58 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:50:58 user nova-compute[73091]:   <serial>c8a945da-9319-4473-a4cc-af78793c2ea9</serial>
Aug 09 16:50:58 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:50:58 user nova-compute[73091]: </disk>
Aug 09 16:50:58 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:50:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Successfully detached device vdb from instance 12689fb0-5e5e-4421-8dd1-859bd5461963 from the persistent domain config.
Aug 09 16:50:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 12689fb0-5e5e-4421-8dd1-859bd5461963 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:50:58 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:50:58 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 09 16:50:58 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:50:58 user nova-compute[73091]:   <serial>c8a945da-9319-4473-a4cc-af78793c2ea9</serial>
Aug 09 16:50:58 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:50:58 user nova-compute[73091]: </disk>
Aug 09 16:50:58 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-6e2aef6b-0b35-41ab-a04a-66637f62f5ef req-79ccb4df-1ce3-4811-a41d-780ac1cccdab service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Received event network-changed-1d105b3b-29db-489d-992c-fc3e9f58f914 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-6e2aef6b-0b35-41ab-a04a-66637f62f5ef req-79ccb4df-1ce3-4811-a41d-780ac1cccdab service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Refreshing instance network info cache due to event network-changed-1d105b3b-29db-489d-992c-fc3e9f58f914. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6e2aef6b-0b35-41ab-a04a-66637f62f5ef req-79ccb4df-1ce3-4811-a41d-780ac1cccdab service nova] Acquiring lock "refresh_cache-925f656c-f94a-4707-b1d9-b750cd83a010" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6e2aef6b-0b35-41ab-a04a-66637f62f5ef req-79ccb4df-1ce3-4811-a41d-780ac1cccdab service nova] Acquired lock "refresh_cache-925f656c-f94a-4707-b1d9-b750cd83a010" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG nova.network.neutron [req-6e2aef6b-0b35-41ab-a04a-66637f62f5ef req-79ccb4df-1ce3-4811-a41d-780ac1cccdab service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Refreshing network info cache for port 1d105b3b-29db-489d-992c-fc3e9f58f914 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691599858.4623191, 12689fb0-5e5e-4421-8dd1-859bd5461963 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 12689fb0-5e5e-4421-8dd1-859bd5461963 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:50:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Successfully detached device vdb from instance 12689fb0-5e5e-4421-8dd1-859bd5461963 from the live domain config.
Aug 09 16:50:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQCXLIlb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:50:58 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:50:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff0342f-7b7a-46a8-8e33-0ecf0f5151cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a67150b-d2d8-4067-94e3-08d89cf8a7d5]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:50:58 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:50:58 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:50:58 user nova-compute[73091]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 (non-flash)
Aug 09 16:50:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:50:58 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:50:58 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:50:58 user nova-compute[73091]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 (non-flash)
Aug 09 16:50:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff06039dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dabbb66-5bb2-4aa6-b3b2-7eee8e8fc3f5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54792b5-d943-46a1-80a6-0ef10419f40e]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[12364585-06f1-4eef-9207-f44d5336f9e2]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[66eaad63-9b4b-4f1e-bd0d-6d2876b0590f]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5c3b44-f366-4ccb-867a-bf02e61b82ad]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9231e028-b4e8-45d0-b6eb-292ee6193f72]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9, portal: 172.16.0.220,3260]
Aug 09 16:50:58 user nova-compute[73091]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9, portal: 172.16.0.220,3260] successful.
Aug 09 16:50:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8a945da-9319-4473-a4cc-af78793c2ea9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbde1beb-a7ea-4b68-b11e-47fe8e5b2093]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] <== disconnect_volume: return (272ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:50:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:50:59 user nova-compute[73091]: DEBUG nova.network.neutron [req-6e2aef6b-0b35-41ab-a04a-66637f62f5ef req-79ccb4df-1ce3-4811-a41d-780ac1cccdab service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Updated VIF entry in instance network info cache for port 1d105b3b-29db-489d-992c-fc3e9f58f914. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:50:59 user nova-compute[73091]: DEBUG nova.network.neutron [req-6e2aef6b-0b35-41ab-a04a-66637f62f5ef req-79ccb4df-1ce3-4811-a41d-780ac1cccdab service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Updating instance_info_cache with network_info: [{"id": "1d105b3b-29db-489d-992c-fc3e9f58f914", "address": "fa:16:3e:e3:2c:a3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d105b3b-29", "ovs_interfaceid": "1d105b3b-29db-489d-992c-fc3e9f58f914", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:50:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6e2aef6b-0b35-41ab-a04a-66637f62f5ef req-79ccb4df-1ce3-4811-a41d-780ac1cccdab service nova] Releasing lock "refresh_cache-925f656c-f94a-4707-b1d9-b750cd83a010" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:50:59 user nova-compute[73091]: DEBUG nova.objects.instance [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lazy-loading 'flavor' on Instance uuid 12689fb0-5e5e-4421-8dd1-859bd5461963 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:50:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-539ed5d6-4a84-41a9-b02d-dacc44dd3c28 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.612s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "925f656c-f94a-4707-b1d9-b750cd83a010" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "925f656c-f94a-4707-b1d9-b750cd83a010" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG nova.objects.instance [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'flavor' on Instance uuid 925f656c-f94a-4707-b1d9-b750cd83a010 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "925f656c-f94a-4707-b1d9-b750cd83a010" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "925f656c-f94a-4707-b1d9-b750cd83a010" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "925f656c-f94a-4707-b1d9-b750cd83a010" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:02 user nova-compute[73091]: INFO nova.compute.manager [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Attaching volume ce606706-509d-47e5-a06c-7b6e3f84cd08 to /dev/vdb
Aug 09 16:51:02 user nova-compute[73091]: DEBUG os_brick.utils [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b9193f-7ee3-4623-875c-366c281de8d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3968c3de-01cd-42ca-9eca-0463dd5fb950]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82c1709-a261-43d5-b9bb-8bb4c7dc9f2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[affbc1ce-03fb-4fa7-85c2-ffc412719d71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:51:02 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:51:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83923ec-3746-4a98-85fe-b09e24013f0f]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG os_brick.utils [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:51:02 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Updating existing volume attachment record: cc9e080a-e471-43cf-873a-1c4495195eff {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:51:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:06 user nova-compute[73091]: INFO nova.compute.manager [None req-26884317-35de-4ead-bb4c-f5a80b40a6e8 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Get console output
Aug 09 16:51:06 user nova-compute[73091]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 09 16:51:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:51:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:06 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:51:06 user nova-compute[73091]: INFO nova.compute.claims [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Claim successful on node user
Aug 09 16:51:07 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:51:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:51:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:51:07 user nova-compute[73091]: INFO nova.virt.block_device [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Booting with volume 6c363878-100f-4807-8700-e096df141b1c at /dev/vda
Aug 09 16:51:07 user nova-compute[73091]: DEBUG nova.policy [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69ccebf0e9d54502a2318c809ce11369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d3dfd232d54594808dad271baa5192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG os_brick.utils [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb25826-1274-4716-bf52-96693d4dae78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe69c914-4b74-4fed-b4f2-1b8245b8842c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d521de3f-28a3-46d5-b6be-45d3fd015266]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8930a026-d20d-400e-b6f4-72f09f300003]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:51:07 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:51:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eab0040-7d17-41db-b013-037af9dc9863]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG os_brick.utils [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:51:07 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Updating existing volume attachment record: 789fd969-4af6-47f2-a83d-0aa8e2477d51 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:51:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Successfully created port: b71c68c4-ac11-4419-8933-e51e7606370c {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:51:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Successfully updated port: b71c68c4-ac11-4419-8933-e51e7606370c {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:51:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "refresh_cache-bfb5340a-2329-4bd2-9f94-52ef24967a9b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:51:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquired lock "refresh_cache-bfb5340a-2329-4bd2-9f94-52ef24967a9b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:51:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:51:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-22873add-d329-4712-a5db-24d47919b922 req-1bbf7a2f-6c62-4e54-9445-edc88d070d9e service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Received event network-changed-b71c68c4-ac11-4419-8933-e51e7606370c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:51:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-22873add-d329-4712-a5db-24d47919b922 req-1bbf7a2f-6c62-4e54-9445-edc88d070d9e service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Refreshing instance network info cache due to event network-changed-b71c68c4-ac11-4419-8933-e51e7606370c. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:51:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-22873add-d329-4712-a5db-24d47919b922 req-1bbf7a2f-6c62-4e54-9445-edc88d070d9e service nova] Acquiring lock "refresh_cache-bfb5340a-2329-4bd2-9f94-52ef24967a9b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:51:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:51:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Updating instance_info_cache with network_info: [{"id": "b71c68c4-ac11-4419-8933-e51e7606370c", "address": "fa:16:3e:67:84:8e", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71c68c4-ac", "ovs_interfaceid": "b71c68c4-ac11-4419-8933-e51e7606370c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:51:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Releasing lock "refresh_cache-bfb5340a-2329-4bd2-9f94-52ef24967a9b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:51:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Instance network_info: |[{"id": "b71c68c4-ac11-4419-8933-e51e7606370c", "address": "fa:16:3e:67:84:8e", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71c68c4-ac", "ovs_interfaceid": "b71c68c4-ac11-4419-8933-e51e7606370c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:51:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-22873add-d329-4712-a5db-24d47919b922 req-1bbf7a2f-6c62-4e54-9445-edc88d070d9e service nova] Acquired lock "refresh_cache-bfb5340a-2329-4bd2-9f94-52ef24967a9b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:51:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-22873add-d329-4712-a5db-24d47919b922 req-1bbf7a2f-6c62-4e54-9445-edc88d070d9e service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Refreshing network info cache for port b71c68c4-ac11-4419-8933-e51e7606370c {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:51:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-22873add-d329-4712-a5db-24d47919b922 req-1bbf7a2f-6c62-4e54-9445-edc88d070d9e service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Updated VIF entry in instance network info cache for port b71c68c4-ac11-4419-8933-e51e7606370c. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:51:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-22873add-d329-4712-a5db-24d47919b922 req-1bbf7a2f-6c62-4e54-9445-edc88d070d9e service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Updating instance_info_cache with network_info: [{"id": "b71c68c4-ac11-4419-8933-e51e7606370c", "address": "fa:16:3e:67:84:8e", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71c68c4-ac", "ovs_interfaceid": "b71c68c4-ac11-4419-8933-e51e7606370c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:51:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-22873add-d329-4712-a5db-24d47919b922 req-1bbf7a2f-6c62-4e54-9445-edc88d070d9e service nova] Releasing lock "refresh_cache-bfb5340a-2329-4bd2-9f94-52ef24967a9b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:51:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:10 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWVJXUCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:51:11 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:51:11 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:51:11 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5f6305-c0ed-4f89-a070-9890b71e6e56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:51:11 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a2d28e-55e1-48c3-8c5d-c63a823e15e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08] added
Aug 09 16:51:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[93777cf2-495f-44a4-b231-e309aa4b82e3]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[974a4268-f2dd-466f-8f0e-a96a6a0e0ca4]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FWVJXUCu {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FWVJXUCu" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[631c821e-affc-4774-8e67-82ffa8550c0a]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FWVJXUCu'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f43bce-12c7-4440-9533-0fb4684a87fe]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f864346-95e4-417f-96eb-689d76c8d454]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:51:11 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:51:11 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:51:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:51:11 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:51:11 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:51:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3cd253-a863-4eb8-a93e-370597efa90f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08, portal: 172.16.0.220,3260]
Aug 09 16:51:11 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08, portal: 172.16.0.220,3260] successful.
Aug 09 16:51:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b8e65b-992c-4b42-8a6d-bae142a67403]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3765069b-da81-44b5-b6f9-fa4cd88e0a96]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:51:11 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:51:11 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:51:11 user nova-compute[73091]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 (non-flash)
Aug 09 16:51:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:51:11 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:51:11 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:51:11 user nova-compute[73091]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 (non-flash)
Aug 09 16:51:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fc8e03-dc50-4936-a084-f1ca76cf7f69]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWVJXUCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "76055017-05ff-4ea7-ae9c-66d2e502e090" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:11 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:51:11 user nova-compute[73091]: INFO nova.compute.claims [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Claim successful on node user
Aug 09 16:51:12 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:51:12 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:51:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:51:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:51:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:51:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:51:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:51:12 user nova-compute[73091]: INFO nova.virt.block_device [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Booting with blank volume at /dev/vda
Aug 09 16:51:12 user nova-compute[73091]: DEBUG nova.policy [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b831573c2594072890b548abda013e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39308f2160f14a1cb5ee136458054726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:51:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:51:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23131623433666338', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:51:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131623433666338', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:51:12 user nova-compute[73091]: DEBUG nova.objects.instance [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'flavor' on Instance uuid 925f656c-f94a-4707-b1d9-b750cd83a010 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:51:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:51:12 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:51:12 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 09 16:51:12 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:51:12 user nova-compute[73091]:   <serial>ce606706-509d-47e5-a06c-7b6e3f84cd08</serial>
Aug 09 16:51:12 user nova-compute[73091]: </disk>
Aug 09 16:51:12 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:51:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:51:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:51:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] No VIF found with MAC fa:16:3e:e3:2c:a3, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:51:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Successfully created port: 58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:51:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-468c4426-1c74-4e03-898b-889af64cd443 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "925f656c-f94a-4707-b1d9-b750cd83a010" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.786s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Successfully updated port: 58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:51:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:51:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquired lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:51:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:51:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-fccb6922-94c9-4134-b1bf-11380947af67 req-52a56681-3fde-44c2-ade8-ec4e57d73015 service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received event network-changed-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:51:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-fccb6922-94c9-4134-b1bf-11380947af67 req-52a56681-3fde-44c2-ade8-ec4e57d73015 service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Refreshing instance network info cache due to event network-changed-58bf6094-42a8-4567-abea-27c63a57cf8a. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:51:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fccb6922-94c9-4134-b1bf-11380947af67 req-52a56681-3fde-44c2-ade8-ec4e57d73015 service nova] Acquiring lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:51:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:51:14 user nova-compute[73091]: DEBUG nova.network.neutron [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Updating instance_info_cache with network_info: [{"id": "58bf6094-42a8-4567-abea-27c63a57cf8a", "address": "fa:16:3e:f3:dd:72", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf6094-42", "ovs_interfaceid": "58bf6094-42a8-4567-abea-27c63a57cf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:51:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Releasing lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:51:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Instance network_info: |[{"id": "58bf6094-42a8-4567-abea-27c63a57cf8a", "address": "fa:16:3e:f3:dd:72", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf6094-42", "ovs_interfaceid": "58bf6094-42a8-4567-abea-27c63a57cf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:51:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fccb6922-94c9-4134-b1bf-11380947af67 req-52a56681-3fde-44c2-ade8-ec4e57d73015 service nova] Acquired lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:51:14 user nova-compute[73091]: DEBUG nova.network.neutron [req-fccb6922-94c9-4134-b1bf-11380947af67 req-52a56681-3fde-44c2-ade8-ec4e57d73015 service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Refreshing network info cache for port 58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:51:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-42b48e9c-af08-4b1e-a988-ac4455c71735 req-343dbbd2-c10f-4bd2-b318-90b7e7e51680 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received event network-changed-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:51:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-42b48e9c-af08-4b1e-a988-ac4455c71735 req-343dbbd2-c10f-4bd2-b318-90b7e7e51680 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Refreshing instance network info cache due to event network-changed-84392ff0-9f13-41e4-adb9-c3a5db7677a5. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:51:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-42b48e9c-af08-4b1e-a988-ac4455c71735 req-343dbbd2-c10f-4bd2-b318-90b7e7e51680 service nova] Acquiring lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:51:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-42b48e9c-af08-4b1e-a988-ac4455c71735 req-343dbbd2-c10f-4bd2-b318-90b7e7e51680 service nova] Acquired lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:51:14 user nova-compute[73091]: DEBUG nova.network.neutron [req-42b48e9c-af08-4b1e-a988-ac4455c71735 req-343dbbd2-c10f-4bd2-b318-90b7e7e51680 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Refreshing network info cache for port 84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:51:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "925f656c-f94a-4707-b1d9-b750cd83a010" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "925f656c-f94a-4707-b1d9-b750cd83a010" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:14 user nova-compute[73091]: INFO nova.compute.manager [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Detaching volume ce606706-509d-47e5-a06c-7b6e3f84cd08
Aug 09 16:51:14 user nova-compute[73091]: DEBUG nova.network.neutron [req-fccb6922-94c9-4134-b1bf-11380947af67 req-52a56681-3fde-44c2-ade8-ec4e57d73015 service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Updated VIF entry in instance network info cache for port 58bf6094-42a8-4567-abea-27c63a57cf8a. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:51:14 user nova-compute[73091]: DEBUG nova.network.neutron [req-fccb6922-94c9-4134-b1bf-11380947af67 req-52a56681-3fde-44c2-ade8-ec4e57d73015 service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Updating instance_info_cache with network_info: [{"id": "58bf6094-42a8-4567-abea-27c63a57cf8a", "address": "fa:16:3e:f3:dd:72", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf6094-42", "ovs_interfaceid": "58bf6094-42a8-4567-abea-27c63a57cf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:51:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fccb6922-94c9-4134-b1bf-11380947af67 req-52a56681-3fde-44c2-ade8-ec4e57d73015 service nova] Releasing lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:51:14 user nova-compute[73091]: INFO nova.virt.block_device [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Attempting to driver detach volume ce606706-509d-47e5-a06c-7b6e3f84cd08 from mountpoint /dev/vdb
Aug 09 16:51:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Attempting to detach device vdb from instance 925f656c-f94a-4707-b1d9-b750cd83a010 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:51:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:51:14 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:51:14 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 09 16:51:14 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:51:14 user nova-compute[73091]:   <serial>ce606706-509d-47e5-a06c-7b6e3f84cd08</serial>
Aug 09 16:51:14 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:51:14 user nova-compute[73091]: </disk>
Aug 09 16:51:14 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:51:14 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:51:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Successfully detached device vdb from instance 925f656c-f94a-4707-b1d9-b750cd83a010 from the persistent domain config.
Aug 09 16:51:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 925f656c-f94a-4707-b1d9-b750cd83a010 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:51:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:51:14 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:51:14 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 09 16:51:14 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:51:14 user nova-compute[73091]:   <serial>ce606706-509d-47e5-a06c-7b6e3f84cd08</serial>
Aug 09 16:51:14 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:51:14 user nova-compute[73091]: </disk>
Aug 09 16:51:14 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG nova.network.neutron [req-42b48e9c-af08-4b1e-a988-ac4455c71735 req-343dbbd2-c10f-4bd2-b318-90b7e7e51680 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Updated VIF entry in instance network info cache for port 84392ff0-9f13-41e4-adb9-c3a5db7677a5. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG nova.network.neutron [req-42b48e9c-af08-4b1e-a988-ac4455c71735 req-343dbbd2-c10f-4bd2-b318-90b7e7e51680 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Updating instance_info_cache with network_info: [{"id": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "address": "fa:16:3e:af:49:2e", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84392ff0-9f", "ovs_interfaceid": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-42b48e9c-af08-4b1e-a988-ac4455c71735 req-343dbbd2-c10f-4bd2-b318-90b7e7e51680 service nova] Releasing lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691599875.4583209, 925f656c-f94a-4707-b1d9-b750cd83a010 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 925f656c-f94a-4707-b1d9-b750cd83a010 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:51:15 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Successfully detached device vdb from instance 925f656c-f94a-4707-b1d9-b750cd83a010 from the live domain config.
Aug 09 16:51:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWVJXUCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:51:15 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:51:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[65265979-9bcf-42f6-902f-336229b234e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa5031b-4302-437b-8e77-8a57f27d8462]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:51:15 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:51:15 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:51:15 user nova-compute[73091]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 (non-flash)
Aug 09 16:51:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:51:15 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:51:15 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:51:15 user nova-compute[73091]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 (non-flash)
Aug 09 16:51:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff06039c3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[047784ec-390b-481c-bc79-712d115cd765]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac4df49-47b7-48ee-bba2-9a6fb01a9513]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb43fefd-7bbe-4e9b-8c2f-bd16ce21c912]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb75a52a-4cc8-46b5-a81a-e67ad4973e8a]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[db28d27b-4ea0-469d-b516-3439ec775b9c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-39f83861-c412-48fa-b9ca-066465a894e1 req-16acf371-ef39-40a1-9040-4c94891d2f34 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received event network-changed-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-39f83861-c412-48fa-b9ca-066465a894e1 req-16acf371-ef39-40a1-9040-4c94891d2f34 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Refreshing instance network info cache due to event network-changed-84392ff0-9f13-41e4-adb9-c3a5db7677a5. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-39f83861-c412-48fa-b9ca-066465a894e1 req-16acf371-ef39-40a1-9040-4c94891d2f34 service nova] Acquiring lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-39f83861-c412-48fa-b9ca-066465a894e1 req-16acf371-ef39-40a1-9040-4c94891d2f34 service nova] Acquired lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG nova.network.neutron [req-39f83861-c412-48fa-b9ca-066465a894e1 req-16acf371-ef39-40a1-9040-4c94891d2f34 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Refreshing network info cache for port 84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc99e0b3-f529-4288-877e-c56e953e860f]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08, portal: 172.16.0.220,3260]
Aug 09 16:51:15 user nova-compute[73091]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08, portal: 172.16.0.220,3260] successful.
Aug 09 16:51:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce606706-509d-47e5-a06c-7b6e3f84cd08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfadd530-994f-4abd-9bd7-75015f8392b4]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] <== disconnect_volume: return (330ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "c142dbba-1e7f-4381-91a5-876b55e11a64" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:51:15 user nova-compute[73091]: INFO nova.compute.manager [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Detaching volume ee4430ff-491a-4834-abb8-e57f3f4f2a9a
Aug 09 16:51:15 user nova-compute[73091]: INFO nova.virt.block_device [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Attempting to driver detach volume ee4430ff-491a-4834-abb8-e57f3f4f2a9a from mountpoint /dev/vdb
Aug 09 16:51:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Attempting to detach device vdb from instance c142dbba-1e7f-4381-91a5-876b55e11a64 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:51:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:51:15 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:51:15 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 09 16:51:15 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:51:15 user nova-compute[73091]:   <serial>ee4430ff-491a-4834-abb8-e57f3f4f2a9a</serial>
Aug 09 16:51:15 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:51:15 user nova-compute[73091]: </disk>
Aug 09 16:51:15 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:51:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Successfully detached device vdb from instance c142dbba-1e7f-4381-91a5-876b55e11a64 from the persistent domain config.
Aug 09 16:51:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c142dbba-1e7f-4381-91a5-876b55e11a64 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:51:16 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:51:16 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 09 16:51:16 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:51:16 user nova-compute[73091]:   <serial>ee4430ff-491a-4834-abb8-e57f3f4f2a9a</serial>
Aug 09 16:51:16 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:51:16 user nova-compute[73091]: </disk>
Aug 09 16:51:16 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-39f83861-c412-48fa-b9ca-066465a894e1 req-16acf371-ef39-40a1-9040-4c94891d2f34 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Updated VIF entry in instance network info cache for port 84392ff0-9f13-41e4-adb9-c3a5db7677a5. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-39f83861-c412-48fa-b9ca-066465a894e1 req-16acf371-ef39-40a1-9040-4c94891d2f34 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Updating instance_info_cache with network_info: [{"id": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "address": "fa:16:3e:af:49:2e", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84392ff0-9f", "ovs_interfaceid": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-39f83861-c412-48fa-b9ca-066465a894e1 req-16acf371-ef39-40a1-9040-4c94891d2f34 service nova] Releasing lock "refresh_cache-c142dbba-1e7f-4381-91a5-876b55e11a64" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691599876.4620252, c142dbba-1e7f-4381-91a5-876b55e11a64 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c142dbba-1e7f-4381-91a5-876b55e11a64 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:51:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Successfully detached device vdb from instance c142dbba-1e7f-4381-91a5-876b55e11a64 from the live domain config.
Aug 09 16:51:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rmdafnPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:51:16 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:51:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[23457e33-f21d-4b46-97de-9de390f0f01b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ba92d6-32b6-427d-a2f3-1e43aa72e69c]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:51:16 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:51:16 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:51:16 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:51:16 user nova-compute[73091]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a (non-flash)
Aug 09 16:51:16 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:51:16 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff080419fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a'): ({'sdd'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Removing single pathed devices sdd {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a409390-304c-48c2-8c49-94b5e8272def]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa429de-8d68-44d9-8f6a-a4bd56f231c3]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Flushing IO for device /dev/sdd {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3f9334-7ffe-4189-958e-2362d6838601]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3cb68f-b1ab-455f-9878-8679d111881f]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b63df5-d94f-48cd-91bb-219bb0155ca0]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c057d13e-ac33-4c94-9145-ef97098431d2]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a, portal: 172.16.0.220,3260]
Aug 09 16:51:16 user nova-compute[73091]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a, portal: 172.16.0.220,3260] successful.
Aug 09 16:51:16 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4430ff-491a-4834-abb8-e57f3f4f2a9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5abc32-24f3-49a7-8e2b-70d60da46538]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] <== disconnect_volume: return (300ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:51:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:51:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Updating instance_info_cache with network_info: [{"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:51:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-97af1277-b4bd-4a89-903b-4f70087f0535" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:51:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:51:17 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lazy-loading 'flavor' on Instance uuid c142dbba-1e7f-4381-91a5-876b55e11a64 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:51:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a818d54-b516-463b-a211-9da77253f8cd tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.770s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:17 user nova-compute[73091]: DEBUG os_brick.utils [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:51:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7908a261-e116-4c7a-8972-061d743d36d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[15decf54-a298-4870-bd80-79c3049a7ea6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9294baed-acb8-4d0f-be55-b6d5ab2785df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb53ce5-cb73-414f-a0be-25271a7102f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:51:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:51:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:51:18 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:51:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eff36bf-98b3-4653-95c9-fdc280dcf094]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:51:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:51:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:51:18 user nova-compute[73091]: DEBUG os_brick.utils [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:51:18 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Updating existing volume attachment record: b91ff362-4edf-4d57-9214-9d5633127543 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:51:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:51:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:51:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:51:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Creating image(s)
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Ensure instance console log exists: /opt/stack/data/nova/instances/bfb5340a-2329-4bd2-9f94-52ef24967a9b/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Start _get_guest_xml network_info=[{"id": "b71c68c4-ac11-4419-8933-e51e7606370c", "address": "fa:16:3e:67:84:8e", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71c68c4-ac", "ovs_interfaceid": "b71c68c4-ac11-4419-8933-e51e7606370c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '789fd969-4af6-47f2-a83d-0aa8e2477d51', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XypTsJzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bfb5340a-2329-4bd2-9f94-52ef24967a9b', 'attached_at': '', 'detached_at': '', 'volume_id': '6c363878-100f-4807-8700-e096df141b1c', 'serial': '6c363878-100f-4807-8700-e096df141b1c'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:51:20 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:51:20 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XypTsJzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:51:20 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:51:20 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:51:20 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a06c630-d45f-4908-84ea-e44236895431]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:51:20 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'flavor' on Instance uuid 925f656c-f94a-4707-b1d9-b750cd83a010 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf18ce6-881e-4ccf-a9c0-5e3493784af8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c] added
Aug 09 16:51:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2879c4-d1f1-42ab-96ff-632c79d40308]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-464cbedd-913f-409a-8116-ed35364261e5 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "925f656c-f94a-4707-b1d9-b750cd83a010" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.627s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a455e2-0be3-4c65-b588-572551627f6a]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XypTsJzG {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XypTsJzG" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c1a07a-6740-4569-86d9-356cbf88e008]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XypTsJzG'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e80829-31dc-490e-af6e-ab6422b61422]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa458f5-b3ca-4daa-8634-97a4728c9f53]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:51:20 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:51:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:51:20 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:51:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[63be0b0b-5473-45e6-8558-32c812006a1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c, portal: 172.16.0.220,3260]
Aug 09 16:51:20 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c, portal: 172.16.0.220,3260] successful.
Aug 09 16:51:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40e2f74-2946-4573-82b6-8a0fc440df55]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[093bb287-f874-4250-86d7-9141802cb06b]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:51:20 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:51:20 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:51:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:51:20 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:51:20 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:51:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[52238e0b-14b5-4309-a8fe-21904473e052]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XypTsJzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:51:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23362383137393366', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362383137393366', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:51:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1750284173',display_name='tempest-TestVolumeBootPattern-server-1750284173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1750284173',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSSzWQUVuDlac0eUgyT2z4iM1Y0qg2BfVrMrtynGR00pxQ570GYD8As3UZF1alKpRXt3lDEuXxBRenfT0VFniILv2ftKfjpM7Z1J3bJewWzw1Fr2JnxHpTfKfQmiSEWpw==',key_name='tempest-TestVolumeBootPattern-2063534983',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d3dfd232d54594808dad271baa5192',ramdisk_id='',reservation_id='r-u9d387s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1605875873',owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:51:07Z,user_data=None,user_id='69ccebf0e9d54502a2318c809ce11369',uuid=bfb5340a-2329-4bd2-9f94-52ef24967a9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b71c68c4-ac11-4419-8933-e51e7606370c", "address": "fa:16:3e:67:84:8e", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71c68c4-ac", "ovs_interfaceid": "b71c68c4-ac11-4419-8933-e51e7606370c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converting VIF {"id": "b71c68c4-ac11-4419-8933-e51e7606370c", "address": "fa:16:3e:67:84:8e", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71c68c4-ac", "ovs_interfaceid": "b71c68c4-ac11-4419-8933-e51e7606370c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:84:8e,bridge_name='br-int',has_traffic_filtering=True,id=b71c68c4-ac11-4419-8933-e51e7606370c,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71c68c4-ac') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lazy-loading 'pci_devices' on Instance uuid bfb5340a-2329-4bd2-9f94-52ef24967a9b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:51:21 user nova-compute[73091]:   <uuid>bfb5340a-2329-4bd2-9f94-52ef24967a9b</uuid>
Aug 09 16:51:21 user nova-compute[73091]:   <name>instance-00000027</name>
Aug 09 16:51:21 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:51:21 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:51:21 user nova-compute[73091]:   <metadata>
Aug 09 16:51:21 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:51:21 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:51:21 user nova-compute[73091]:       <nova:name>tempest-TestVolumeBootPattern-server-1750284173</nova:name>
Aug 09 16:51:21 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:51:20</nova:creationTime>
Aug 09 16:51:21 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:51:21 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:51:21 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:51:21 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:51:21 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:51:21 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:51:21 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:51:21 user nova-compute[73091]:       <nova:owner>
Aug 09 16:51:21 user nova-compute[73091]:         <nova:user uuid="69ccebf0e9d54502a2318c809ce11369">tempest-TestVolumeBootPattern-1605875873-project-member</nova:user>
Aug 09 16:51:21 user nova-compute[73091]:         <nova:project uuid="64d3dfd232d54594808dad271baa5192">tempest-TestVolumeBootPattern-1605875873</nova:project>
Aug 09 16:51:21 user nova-compute[73091]:       </nova:owner>
Aug 09 16:51:21 user nova-compute[73091]:       <nova:ports>
Aug 09 16:51:21 user nova-compute[73091]:         <nova:port uuid="b71c68c4-ac11-4419-8933-e51e7606370c">
Aug 09 16:51:21 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 16:51:21 user nova-compute[73091]:         </nova:port>
Aug 09 16:51:21 user nova-compute[73091]:       </nova:ports>
Aug 09 16:51:21 user nova-compute[73091]:     </nova:instance>
Aug 09 16:51:21 user nova-compute[73091]:   </metadata>
Aug 09 16:51:21 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:51:21 user nova-compute[73091]:     <system>
Aug 09 16:51:21 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:51:21 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:51:21 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:51:21 user nova-compute[73091]:       <entry name="serial">bfb5340a-2329-4bd2-9f94-52ef24967a9b</entry>
Aug 09 16:51:21 user nova-compute[73091]:       <entry name="uuid">bfb5340a-2329-4bd2-9f94-52ef24967a9b</entry>
Aug 09 16:51:21 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:51:21 user nova-compute[73091]:     </system>
Aug 09 16:51:21 user nova-compute[73091]:   </sysinfo>
Aug 09 16:51:21 user nova-compute[73091]:   <os>
Aug 09 16:51:21 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:51:21 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:51:21 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:51:21 user nova-compute[73091]:   </os>
Aug 09 16:51:21 user nova-compute[73091]:   <features>
Aug 09 16:51:21 user nova-compute[73091]:     <acpi/>
Aug 09 16:51:21 user nova-compute[73091]:     <apic/>
Aug 09 16:51:21 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:51:21 user nova-compute[73091]:   </features>
Aug 09 16:51:21 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:51:21 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:51:21 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:51:21 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:51:21 user nova-compute[73091]:   </clock>
Aug 09 16:51:21 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:51:21 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:51:21 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:51:21 user nova-compute[73091]:   </cpu>
Aug 09 16:51:21 user nova-compute[73091]:   <devices>
Aug 09 16:51:21 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:51:21 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:51:21 user nova-compute[73091]:       <source dev="/dev/sdc"/>
Aug 09 16:51:21 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:51:21 user nova-compute[73091]:       <serial>6c363878-100f-4807-8700-e096df141b1c</serial>
Aug 09 16:51:21 user nova-compute[73091]:     </disk>
Aug 09 16:51:21 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:51:21 user nova-compute[73091]:       <mac address="fa:16:3e:67:84:8e"/>
Aug 09 16:51:21 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:51:21 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:51:21 user nova-compute[73091]:       <target dev="tapb71c68c4-ac"/>
Aug 09 16:51:21 user nova-compute[73091]:     </interface>
Aug 09 16:51:21 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:51:21 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/bfb5340a-2329-4bd2-9f94-52ef24967a9b/console.log" append="off"/>
Aug 09 16:51:21 user nova-compute[73091]:     </serial>
Aug 09 16:51:21 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:51:21 user nova-compute[73091]:     <video>
Aug 09 16:51:21 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:51:21 user nova-compute[73091]:     </video>
Aug 09 16:51:21 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:51:21 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:51:21 user nova-compute[73091]:     </rng>
Aug 09 16:51:21 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:51:21 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:51:21 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:51:21 user nova-compute[73091]:     </memballoon>
Aug 09 16:51:21 user nova-compute[73091]:   </devices>
Aug 09 16:51:21 user nova-compute[73091]: </domain>
Aug 09 16:51:21 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:51:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1750284173',display_name='tempest-TestVolumeBootPattern-server-1750284173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1750284173',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSSzWQUVuDlac0eUgyT2z4iM1Y0qg2BfVrMrtynGR00pxQ570GYD8As3UZF1alKpRXt3lDEuXxBRenfT0VFniILv2ftKfjpM7Z1J3bJewWzw1Fr2JnxHpTfKfQmiSEWpw==',key_name='tempest-TestVolumeBootPattern-2063534983',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d3dfd232d54594808dad271baa5192',ramdisk_id='',reservation_id='r-u9d387s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1605875873',owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:51:07Z,user_data=None,user_id='69ccebf0e9d54502a2318c809ce11369',uuid=bfb5340a-2329-4bd2-9f94-52ef24967a9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b71c68c4-ac11-4419-8933-e51e7606370c", "address": "fa:16:3e:67:84:8e", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71c68c4-ac", "ovs_interfaceid": "b71c68c4-ac11-4419-8933-e51e7606370c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converting VIF {"id": "b71c68c4-ac11-4419-8933-e51e7606370c", "address": "fa:16:3e:67:84:8e", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71c68c4-ac", "ovs_interfaceid": "b71c68c4-ac11-4419-8933-e51e7606370c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:84:8e,bridge_name='br-int',has_traffic_filtering=True,id=b71c68c4-ac11-4419-8933-e51e7606370c,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71c68c4-ac') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG os_vif [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:84:8e,bridge_name='br-int',has_traffic_filtering=True,id=b71c68c4-ac11-4419-8933-e51e7606370c,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71c68c4-ac') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb71c68c4-ac, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb71c68c4-ac, col_values=(('external_ids', {'iface-id': 'b71c68c4-ac11-4419-8933-e51e7606370c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:84:8e', 'vm-uuid': 'bfb5340a-2329-4bd2-9f94-52ef24967a9b'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:21 user nova-compute[73091]: INFO os_vif [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:84:8e,bridge_name='br-int',has_traffic_filtering=True,id=b71c68c4-ac11-4419-8933-e51e7606370c,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71c68c4-ac')
Aug 09 16:51:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] No VIF found with MAC fa:16:3e:67:84:8e, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:21 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:51:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-e0b819be-6c21-4b14-801d-34c0c0ab91d3 req-b2fa8d96-0fd2-4fff-9e0f-d604ede45eae service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Received event network-vif-plugged-b71c68c4-ac11-4419-8933-e51e7606370c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:51:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e0b819be-6c21-4b14-801d-34c0c0ab91d3 req-b2fa8d96-0fd2-4fff-9e0f-d604ede45eae service nova] Acquiring lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e0b819be-6c21-4b14-801d-34c0c0ab91d3 req-b2fa8d96-0fd2-4fff-9e0f-d604ede45eae service nova] Lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e0b819be-6c21-4b14-801d-34c0c0ab91d3 req-b2fa8d96-0fd2-4fff-9e0f-d604ede45eae service nova] Lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:23 user nova-compute[73091]: DEBUG nova.compute.manager [req-e0b819be-6c21-4b14-801d-34c0c0ab91d3 req-b2fa8d96-0fd2-4fff-9e0f-d604ede45eae service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] No waiting events found dispatching network-vif-plugged-b71c68c4-ac11-4419-8933-e51e7606370c {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:51:23 user nova-compute[73091]: WARNING nova.compute.manager [req-e0b819be-6c21-4b14-801d-34c0c0ab91d3 req-b2fa8d96-0fd2-4fff-9e0f-d604ede45eae service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Received unexpected event network-vif-plugged-b71c68c4-ac11-4419-8933-e51e7606370c for instance with vm_state building and task_state spawning.
Aug 09 16:51:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:51:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599885.0617805, bfb5340a-2329-4bd2-9f94-52ef24967a9b => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:51:25 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] VM Resumed (Lifecycle Event)
Aug 09 16:51:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:51:25 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Instance spawned successfully.
Aug 09 16:51:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:51:25 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:51:25 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599885.0649943, bfb5340a-2329-4bd2-9f94-52ef24967a9b => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:51:25 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] VM Started (Lifecycle Event)
Aug 09 16:51:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:25 user nova-compute[73091]: INFO nova.compute.manager [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Took 5.03 seconds to spawn the instance on the hypervisor.
Aug 09 16:51:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:51:25 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:51:25 user nova-compute[73091]: INFO nova.compute.manager [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Took 18.51 seconds to build instance.
Aug 09 16:51:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02fb5b91-197d-4cb9-9f3b-ab7589e6363f tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.613s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-67685fc0-ccb0-4773-9060-8c5d2be60ca3 req-d64fe744-572f-49db-8edd-1314daebef58 service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Received event network-vif-plugged-b71c68c4-ac11-4419-8933-e51e7606370c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-67685fc0-ccb0-4773-9060-8c5d2be60ca3 req-d64fe744-572f-49db-8edd-1314daebef58 service nova] Acquiring lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-67685fc0-ccb0-4773-9060-8c5d2be60ca3 req-d64fe744-572f-49db-8edd-1314daebef58 service nova] Lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-67685fc0-ccb0-4773-9060-8c5d2be60ca3 req-d64fe744-572f-49db-8edd-1314daebef58 service nova] Lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-67685fc0-ccb0-4773-9060-8c5d2be60ca3 req-d64fe744-572f-49db-8edd-1314daebef58 service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] No waiting events found dispatching network-vif-plugged-b71c68c4-ac11-4419-8933-e51e7606370c {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:51:25 user nova-compute[73091]: WARNING nova.compute.manager [req-67685fc0-ccb0-4773-9060-8c5d2be60ca3 req-d64fe744-572f-49db-8edd-1314daebef58 service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Received unexpected event network-vif-plugged-b71c68c4-ac11-4419-8933-e51e7606370c for instance with vm_state active and task_state None.
Aug 09 16:51:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:51:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:51:27 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Creating image(s)
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Ensure instance console log exists: /opt/stack/data/nova/instances/76055017-05ff-4ea7-ae9c-66d2e502e090/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Start _get_guest_xml network_info=[{"id": "58bf6094-42a8-4567-abea-27c63a57cf8a", "address": "fa:16:3e:f3:dd:72", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf6094-42", "ovs_interfaceid": "58bf6094-42a8-4567-abea-27c63a57cf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'b91ff362-4edf-4d57-9214-9d5633127543', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQivsqeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '76055017-05ff-4ea7-ae9c-66d2e502e090', 'attached_at': '', 'detached_at': '', 'volume_id': '06296a53-7a38-4d42-836c-f02cf17391b5', 'serial': '06296a53-7a38-4d42-836c-f02cf17391b5'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:51:27 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:51:27 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7199MB free_disk=24.93389129638672GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:27 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:51:27 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQivsqeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:51:27 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:51:27 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:51:27 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdab575-0b66-47e1-baab-27df6044585d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:51:27 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee1c58a-c0c2-4af0-bec5-52969671a3cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5] added
Aug 09 16:51:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c8cbf0-82c7-430c-8dd1-7d55536e84f3]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f939fe27-017a-481e-babc-147bf98e0132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8fc884a8-24bb-488a-baeb-ef2b1faf239d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance b9639ddc-0ff9-41d2-b647-3af5fce945c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c142dbba-1e7f-4381-91a5-876b55e11a64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 97af1277-b4bd-4a89-903b-4f70087f0535 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c3871ef4-45e7-4118-8227-e48cc857d481 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 12689fb0-5e5e-4421-8dd1-859bd5461963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 925f656c-f94a-4707-b1d9-b750cd83a010 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 0367cec8-7472-4e57-9ef9-d8cee9ad57c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance bfb5340a-2329-4bd2-9f94-52ef24967a9b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 76055017-05ff-4ea7-ae9c-66d2e502e090 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff02b85f-392e-4c12-a986-545d81db2485]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EQivsqeH {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EQivsqeH" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65eb2cf-272d-4d0e-a437-79e06f47c4d8]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EQivsqeH'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c738aac-058d-47fd-9c66-7295816088fe]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c27bda-160a-4efe-8f01-2af1b70e6aac]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:51:27 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:51:27 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:51:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:51:27 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:51:27 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:51:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[af00a178-832b-4b2a-ae9f-3a487a406ba6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5, portal: 172.16.0.220,3260]
Aug 09 16:51:27 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5, portal: 172.16.0.220,3260] successful.
Aug 09 16:51:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fba003-db89-416e-a134-1fb223237acb]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1659bac-1774-494f-a78b-7e2239b889f6]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:51:27 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:51:27 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:51:27 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:51:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:51:27 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:51:27 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:51:27 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:51:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca8100e-9df7-416e-8da7-6afd2e56ca74]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:51:27 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.632s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQivsqeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23437366337323766', 'path': '/dev/sdd'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437366337323766', 'path': '/dev/sdd'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-778120530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-778120530',id=40,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39308f2160f14a1cb5ee136458054726',ramdisk_id='',reservation_id='r-i2p91t84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:51:12Z,user_data=None,user_id='1b831573c2594072890b548abda013e3',uuid=76055017-05ff-4ea7-ae9c-66d2e502e090,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58bf6094-42a8-4567-abea-27c63a57cf8a", "address": "fa:16:3e:f3:dd:72", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf6094-42", "ovs_interfaceid": "58bf6094-42a8-4567-abea-27c63a57cf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converting VIF {"id": "58bf6094-42a8-4567-abea-27c63a57cf8a", "address": "fa:16:3e:f3:dd:72", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf6094-42", "ovs_interfaceid": "58bf6094-42a8-4567-abea-27c63a57cf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:dd:72,bridge_name='br-int',has_traffic_filtering=True,id=58bf6094-42a8-4567-abea-27c63a57cf8a,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58bf6094-42') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG nova.objects.instance [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'pci_devices' on Instance uuid 76055017-05ff-4ea7-ae9c-66d2e502e090 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:51:28 user nova-compute[73091]:   <uuid>76055017-05ff-4ea7-ae9c-66d2e502e090</uuid>
Aug 09 16:51:28 user nova-compute[73091]:   <name>instance-00000028</name>
Aug 09 16:51:28 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:51:28 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:51:28 user nova-compute[73091]:   <metadata>
Aug 09 16:51:28 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:51:28 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:51:28 user nova-compute[73091]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-778120530</nova:name>
Aug 09 16:51:28 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:51:27</nova:creationTime>
Aug 09 16:51:28 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:51:28 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:51:28 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:51:28 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:51:28 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:51:28 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:51:28 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:51:28 user nova-compute[73091]:       <nova:owner>
Aug 09 16:51:28 user nova-compute[73091]:         <nova:user uuid="1b831573c2594072890b548abda013e3">tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member</nova:user>
Aug 09 16:51:28 user nova-compute[73091]:         <nova:project uuid="39308f2160f14a1cb5ee136458054726">tempest-ServerBootFromVolumeStableRescueTest-1999746022</nova:project>
Aug 09 16:51:28 user nova-compute[73091]:       </nova:owner>
Aug 09 16:51:28 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:51:28 user nova-compute[73091]:       <nova:ports>
Aug 09 16:51:28 user nova-compute[73091]:         <nova:port uuid="58bf6094-42a8-4567-abea-27c63a57cf8a">
Aug 09 16:51:28 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 16:51:28 user nova-compute[73091]:         </nova:port>
Aug 09 16:51:28 user nova-compute[73091]:       </nova:ports>
Aug 09 16:51:28 user nova-compute[73091]:     </nova:instance>
Aug 09 16:51:28 user nova-compute[73091]:   </metadata>
Aug 09 16:51:28 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:51:28 user nova-compute[73091]:     <system>
Aug 09 16:51:28 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:51:28 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:51:28 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:51:28 user nova-compute[73091]:       <entry name="serial">76055017-05ff-4ea7-ae9c-66d2e502e090</entry>
Aug 09 16:51:28 user nova-compute[73091]:       <entry name="uuid">76055017-05ff-4ea7-ae9c-66d2e502e090</entry>
Aug 09 16:51:28 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:51:28 user nova-compute[73091]:     </system>
Aug 09 16:51:28 user nova-compute[73091]:   </sysinfo>
Aug 09 16:51:28 user nova-compute[73091]:   <os>
Aug 09 16:51:28 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:51:28 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:51:28 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:51:28 user nova-compute[73091]:   </os>
Aug 09 16:51:28 user nova-compute[73091]:   <features>
Aug 09 16:51:28 user nova-compute[73091]:     <acpi/>
Aug 09 16:51:28 user nova-compute[73091]:     <apic/>
Aug 09 16:51:28 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:51:28 user nova-compute[73091]:   </features>
Aug 09 16:51:28 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:51:28 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:51:28 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:51:28 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:51:28 user nova-compute[73091]:   </clock>
Aug 09 16:51:28 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:51:28 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:51:28 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:51:28 user nova-compute[73091]:   </cpu>
Aug 09 16:51:28 user nova-compute[73091]:   <devices>
Aug 09 16:51:28 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:51:28 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:51:28 user nova-compute[73091]:       <source dev="/dev/sdd"/>
Aug 09 16:51:28 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:51:28 user nova-compute[73091]:       <serial>06296a53-7a38-4d42-836c-f02cf17391b5</serial>
Aug 09 16:51:28 user nova-compute[73091]:     </disk>
Aug 09 16:51:28 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:51:28 user nova-compute[73091]:       <mac address="fa:16:3e:f3:dd:72"/>
Aug 09 16:51:28 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:51:28 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:51:28 user nova-compute[73091]:       <target dev="tap58bf6094-42"/>
Aug 09 16:51:28 user nova-compute[73091]:     </interface>
Aug 09 16:51:28 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:51:28 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/76055017-05ff-4ea7-ae9c-66d2e502e090/console.log" append="off"/>
Aug 09 16:51:28 user nova-compute[73091]:     </serial>
Aug 09 16:51:28 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:51:28 user nova-compute[73091]:     <video>
Aug 09 16:51:28 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:51:28 user nova-compute[73091]:     </video>
Aug 09 16:51:28 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:51:28 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:51:28 user nova-compute[73091]:     </rng>
Aug 09 16:51:28 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:51:28 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:51:28 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:51:28 user nova-compute[73091]:     </memballoon>
Aug 09 16:51:28 user nova-compute[73091]:   </devices>
Aug 09 16:51:28 user nova-compute[73091]: </domain>
Aug 09 16:51:28 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-778120530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-778120530',id=40,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39308f2160f14a1cb5ee136458054726',ramdisk_id='',reservation_id='r-i2p91t84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:51:12Z,user_data=None,user_id='1b831573c2594072890b548abda013e3',uuid=76055017-05ff-4ea7-ae9c-66d2e502e090,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58bf6094-42a8-4567-abea-27c63a57cf8a", "address": "fa:16:3e:f3:dd:72", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf6094-42", "ovs_interfaceid": "58bf6094-42a8-4567-abea-27c63a57cf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converting VIF {"id": "58bf6094-42a8-4567-abea-27c63a57cf8a", "address": "fa:16:3e:f3:dd:72", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf6094-42", "ovs_interfaceid": "58bf6094-42a8-4567-abea-27c63a57cf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:dd:72,bridge_name='br-int',has_traffic_filtering=True,id=58bf6094-42a8-4567-abea-27c63a57cf8a,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58bf6094-42') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG os_vif [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:dd:72,bridge_name='br-int',has_traffic_filtering=True,id=58bf6094-42a8-4567-abea-27c63a57cf8a,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58bf6094-42') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58bf6094-42, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap58bf6094-42, col_values=(('external_ids', {'iface-id': '58bf6094-42a8-4567-abea-27c63a57cf8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:dd:72', 'vm-uuid': '76055017-05ff-4ea7-ae9c-66d2e502e090'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:28 user nova-compute[73091]: INFO os_vif [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:dd:72,bridge_name='br-int',has_traffic_filtering=True,id=58bf6094-42a8-4567-abea-27c63a57cf8a,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58bf6094-42')
Aug 09 16:51:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:51:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] No VIF found with MAC fa:16:3e:f3:dd:72, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:51:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:51:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:51:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-fbfdf9a6-515e-4e3c-8e94-cf6b5251c3ad req-7d0f14cd-d3c7-4f08-9dde-e92c9763909b service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received event network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:51:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fbfdf9a6-515e-4e3c-8e94-cf6b5251c3ad req-7d0f14cd-d3c7-4f08-9dde-e92c9763909b service nova] Acquiring lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fbfdf9a6-515e-4e3c-8e94-cf6b5251c3ad req-7d0f14cd-d3c7-4f08-9dde-e92c9763909b service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fbfdf9a6-515e-4e3c-8e94-cf6b5251c3ad req-7d0f14cd-d3c7-4f08-9dde-e92c9763909b service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-fbfdf9a6-515e-4e3c-8e94-cf6b5251c3ad req-7d0f14cd-d3c7-4f08-9dde-e92c9763909b service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] No waiting events found dispatching network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:51:30 user nova-compute[73091]: WARNING nova.compute.manager [req-fbfdf9a6-515e-4e3c-8e94-cf6b5251c3ad req-7d0f14cd-d3c7-4f08-9dde-e92c9763909b service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received unexpected event network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a for instance with vm_state building and task_state spawning.
Aug 09 16:51:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-368dda37-f75a-4bba-b257-2ed50a8d4292 req-9b8c480f-d3e6-4189-a2b3-c6c42a0a7a1e service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Received event network-changed-7f0dfb31-4d50-4a36-b838-7151f4893a02 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:51:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-368dda37-f75a-4bba-b257-2ed50a8d4292 req-9b8c480f-d3e6-4189-a2b3-c6c42a0a7a1e service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Refreshing instance network info cache due to event network-changed-7f0dfb31-4d50-4a36-b838-7151f4893a02. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:51:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-368dda37-f75a-4bba-b257-2ed50a8d4292 req-9b8c480f-d3e6-4189-a2b3-c6c42a0a7a1e service nova] Acquiring lock "refresh_cache-0367cec8-7472-4e57-9ef9-d8cee9ad57c5" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:51:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-368dda37-f75a-4bba-b257-2ed50a8d4292 req-9b8c480f-d3e6-4189-a2b3-c6c42a0a7a1e service nova] Acquired lock "refresh_cache-0367cec8-7472-4e57-9ef9-d8cee9ad57c5" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:51:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-368dda37-f75a-4bba-b257-2ed50a8d4292 req-9b8c480f-d3e6-4189-a2b3-c6c42a0a7a1e service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Refreshing network info cache for port 7f0dfb31-4d50-4a36-b838-7151f4893a02 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lazy-loading 'flavor' on Instance uuid 0367cec8-7472-4e57-9ef9-d8cee9ad57c5 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:51:32 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Ignoring supplied device name: /dev/vdb
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:32 user nova-compute[73091]: INFO nova.compute.manager [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Attaching volume 99f7ef48-3168-4d89-ac1c-8b8f13988dbf to /dev/vdb
Aug 09 16:51:32 user nova-compute[73091]: DEBUG os_brick.utils [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbaadb7-d246-4287-9099-7105f9bcbe5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599892.3232365, 76055017-05ff-4ea7-ae9c-66d2e502e090 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:51:32 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] VM Resumed (Lifecycle Event)
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2502aeee-008a-42b5-9e81-9569e64566a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:51:32 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Instance spawned successfully.
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be8f675-f003-45b9-a62a-0bc859c19b9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b2f3c6-41a6-4efd-9391-93072ae5b8ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:51:32 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bd6f80-c857-4696-b199-e5b27a61e96b]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG os_brick.utils [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Updating existing volume attachment record: 8846e09f-80e9-4b79-8dc3-98b669b5d33b {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:51:32 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599892.331014, 76055017-05ff-4ea7-ae9c-66d2e502e090 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:51:32 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] VM Started (Lifecycle Event)
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-5d5aee75-2baa-4889-9f5d-035ef14229d1 req-e45bf0a8-db4d-408d-b71b-cbe856482e02 service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received event network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5d5aee75-2baa-4889-9f5d-035ef14229d1 req-e45bf0a8-db4d-408d-b71b-cbe856482e02 service nova] Acquiring lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5d5aee75-2baa-4889-9f5d-035ef14229d1 req-e45bf0a8-db4d-408d-b71b-cbe856482e02 service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5d5aee75-2baa-4889-9f5d-035ef14229d1 req-e45bf0a8-db4d-408d-b71b-cbe856482e02 service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-5d5aee75-2baa-4889-9f5d-035ef14229d1 req-e45bf0a8-db4d-408d-b71b-cbe856482e02 service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] No waiting events found dispatching network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:51:32 user nova-compute[73091]: WARNING nova.compute.manager [req-5d5aee75-2baa-4889-9f5d-035ef14229d1 req-e45bf0a8-db4d-408d-b71b-cbe856482e02 service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received unexpected event network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a for instance with vm_state building and task_state spawning.
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:51:32 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:51:32 user nova-compute[73091]: INFO nova.compute.manager [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Took 5.13 seconds to spawn the instance on the hypervisor.
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.network.neutron [req-368dda37-f75a-4bba-b257-2ed50a8d4292 req-9b8c480f-d3e6-4189-a2b3-c6c42a0a7a1e service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Updated VIF entry in instance network info cache for port 7f0dfb31-4d50-4a36-b838-7151f4893a02. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG nova.network.neutron [req-368dda37-f75a-4bba-b257-2ed50a8d4292 req-9b8c480f-d3e6-4189-a2b3-c6c42a0a7a1e service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Updating instance_info_cache with network_info: [{"id": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "address": "fa:16:3e:dc:a0:74", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f0dfb31-4d", "ovs_interfaceid": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:51:32 user nova-compute[73091]: INFO nova.compute.manager [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Took 20.89 seconds to build instance.
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-368dda37-f75a-4bba-b257-2ed50a8d4292 req-9b8c480f-d3e6-4189-a2b3-c6c42a0a7a1e service nova] Releasing lock "refresh_cache-0367cec8-7472-4e57-9ef9-d8cee9ad57c5" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:51:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-319e013f-e937-4cd5-8899-f931eb49d1a2 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.007s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:34 user nova-compute[73091]: INFO nova.compute.manager [None req-15bba75e-7445-41b6-958a-fbb5e9ba6a84 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Unrescuing
Aug 09 16:51:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-15bba75e-7445-41b6-958a-fbb5e9ba6a84 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:51:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-15bba75e-7445-41b6-958a-fbb5e9ba6a84 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquired lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:51:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-15bba75e-7445-41b6-958a-fbb5e9ba6a84 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:51:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-15bba75e-7445-41b6-958a-fbb5e9ba6a84 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Updating instance_info_cache with network_info: [{"id": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "address": "fa:16:3e:6e:98:76", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb647b7d-fa", "ovs_interfaceid": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:51:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-15bba75e-7445-41b6-958a-fbb5e9ba6a84 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Releasing lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:51:35 user nova-compute[73091]: DEBUG nova.objects.instance [None req-15bba75e-7445-41b6-958a-fbb5e9ba6a84 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'flavor' on Instance uuid 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:51:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-59527bb8-1008-4ac2-97f3-0cc00ea7c2b8 req-8d4d9fce-6192-4d2d-99eb-a091c119771f service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received event network-vif-unplugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:51:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-59527bb8-1008-4ac2-97f3-0cc00ea7c2b8 req-8d4d9fce-6192-4d2d-99eb-a091c119771f service nova] Acquiring lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-59527bb8-1008-4ac2-97f3-0cc00ea7c2b8 req-8d4d9fce-6192-4d2d-99eb-a091c119771f service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-59527bb8-1008-4ac2-97f3-0cc00ea7c2b8 req-8d4d9fce-6192-4d2d-99eb-a091c119771f service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-59527bb8-1008-4ac2-97f3-0cc00ea7c2b8 req-8d4d9fce-6192-4d2d-99eb-a091c119771f service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] No waiting events found dispatching network-vif-unplugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:51:35 user nova-compute[73091]: WARNING nova.compute.manager [req-59527bb8-1008-4ac2-97f3-0cc00ea7c2b8 req-8d4d9fce-6192-4d2d-99eb-a091c119771f service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received unexpected event network-vif-unplugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 for instance with vm_state rescued and task_state unrescuing.
Aug 09 16:51:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:36 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Instance destroyed successfully.
Aug 09 16:51:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-385f91dd-a379-4365-898c-13e33f89d584 req-d0928a06-78b6-4f65-9fe8-594ce660f2ce service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received event network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:51:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-385f91dd-a379-4365-898c-13e33f89d584 req-d0928a06-78b6-4f65-9fe8-594ce660f2ce service nova] Acquiring lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-385f91dd-a379-4365-898c-13e33f89d584 req-d0928a06-78b6-4f65-9fe8-594ce660f2ce service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-385f91dd-a379-4365-898c-13e33f89d584 req-d0928a06-78b6-4f65-9fe8-594ce660f2ce service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-385f91dd-a379-4365-898c-13e33f89d584 req-d0928a06-78b6-4f65-9fe8-594ce660f2ce service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] No waiting events found dispatching network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:51:37 user nova-compute[73091]: WARNING nova.compute.manager [req-385f91dd-a379-4365-898c-13e33f89d584 req-d0928a06-78b6-4f65-9fe8-594ce660f2ce service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received unexpected event network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 for instance with vm_state rescued and task_state unrescuing.
Aug 09 16:51:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Removed pending event for 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 16:51:39 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599899.7281384, 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:51:39 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] VM Resumed (Lifecycle Event)
Aug 09 16:51:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-15bba75e-7445-41b6-958a-fbb5e9ba6a84 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:51:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:51:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:51:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f54646c-79d4-43f7-ba49-b11d798e9755 req-150559b8-25c7-4a7c-a6ce-ff78949530e7 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received event network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:51:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f54646c-79d4-43f7-ba49-b11d798e9755 req-150559b8-25c7-4a7c-a6ce-ff78949530e7 service nova] Acquiring lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f54646c-79d4-43f7-ba49-b11d798e9755 req-150559b8-25c7-4a7c-a6ce-ff78949530e7 service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f54646c-79d4-43f7-ba49-b11d798e9755 req-150559b8-25c7-4a7c-a6ce-ff78949530e7 service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f54646c-79d4-43f7-ba49-b11d798e9755 req-150559b8-25c7-4a7c-a6ce-ff78949530e7 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] No waiting events found dispatching network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:51:39 user nova-compute[73091]: WARNING nova.compute.manager [req-3f54646c-79d4-43f7-ba49-b11d798e9755 req-150559b8-25c7-4a7c-a6ce-ff78949530e7 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received unexpected event network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 for instance with vm_state rescued and task_state unrescuing.
Aug 09 16:51:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f54646c-79d4-43f7-ba49-b11d798e9755 req-150559b8-25c7-4a7c-a6ce-ff78949530e7 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received event network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:51:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f54646c-79d4-43f7-ba49-b11d798e9755 req-150559b8-25c7-4a7c-a6ce-ff78949530e7 service nova] Acquiring lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f54646c-79d4-43f7-ba49-b11d798e9755 req-150559b8-25c7-4a7c-a6ce-ff78949530e7 service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3f54646c-79d4-43f7-ba49-b11d798e9755 req-150559b8-25c7-4a7c-a6ce-ff78949530e7 service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-3f54646c-79d4-43f7-ba49-b11d798e9755 req-150559b8-25c7-4a7c-a6ce-ff78949530e7 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] No waiting events found dispatching network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:51:39 user nova-compute[73091]: WARNING nova.compute.manager [req-3f54646c-79d4-43f7-ba49-b11d798e9755 req-150559b8-25c7-4a7c-a6ce-ff78949530e7 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received unexpected event network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 for instance with vm_state rescued and task_state unrescuing.
Aug 09 16:51:39 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 16:51:39 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599899.7325792, 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:51:39 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] VM Started (Lifecycle Event)
Aug 09 16:51:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:51:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:51:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYgrqWsT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:51:41 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:51:41 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:51:41 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[74faf6c6-0331-484a-b367-fc942926e053]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:51:41 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7703ba2f-9cf0-459f-adf2-3680dd3968ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf] added
Aug 09 16:51:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c01e82-0445-4067-a525-ec654450b6ac]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceda6beb-c6f6-4a86-9eac-882352f71fbc]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYgrqWsT {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYgrqWsT" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0025095c-1a4b-44b5-a239-73063f713cde]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mYgrqWsT'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e82a671-7983-431a-897b-679542abc982]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc7910f-5ff0-41f0-a3c9-62317feb5ef1]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:51:41 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:51:41 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:51:41 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:51:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:51:41 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:51:41 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:51:41 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:51:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7078d71f-bb53-44a8-a410-20725ffd3c59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf, portal: 172.16.0.220,3260]
Aug 09 16:51:41 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf, portal: 172.16.0.220,3260] successful.
Aug 09 16:51:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d7d79a-2136-4407-b269-fbde710bdf33]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c560d080-4a08-404e-8232-d53f74a05c0b]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:51:41 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:51:41 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:51:41 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:51:41 user nova-compute[73091]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf (non-flash)
Aug 09 16:51:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:51:41 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:51:41 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:51:41 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:51:41 user nova-compute[73091]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf (non-flash)
Aug 09 16:51:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] HCTL ('37', '-', '-', 0) found on session 44 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae64b413-5a0e-4718-97e3-97db13bddcc5]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:51:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYgrqWsT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:51:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:51:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23364373931386333', 'path': '/dev/sdf'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:51:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364373931386333', 'path': '/dev/sdf'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:51:42 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lazy-loading 'flavor' on Instance uuid 0367cec8-7472-4e57-9ef9-d8cee9ad57c5 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:51:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:51:42 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:51:42 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 09 16:51:42 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:51:42 user nova-compute[73091]:   <serial>99f7ef48-3168-4d89-ac1c-8b8f13988dbf</serial>
Aug 09 16:51:42 user nova-compute[73091]: </disk>
Aug 09 16:51:42 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:51:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:51:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:51:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] No VIF found with MAC fa:16:3e:dc:a0:74, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:51:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1bf888b7-6cf8-4110-a016-96064c178991 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.104s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-63f1a95c-2ec1-4f8a-8452-92c46f622fdd req-432ec4a0-84c5-4547-b4f6-80fb86265c09 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Received event network-changed-639d4d2b-0348-4dc8-91f0-9b6907984a13 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:51:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-63f1a95c-2ec1-4f8a-8452-92c46f622fdd req-432ec4a0-84c5-4547-b4f6-80fb86265c09 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Refreshing instance network info cache due to event network-changed-639d4d2b-0348-4dc8-91f0-9b6907984a13. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:51:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-63f1a95c-2ec1-4f8a-8452-92c46f622fdd req-432ec4a0-84c5-4547-b4f6-80fb86265c09 service nova] Acquiring lock "refresh_cache-12689fb0-5e5e-4421-8dd1-859bd5461963" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:51:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-63f1a95c-2ec1-4f8a-8452-92c46f622fdd req-432ec4a0-84c5-4547-b4f6-80fb86265c09 service nova] Acquired lock "refresh_cache-12689fb0-5e5e-4421-8dd1-859bd5461963" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:51:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-63f1a95c-2ec1-4f8a-8452-92c46f622fdd req-432ec4a0-84c5-4547-b4f6-80fb86265c09 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Refreshing network info cache for port 639d4d2b-0348-4dc8-91f0-9b6907984a13 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:51:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "12689fb0-5e5e-4421-8dd1-859bd5461963" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "12689fb0-5e5e-4421-8dd1-859bd5461963-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:48 user nova-compute[73091]: INFO nova.compute.manager [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Terminating instance
Aug 09 16:51:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:51:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d70f260-f1b1-4ba6-abc2-c0c7fd4827b8 req-3354e3de-23cd-410c-888b-fb4f32a0dfeb service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Received event network-vif-unplugged-639d4d2b-0348-4dc8-91f0-9b6907984a13 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:51:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d70f260-f1b1-4ba6-abc2-c0c7fd4827b8 req-3354e3de-23cd-410c-888b-fb4f32a0dfeb service nova] Acquiring lock "12689fb0-5e5e-4421-8dd1-859bd5461963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d70f260-f1b1-4ba6-abc2-c0c7fd4827b8 req-3354e3de-23cd-410c-888b-fb4f32a0dfeb service nova] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d70f260-f1b1-4ba6-abc2-c0c7fd4827b8 req-3354e3de-23cd-410c-888b-fb4f32a0dfeb service nova] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d70f260-f1b1-4ba6-abc2-c0c7fd4827b8 req-3354e3de-23cd-410c-888b-fb4f32a0dfeb service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] No waiting events found dispatching network-vif-unplugged-639d4d2b-0348-4dc8-91f0-9b6907984a13 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:51:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d70f260-f1b1-4ba6-abc2-c0c7fd4827b8 req-3354e3de-23cd-410c-888b-fb4f32a0dfeb service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Received event network-vif-unplugged-639d4d2b-0348-4dc8-91f0-9b6907984a13 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:51:49 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Instance destroyed successfully.
Aug 09 16:51:49 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lazy-loading 'resources' on Instance uuid 12689fb0-5e5e-4421-8dd1-859bd5461963 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:51:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1353293834',display_name='tempest-TestStampPattern-server-1353293834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1353293834',id=36,image_ref='0bbd95ca-209a-417c-84e1-bf013da6260a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6P3Qr1VZMAIk6RrDyvvqyhQ7LZCS0nJ47xUsRbhRFY0D/71qjjhLa1dc7eKXbzOlylR7y7dZ2Cb+Q/d0qINaFIYFTtHe5bUCqpIXOHo2fHfUg3zDl3U8Cw2AlPHLav2Q==',key_name='tempest-TestStampPattern-1375898526',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:49:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c79c356957db41aaa4e38a994523ba49',ramdisk_id='',reservation_id='r-yzjf0pt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b9639ddc-0ff9-41d2-b647-3af5fce945c2',image_min_disk='1',image_min_ram='0',image_owner_id='c79c356957db41aaa4e38a994523ba49',image_owner_project_name='tempest-TestStampPattern-1011496614',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1011496614-project-member',image_user_id='50cd847d1eb74f15bca467f2ce19941f',owner_project_name='tempest-TestStampPattern-1011496614',owner_user_name='tempest-TestStampPattern-1011496614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:49:00Z,user_data=None,user_id='50cd847d1eb74f15bca467f2ce19941f',uuid=12689fb0-5e5e-4421-8dd1-859bd5461963,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "address": "fa:16:3e:74:bf:53", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap639d4d2b-03", "ovs_interfaceid": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:51:49 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Converting VIF {"id": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "address": "fa:16:3e:74:bf:53", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap639d4d2b-03", "ovs_interfaceid": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:51:49 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:bf:53,bridge_name='br-int',has_traffic_filtering=True,id=639d4d2b-0348-4dc8-91f0-9b6907984a13,network=Network(7a19d9ac-eff2-4fff-b74e-caad307b52ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap639d4d2b-03') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:51:49 user nova-compute[73091]: DEBUG os_vif [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:bf:53,bridge_name='br-int',has_traffic_filtering=True,id=639d4d2b-0348-4dc8-91f0-9b6907984a13,network=Network(7a19d9ac-eff2-4fff-b74e-caad307b52ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap639d4d2b-03') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:51:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap639d4d2b-03, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:51:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:49 user nova-compute[73091]: INFO os_vif [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:bf:53,bridge_name='br-int',has_traffic_filtering=True,id=639d4d2b-0348-4dc8-91f0-9b6907984a13,network=Network(7a19d9ac-eff2-4fff-b74e-caad307b52ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap639d4d2b-03')
Aug 09 16:51:49 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Deleting instance files /opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963_del
Aug 09 16:51:49 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Deletion of /opt/stack/data/nova/instances/12689fb0-5e5e-4421-8dd1-859bd5461963_del complete
Aug 09 16:51:49 user nova-compute[73091]: DEBUG nova.network.neutron [req-63f1a95c-2ec1-4f8a-8452-92c46f622fdd req-432ec4a0-84c5-4547-b4f6-80fb86265c09 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Updated VIF entry in instance network info cache for port 639d4d2b-0348-4dc8-91f0-9b6907984a13. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:51:49 user nova-compute[73091]: DEBUG nova.network.neutron [req-63f1a95c-2ec1-4f8a-8452-92c46f622fdd req-432ec4a0-84c5-4547-b4f6-80fb86265c09 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Updating instance_info_cache with network_info: [{"id": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "address": "fa:16:3e:74:bf:53", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap639d4d2b-03", "ovs_interfaceid": "639d4d2b-0348-4dc8-91f0-9b6907984a13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:51:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-63f1a95c-2ec1-4f8a-8452-92c46f622fdd req-432ec4a0-84c5-4547-b4f6-80fb86265c09 service nova] Releasing lock "refresh_cache-12689fb0-5e5e-4421-8dd1-859bd5461963" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:51:49 user nova-compute[73091]: INFO nova.compute.manager [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 16:51:49 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:51:49 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:51:49 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:51:50 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:51:50 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Took 0.47 seconds to deallocate network for instance.
Aug 09 16:51:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:50 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:51:50 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:51:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:50 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Deleted allocations for instance 12689fb0-5e5e-4421-8dd1-859bd5461963
Aug 09 16:51:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a28aa536-23b3-46f5-8758-6698523b8a33 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.025s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-b4faeddf-0920-49c0-a0bc-e47a76ccad57 req-e70b09c3-3176-4808-b43a-6870d80ad6b2 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Received event network-vif-plugged-639d4d2b-0348-4dc8-91f0-9b6907984a13 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:51:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b4faeddf-0920-49c0-a0bc-e47a76ccad57 req-e70b09c3-3176-4808-b43a-6870d80ad6b2 service nova] Acquiring lock "12689fb0-5e5e-4421-8dd1-859bd5461963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:51:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b4faeddf-0920-49c0-a0bc-e47a76ccad57 req-e70b09c3-3176-4808-b43a-6870d80ad6b2 service nova] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:51:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b4faeddf-0920-49c0-a0bc-e47a76ccad57 req-e70b09c3-3176-4808-b43a-6870d80ad6b2 service nova] Lock "12689fb0-5e5e-4421-8dd1-859bd5461963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:51:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-b4faeddf-0920-49c0-a0bc-e47a76ccad57 req-e70b09c3-3176-4808-b43a-6870d80ad6b2 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] No waiting events found dispatching network-vif-plugged-639d4d2b-0348-4dc8-91f0-9b6907984a13 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:51:51 user nova-compute[73091]: WARNING nova.compute.manager [req-b4faeddf-0920-49c0-a0bc-e47a76ccad57 req-e70b09c3-3176-4808-b43a-6870d80ad6b2 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Received unexpected event network-vif-plugged-639d4d2b-0348-4dc8-91f0-9b6907984a13 for instance with vm_state deleted and task_state None.
Aug 09 16:51:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-b4faeddf-0920-49c0-a0bc-e47a76ccad57 req-e70b09c3-3176-4808-b43a-6870d80ad6b2 service nova] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Received event network-vif-deleted-639d4d2b-0348-4dc8-91f0-9b6907984a13 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:51:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:51:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:04 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599909.5189424, 12689fb0-5e5e-4421-8dd1-859bd5461963 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:52:04 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] VM Stopped (Lifecycle Event)
Aug 09 16:52:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-691aaa2f-ecaa-4c11-a225-cd125a67c2b9 None None] [instance: 12689fb0-5e5e-4421-8dd1-859bd5461963] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:52:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "925f656c-f94a-4707-b1d9-b750cd83a010" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "925f656c-f94a-4707-b1d9-b750cd83a010" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "925f656c-f94a-4707-b1d9-b750cd83a010-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "925f656c-f94a-4707-b1d9-b750cd83a010-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "925f656c-f94a-4707-b1d9-b750cd83a010-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:05 user nova-compute[73091]: INFO nova.compute.manager [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Terminating instance
Aug 09 16:52:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-86a340f2-8baa-4236-a301-d01cc6086554 req-da73bc14-b669-4f70-8ccf-4aeca509944b service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Received event network-vif-unplugged-1d105b3b-29db-489d-992c-fc3e9f58f914 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-86a340f2-8baa-4236-a301-d01cc6086554 req-da73bc14-b669-4f70-8ccf-4aeca509944b service nova] Acquiring lock "925f656c-f94a-4707-b1d9-b750cd83a010-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-86a340f2-8baa-4236-a301-d01cc6086554 req-da73bc14-b669-4f70-8ccf-4aeca509944b service nova] Lock "925f656c-f94a-4707-b1d9-b750cd83a010-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-86a340f2-8baa-4236-a301-d01cc6086554 req-da73bc14-b669-4f70-8ccf-4aeca509944b service nova] Lock "925f656c-f94a-4707-b1d9-b750cd83a010-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-86a340f2-8baa-4236-a301-d01cc6086554 req-da73bc14-b669-4f70-8ccf-4aeca509944b service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] No waiting events found dispatching network-vif-unplugged-1d105b3b-29db-489d-992c-fc3e9f58f914 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-86a340f2-8baa-4236-a301-d01cc6086554 req-da73bc14-b669-4f70-8ccf-4aeca509944b service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Received event network-vif-unplugged-1d105b3b-29db-489d-992c-fc3e9f58f914 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:52:05 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Instance destroyed successfully.
Aug 09 16:52:05 user nova-compute[73091]: DEBUG nova.objects.instance [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'resources' on Instance uuid 925f656c-f94a-4707-b1d9-b750cd83a010 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-378958278',display_name='tempest-AttachVolumeNegativeTest-server-378958278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-378958278',id=37,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAAhtlt1zH3c512v4rMI07WPJ4R0gFaQZp5osmQkO4+Zr+CrxcY9ojXjbnXZAuxCu80ApxLcFBQqvTDbS2vXt4vm0har9YPIEizY3esPsH8y2Kog4xPg/1X6tTTEypV4g==',key_name='tempest-keypair-1669128727',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:49:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27f2275630ce4d55bf02851df830b6bd',ramdisk_id='',reservation_id='r-00gvts8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-604747333',owner_user_name='tempest-AttachVolumeNegativeTest-604747333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:49:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a5c393d644c4c3f8e9cbb0805ba7c08',uuid=925f656c-f94a-4707-b1d9-b750cd83a010,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d105b3b-29db-489d-992c-fc3e9f58f914", "address": "fa:16:3e:e3:2c:a3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d105b3b-29", "ovs_interfaceid": "1d105b3b-29db-489d-992c-fc3e9f58f914", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converting VIF {"id": "1d105b3b-29db-489d-992c-fc3e9f58f914", "address": "fa:16:3e:e3:2c:a3", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d105b3b-29", "ovs_interfaceid": "1d105b3b-29db-489d-992c-fc3e9f58f914", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:2c:a3,bridge_name='br-int',has_traffic_filtering=True,id=1d105b3b-29db-489d-992c-fc3e9f58f914,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d105b3b-29') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG os_vif [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:2c:a3,bridge_name='br-int',has_traffic_filtering=True,id=1d105b3b-29db-489d-992c-fc3e9f58f914,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d105b3b-29') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d105b3b-29, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:52:05 user nova-compute[73091]: INFO os_vif [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:2c:a3,bridge_name='br-int',has_traffic_filtering=True,id=1d105b3b-29db-489d-992c-fc3e9f58f914,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d105b3b-29')
Aug 09 16:52:05 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Deleting instance files /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010_del
Aug 09 16:52:05 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Deletion of /opt/stack/data/nova/instances/925f656c-f94a-4707-b1d9-b750cd83a010_del complete
Aug 09 16:52:05 user nova-compute[73091]: INFO nova.compute.manager [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 09 16:52:05 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:52:05 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:52:07 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Took 1.26 seconds to deallocate network for instance.
Aug 09 16:52:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "97af1277-b4bd-4a89-903b-4f70087f0535" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "97af1277-b4bd-4a89-903b-4f70087f0535" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:07 user nova-compute[73091]: INFO nova.compute.manager [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Terminating instance
Aug 09 16:52:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-05671cee-7248-449a-ae04-d9ad8465fb88 req-53eacca0-691b-4904-88ac-6275807cd1d4 service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Received event network-vif-plugged-1d105b3b-29db-489d-992c-fc3e9f58f914 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-05671cee-7248-449a-ae04-d9ad8465fb88 req-53eacca0-691b-4904-88ac-6275807cd1d4 service nova] Acquiring lock "925f656c-f94a-4707-b1d9-b750cd83a010-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-05671cee-7248-449a-ae04-d9ad8465fb88 req-53eacca0-691b-4904-88ac-6275807cd1d4 service nova] Lock "925f656c-f94a-4707-b1d9-b750cd83a010-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-05671cee-7248-449a-ae04-d9ad8465fb88 req-53eacca0-691b-4904-88ac-6275807cd1d4 service nova] Lock "925f656c-f94a-4707-b1d9-b750cd83a010-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-05671cee-7248-449a-ae04-d9ad8465fb88 req-53eacca0-691b-4904-88ac-6275807cd1d4 service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] No waiting events found dispatching network-vif-plugged-1d105b3b-29db-489d-992c-fc3e9f58f914 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:52:07 user nova-compute[73091]: WARNING nova.compute.manager [req-05671cee-7248-449a-ae04-d9ad8465fb88 req-53eacca0-691b-4904-88ac-6275807cd1d4 service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Received unexpected event network-vif-plugged-1d105b3b-29db-489d-992c-fc3e9f58f914 for instance with vm_state deleted and task_state None.
Aug 09 16:52:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-05671cee-7248-449a-ae04-d9ad8465fb88 req-53eacca0-691b-4904-88ac-6275807cd1d4 service nova] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Received event network-vif-deleted-1d105b3b-29db-489d-992c-fc3e9f58f914 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-c77c5014-11fc-4c86-8c31-b11a4e19af96 req-b4a816f1-7edb-44a1-adda-5a39f78c0607 service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Received event network-vif-unplugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c77c5014-11fc-4c86-8c31-b11a4e19af96 req-b4a816f1-7edb-44a1-adda-5a39f78c0607 service nova] Acquiring lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c77c5014-11fc-4c86-8c31-b11a4e19af96 req-b4a816f1-7edb-44a1-adda-5a39f78c0607 service nova] Lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c77c5014-11fc-4c86-8c31-b11a4e19af96 req-b4a816f1-7edb-44a1-adda-5a39f78c0607 service nova] Lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-c77c5014-11fc-4c86-8c31-b11a4e19af96 req-b4a816f1-7edb-44a1-adda-5a39f78c0607 service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] No waiting events found dispatching network-vif-unplugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-c77c5014-11fc-4c86-8c31-b11a4e19af96 req-b4a816f1-7edb-44a1-adda-5a39f78c0607 service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Received event network-vif-unplugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.529s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:07 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Deleted allocations for instance 925f656c-f94a-4707-b1d9-b750cd83a010
Aug 09 16:52:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-473501f2-bd27-4a98-8637-dc00ead17027 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "925f656c-f94a-4707-b1d9-b750cd83a010" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.888s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Instance destroyed successfully.
Aug 09 16:52:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lazy-loading 'resources' on Instance uuid 97af1277-b4bd-4a89-903b-4f70087f0535 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-946441557',display_name='tempest-ServerActionsTestOtherA-server-946441557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-946441557',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILfado63mW6+CgjHmwYiNct4RkaQ/hFrQzjzGZX9fcd5tmDChxbl9riU31kjgrW3xhMcxzy/FY8sPsumtyuqQ7ittcRZasxYBvL6XWrt/5jr8BpeJz8IvTq6jqpzExzYw==',key_name='tempest-keypair-1434010925',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:47:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38c913ceef2c4610a26bd19df29ee896',ramdisk_id='',reservation_id='r-yjp8agt5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-813213856',owner_user_name='tempest-ServerActionsTestOtherA-813213856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:49:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8956fad221ec4dedb700f034d5230c06',uuid=97af1277-b4bd-4a89-903b-4f70087f0535,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converting VIF {"id": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "address": "fa:16:3e:d1:07:07", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ff67fb-2a", "ovs_interfaceid": "a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:07:07,bridge_name='br-int',has_traffic_filtering=True,id=a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ff67fb-2a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG os_vif [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:07:07,bridge_name='br-int',has_traffic_filtering=True,id=a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ff67fb-2a') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0ff67fb-2a, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:08 user nova-compute[73091]: INFO os_vif [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:07:07,bridge_name='br-int',has_traffic_filtering=True,id=a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ff67fb-2a')
Aug 09 16:52:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hztVspoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:52:08 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:52:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ee9b90-d4c7-4f57-ae18-db8ecd52acc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83c4104-3449-40b9-a4eb-2b132e61e6da]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:52:08 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:52:08 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:52:08 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:52:08 user nova-compute[73091]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf (non-flash)
Aug 09 16:52:08 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 (non-flash)
Aug 09 16:52:08 user nova-compute[73091]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:52:08 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:52:08 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:52:08 user nova-compute[73091]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf (non-flash)
Aug 09 16:52:08 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0603d7490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d1b062-12aa-4e5a-9bfd-c3e8e8996e18]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[688ea47a-7378-4694-b97b-77a6c3c64ddd]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[195c86f0-9076-4d15-b589-73c904bcf09d]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9997eb92-2828-4130-9022-2fc4e107c3d4]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaa0436-36a8-4587-ae74-26ca4d87dd6f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e21933-8d5d-4964-b55a-a53ca088a569]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628, portal: 172.16.0.220,3260]
Aug 09 16:52:08 user nova-compute[73091]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628, portal: 172.16.0.220,3260] successful.
Aug 09 16:52:08 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35539ace-9cd8-4004-bdba-ccd3d56a7628 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[64680148-5fc1-4c92-ad2a-af04ea279770]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] <== disconnect_volume: return (303ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:52:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Deleting instance files /opt/stack/data/nova/instances/97af1277-b4bd-4a89-903b-4f70087f0535_del
Aug 09 16:52:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Deletion of /opt/stack/data/nova/instances/97af1277-b4bd-4a89-903b-4f70087f0535_del complete
Aug 09 16:52:08 user nova-compute[73091]: INFO nova.compute.manager [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 09 16:52:08 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:52:08 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:52:09 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:52:09 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Took 0.79 seconds to deallocate network for instance.
Aug 09 16:52:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-9f6fb020-a399-4b2d-ba42-924f36e8ece0 req-318679aa-2439-4f9a-bc3f-98d88b4030bb service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Received event network-vif-deleted-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:52:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-bd848a77-23bf-4fc5-9f13-6d24d1856ad4 req-1e8ebc01-91c3-4bbc-b511-79748e658c03 service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Received event network-vif-plugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:52:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bd848a77-23bf-4fc5-9f13-6d24d1856ad4 req-1e8ebc01-91c3-4bbc-b511-79748e658c03 service nova] Acquiring lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bd848a77-23bf-4fc5-9f13-6d24d1856ad4 req-1e8ebc01-91c3-4bbc-b511-79748e658c03 service nova] Lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bd848a77-23bf-4fc5-9f13-6d24d1856ad4 req-1e8ebc01-91c3-4bbc-b511-79748e658c03 service nova] Lock "97af1277-b4bd-4a89-903b-4f70087f0535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-bd848a77-23bf-4fc5-9f13-6d24d1856ad4 req-1e8ebc01-91c3-4bbc-b511-79748e658c03 service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] No waiting events found dispatching network-vif-plugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:52:09 user nova-compute[73091]: WARNING nova.compute.manager [req-bd848a77-23bf-4fc5-9f13-6d24d1856ad4 req-1e8ebc01-91c3-4bbc-b511-79748e658c03 service nova] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Received unexpected event network-vif-plugged-a0ff67fb-2aa9-4f23-bcf9-41223c7bf6ca for instance with vm_state active and task_state deleting.
Aug 09 16:52:10 user nova-compute[73091]: INFO nova.compute.manager [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Took 0.75 seconds to detach 1 volumes for instance.
Aug 09 16:52:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Deleting volume: 35539ace-9cd8-4004-bdba-ccd3d56a7628 {{(pid=73091) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 16:52:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:10 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:52:10 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:52:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:10 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Deleted allocations for instance 97af1277-b4bd-4a89-903b-4f70087f0535
Aug 09 16:52:10 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:52:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-98cec2b3-de68-42d5-a33c-93799c995ce4 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "97af1277-b4bd-4a89-903b-4f70087f0535" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.544s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "c142dbba-1e7f-4381-91a5-876b55e11a64" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:11 user nova-compute[73091]: INFO nova.compute.manager [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Terminating instance
Aug 09 16:52:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:52:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-a69b3a4f-8465-498f-8227-ecb240effb58 req-38d14ce9-4752-43dc-9fb3-ac2ccc493d35 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received event network-vif-unplugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:52:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a69b3a4f-8465-498f-8227-ecb240effb58 req-38d14ce9-4752-43dc-9fb3-ac2ccc493d35 service nova] Acquiring lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a69b3a4f-8465-498f-8227-ecb240effb58 req-38d14ce9-4752-43dc-9fb3-ac2ccc493d35 service nova] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a69b3a4f-8465-498f-8227-ecb240effb58 req-38d14ce9-4752-43dc-9fb3-ac2ccc493d35 service nova] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-a69b3a4f-8465-498f-8227-ecb240effb58 req-38d14ce9-4752-43dc-9fb3-ac2ccc493d35 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] No waiting events found dispatching network-vif-unplugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:52:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-a69b3a4f-8465-498f-8227-ecb240effb58 req-38d14ce9-4752-43dc-9fb3-ac2ccc493d35 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received event network-vif-unplugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:52:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Instance destroyed successfully.
Aug 09 16:52:12 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lazy-loading 'resources' on Instance uuid c142dbba-1e7f-4381-91a5-876b55e11a64 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:52:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-555112067',display_name='tempest-TestMinimumBasicScenario-server-555112067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-555112067',id=32,image_ref='315f3d5d-9f33-47f0-9347-eeea00742c89',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJJTaTt6mrnEToLWj6nubMKFVBkIJwEb5cDa5Yu86AftoYDLns8EgRlJGxSLc2cqmOVkWKfcWg93a8UH6XQPiGNITEhujb4EycBouXSykeAVhwwkZ1aI0XrPmFSukQ+Xw==',key_name='tempest-TestMinimumBasicScenario-1099798685',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:47:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e1ecfa8609840b1950ed8563bd427d1',ramdisk_id='',reservation_id='r-c7zbbjs6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='315f3d5d-9f33-47f0-9347-eeea00742c89',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-51921820',owner_user_name='tempest-TestMinimumBasicScenario-51921820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:49:30Z,user_data=None,user_id='d6652e0ef40d4e26b67628d261f2848e',uuid=c142dbba-1e7f-4381-91a5-876b55e11a64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "address": "fa:16:3e:af:49:2e", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84392ff0-9f", "ovs_interfaceid": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:52:12 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Converting VIF {"id": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "address": "fa:16:3e:af:49:2e", "network": {"id": "c037721f-4077-4bb6-bc67-2dacc5c90efc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-149977018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e1ecfa8609840b1950ed8563bd427d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84392ff0-9f", "ovs_interfaceid": "84392ff0-9f13-41e4-adb9-c3a5db7677a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:52:12 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:49:2e,bridge_name='br-int',has_traffic_filtering=True,id=84392ff0-9f13-41e4-adb9-c3a5db7677a5,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84392ff0-9f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:52:12 user nova-compute[73091]: DEBUG os_vif [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:49:2e,bridge_name='br-int',has_traffic_filtering=True,id=84392ff0-9f13-41e4-adb9-c3a5db7677a5,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84392ff0-9f') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:52:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84392ff0-9f, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:52:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:12 user nova-compute[73091]: INFO os_vif [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:49:2e,bridge_name='br-int',has_traffic_filtering=True,id=84392ff0-9f13-41e4-adb9-c3a5db7677a5,network=Network(c037721f-4077-4bb6-bc67-2dacc5c90efc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84392ff0-9f')
Aug 09 16:52:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Deleting instance files /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64_del
Aug 09 16:52:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Deletion of /opt/stack/data/nova/instances/c142dbba-1e7f-4381-91a5-876b55e11a64_del complete
Aug 09 16:52:12 user nova-compute[73091]: INFO nova.compute.manager [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 09 16:52:12 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:52:12 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:52:12 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:52:13 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:52:13 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Took 0.62 seconds to deallocate network for instance.
Aug 09 16:52:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:13 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:52:13 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:52:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:13 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Deleted allocations for instance c142dbba-1e7f-4381-91a5-876b55e11a64
Aug 09 16:52:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6cdf8ffa-31c1-4cea-a9ec-61bdcce973a4 tempest-TestMinimumBasicScenario-51921820 tempest-TestMinimumBasicScenario-51921820-project-member] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.031s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-543d8d63-4427-42e3-805e-17e2e7eb98de req-81a519d3-fc47-47df-b58f-50bf95b96858 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received event network-vif-plugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:52:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-543d8d63-4427-42e3-805e-17e2e7eb98de req-81a519d3-fc47-47df-b58f-50bf95b96858 service nova] Acquiring lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-543d8d63-4427-42e3-805e-17e2e7eb98de req-81a519d3-fc47-47df-b58f-50bf95b96858 service nova] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-543d8d63-4427-42e3-805e-17e2e7eb98de req-81a519d3-fc47-47df-b58f-50bf95b96858 service nova] Lock "c142dbba-1e7f-4381-91a5-876b55e11a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-543d8d63-4427-42e3-805e-17e2e7eb98de req-81a519d3-fc47-47df-b58f-50bf95b96858 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] No waiting events found dispatching network-vif-plugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:52:14 user nova-compute[73091]: WARNING nova.compute.manager [req-543d8d63-4427-42e3-805e-17e2e7eb98de req-81a519d3-fc47-47df-b58f-50bf95b96858 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received unexpected event network-vif-plugged-84392ff0-9f13-41e4-adb9-c3a5db7677a5 for instance with vm_state deleted and task_state None.
Aug 09 16:52:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-543d8d63-4427-42e3-805e-17e2e7eb98de req-81a519d3-fc47-47df-b58f-50bf95b96858 service nova] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Received event network-vif-deleted-84392ff0-9f13-41e4-adb9-c3a5db7677a5 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:52:14 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:52:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:52:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:17 user nova-compute[73091]: INFO nova.compute.manager [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Detaching volume 99f7ef48-3168-4d89-ac1c-8b8f13988dbf
Aug 09 16:52:17 user nova-compute[73091]: INFO nova.virt.block_device [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Attempting to driver detach volume 99f7ef48-3168-4d89-ac1c-8b8f13988dbf from mountpoint /dev/vdb
Aug 09 16:52:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Attempting to detach device vdb from instance 0367cec8-7472-4e57-9ef9-d8cee9ad57c5 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:52:17 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:52:17 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 09 16:52:17 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:52:17 user nova-compute[73091]:   <serial>99f7ef48-3168-4d89-ac1c-8b8f13988dbf</serial>
Aug 09 16:52:17 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:52:17 user nova-compute[73091]: </disk>
Aug 09 16:52:17 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:52:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Successfully detached device vdb from instance 0367cec8-7472-4e57-9ef9-d8cee9ad57c5 from the persistent domain config.
Aug 09 16:52:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0367cec8-7472-4e57-9ef9-d8cee9ad57c5 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:52:17 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:52:17 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 09 16:52:17 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:52:17 user nova-compute[73091]:   <serial>99f7ef48-3168-4d89-ac1c-8b8f13988dbf</serial>
Aug 09 16:52:17 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:52:17 user nova-compute[73091]: </disk>
Aug 09 16:52:17 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691599937.8477411, 0367cec8-7472-4e57-9ef9-d8cee9ad57c5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0367cec8-7472-4e57-9ef9-d8cee9ad57c5 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:52:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Successfully detached device vdb from instance 0367cec8-7472-4e57-9ef9-d8cee9ad57c5 from the live domain config.
Aug 09 16:52:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYgrqWsT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:52:17 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:52:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be90c7b-d5f8-4974-a701-c4e70b9eeb24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83dcdbf-f099-41cd-9e29-23fa437bd821]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:52:17 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:52:17 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:52:17 user nova-compute[73091]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf (non-flash)
Aug 09 16:52:17 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:52:17 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:52:17 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:52:17 user nova-compute[73091]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf (non-flash)
Aug 09 16:52:17 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff06032ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf'): ({'sdf'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Removing single pathed devices sdf {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[584d7020-508e-476d-83ea-60a724bb5d62]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa56d01-cc5b-4252-939a-7826cf07da24]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Flushing IO for device /dev/sdf {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0686400f-27bd-422d-85b5-042bf7acb9e4]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:52:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41c6205-2693-444d-93a8-b33ca688b6ad]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f71f69-602f-4bd0-977e-5852957b2843]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0785735f-e6e7-4199-8786-79e625024268]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf, portal: 172.16.0.220,3260]
Aug 09 16:52:18 user nova-compute[73091]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf, portal: 172.16.0.220,3260] successful.
Aug 09 16:52:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb33869f-6b1a-4f89-8820-2a0ab939fd39]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] <== disconnect_volume: return (262ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG nova.objects.instance [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lazy-loading 'flavor' on Instance uuid 0367cec8-7472-4e57-9ef9-d8cee9ad57c5 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-de39a7ab-88db-4040-845e-63530e60da5d tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.552s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.438s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:18 user nova-compute[73091]: INFO nova.compute.manager [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Terminating instance
Aug 09 16:52:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-b9639ddc-0ff9-41d2-b647-3af5fce945c2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-b9639ddc-0ff9-41d2-b647-3af5fce945c2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-89e85f31-7b35-4936-9310-314595959776 req-43b7499c-16f6-4a28-905e-8d04a874ea1a service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Received event network-vif-unplugged-7f0dfb31-4d50-4a36-b838-7151f4893a02 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-89e85f31-7b35-4936-9310-314595959776 req-43b7499c-16f6-4a28-905e-8d04a874ea1a service nova] Acquiring lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-89e85f31-7b35-4936-9310-314595959776 req-43b7499c-16f6-4a28-905e-8d04a874ea1a service nova] Lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-89e85f31-7b35-4936-9310-314595959776 req-43b7499c-16f6-4a28-905e-8d04a874ea1a service nova] Lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-89e85f31-7b35-4936-9310-314595959776 req-43b7499c-16f6-4a28-905e-8d04a874ea1a service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] No waiting events found dispatching network-vif-unplugged-7f0dfb31-4d50-4a36-b838-7151f4893a02 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-89e85f31-7b35-4936-9310-314595959776 req-43b7499c-16f6-4a28-905e-8d04a874ea1a service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Received event network-vif-unplugged-7f0dfb31-4d50-4a36-b838-7151f4893a02 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:52:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Instance destroyed successfully.
Aug 09 16:52:19 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lazy-loading 'resources' on Instance uuid 0367cec8-7472-4e57-9ef9-d8cee9ad57c5 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1067024379',display_name='tempest-VolumesSnapshotTestJSON-instance-1067024379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1067024379',id=38,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTOHJXWY8Amk8D9MJn1isq6BrynY6QbXlCy4agJnYj7Wm1dpIa9Te5vfNyegfLojoccJGvIAEkP68OZei24EijDFTG3wifrgD1G8cp/rQcmOAwFlY8q1k8NoW+YYaritA==',key_name='tempest-keypair-760846969',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:49:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6982c498eeb94d8381a610cb59694191',ramdisk_id='',reservation_id='r-sn34wljy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-472009357',owner_user_name='tempest-VolumesSnapshotTestJSON-472009357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:49:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77d81649b61a40ee87e4fc3c7cc56c7d',uuid=0367cec8-7472-4e57-9ef9-d8cee9ad57c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "address": "fa:16:3e:dc:a0:74", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f0dfb31-4d", "ovs_interfaceid": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Converting VIF {"id": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "address": "fa:16:3e:dc:a0:74", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f0dfb31-4d", "ovs_interfaceid": "7f0dfb31-4d50-4a36-b838-7151f4893a02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:a0:74,bridge_name='br-int',has_traffic_filtering=True,id=7f0dfb31-4d50-4a36-b838-7151f4893a02,network=Network(8b1a154d-9ae1-4829-a3f1-001cf4ae3658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f0dfb31-4d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG os_vif [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:a0:74,bridge_name='br-int',has_traffic_filtering=True,id=7f0dfb31-4d50-4a36-b838-7151f4893a02,network=Network(8b1a154d-9ae1-4829-a3f1-001cf4ae3658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f0dfb31-4d') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f0dfb31-4d, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:52:19 user nova-compute[73091]: INFO os_vif [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:a0:74,bridge_name='br-int',has_traffic_filtering=True,id=7f0dfb31-4d50-4a36-b838-7151f4893a02,network=Network(8b1a154d-9ae1-4829-a3f1-001cf4ae3658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f0dfb31-4d')
Aug 09 16:52:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYgrqWsT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:52:19 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:52:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99f7ef48-3168-4d89-ac1c-8b8f13988dbf', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[24447bf9-6da2-4fac-bc90-a447a649dc06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bea94c-f5ca-4207-bda9-40b7b8aa417f]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:52:19 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:52:19 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:52:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:52:19 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:52:19 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:52:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff06032fbe0>, {}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Disconnecting from: [] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] <== disconnect_volume: return (53ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:52:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Deleting instance files /opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5_del
Aug 09 16:52:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Deletion of /opt/stack/data/nova/instances/0367cec8-7472-4e57-9ef9-d8cee9ad57c5_del complete
Aug 09 16:52:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Updating instance_info_cache with network_info: [{"id": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "address": "fa:16:3e:07:e7:b6", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f550175-ab", "ovs_interfaceid": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-b9639ddc-0ff9-41d2-b647-3af5fce945c2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:19 user nova-compute[73091]: INFO nova.compute.manager [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 09 16:52:19 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:52:19 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:52:20 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:52:20 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Took 0.76 seconds to deallocate network for instance.
Aug 09 16:52:20 user nova-compute[73091]: WARNING nova.volume.cinder [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Attachment 8846e09f-80e9-4b79-8dc3-98b669b5d33b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 8846e09f-80e9-4b79-8dc3-98b669b5d33b. (HTTP 404) (Request-ID: req-e7c2fb3a-9d52-4089-87bf-1fc325f9d72f)
Aug 09 16:52:20 user nova-compute[73091]: INFO nova.compute.manager [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Took 0.02 seconds to detach 1 volumes for instance.
Aug 09 16:52:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:20 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599925.8326342, 925f656c-f94a-4707-b1d9-b750cd83a010 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:52:20 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] VM Stopped (Lifecycle Event)
Aug 09 16:52:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-130f9400-ae43-4227-8b7a-e3dfae9131f4 None None] [instance: 925f656c-f94a-4707-b1d9-b750cd83a010] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:52:20 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:52:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:52:20 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:52:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:20 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Deleted allocations for instance 0367cec8-7472-4e57-9ef9-d8cee9ad57c5
Aug 09 16:52:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d61b9e5e-b005-423b-948a-2418f4b6e91e tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.159s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-26b189a4-d48d-42aa-b371-ed2db6cc067e req-14358af4-9db2-4bcb-a39e-f2c7fa0710e7 service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Received event network-vif-plugged-7f0dfb31-4d50-4a36-b838-7151f4893a02 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:52:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-26b189a4-d48d-42aa-b371-ed2db6cc067e req-14358af4-9db2-4bcb-a39e-f2c7fa0710e7 service nova] Acquiring lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-26b189a4-d48d-42aa-b371-ed2db6cc067e req-14358af4-9db2-4bcb-a39e-f2c7fa0710e7 service nova] Lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-26b189a4-d48d-42aa-b371-ed2db6cc067e req-14358af4-9db2-4bcb-a39e-f2c7fa0710e7 service nova] Lock "0367cec8-7472-4e57-9ef9-d8cee9ad57c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-26b189a4-d48d-42aa-b371-ed2db6cc067e req-14358af4-9db2-4bcb-a39e-f2c7fa0710e7 service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] No waiting events found dispatching network-vif-plugged-7f0dfb31-4d50-4a36-b838-7151f4893a02 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:52:21 user nova-compute[73091]: WARNING nova.compute.manager [req-26b189a4-d48d-42aa-b371-ed2db6cc067e req-14358af4-9db2-4bcb-a39e-f2c7fa0710e7 service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Received unexpected event network-vif-plugged-7f0dfb31-4d50-4a36-b838-7151f4893a02 for instance with vm_state deleted and task_state None.
Aug 09 16:52:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-26b189a4-d48d-42aa-b371-ed2db6cc067e req-14358af4-9db2-4bcb-a39e-f2c7fa0710e7 service nova] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Received event network-vif-deleted-7f0dfb31-4d50-4a36-b838-7151f4893a02 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:52:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:52:22 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:52:22 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:52:22 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:52:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:22 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:52:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:52:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:23 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599928.136101, 97af1277-b4bd-4a89-903b-4f70087f0535 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:52:23 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] VM Stopped (Lifecycle Event)
Aug 09 16:52:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f9f89f49-7dfe-48aa-b8d3-2ea215bda551 None None] [instance: 97af1277-b4bd-4a89-903b-4f70087f0535] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:52:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:52:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:52:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:52:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:52:25 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:52:25 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:52:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7719MB free_disk=25.014934539794922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:52:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:52:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f939fe27-017a-481e-babc-147bf98e0132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:52:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8fc884a8-24bb-488a-baeb-ef2b1faf239d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:52:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance b9639ddc-0ff9-41d2-b647-3af5fce945c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:52:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:52:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c3871ef4-45e7-4118-8227-e48cc857d481 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:52:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance bfb5340a-2329-4bd2-9f94-52ef24967a9b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:52:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 76055017-05ff-4ea7-ae9c-66d2e502e090 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:52:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:52:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:52:25 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:52:25 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:52:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:52:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:27 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599932.5558686, c142dbba-1e7f-4381-91a5-876b55e11a64 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:52:27 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] VM Stopped (Lifecycle Event)
Aug 09 16:52:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2b4cc0d7-6c45-4b3f-9832-072550bcd401 None None] [instance: c142dbba-1e7f-4381-91a5-876b55e11a64] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:52:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:34 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599939.6330006, 0367cec8-7472-4e57-9ef9-d8cee9ad57c5 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:52:34 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] VM Stopped (Lifecycle Event)
Aug 09 16:52:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-36407040-905a-49c2-b3d6-0cd03edf2270 None None] [instance: 0367cec8-7472-4e57-9ef9-d8cee9ad57c5] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:52:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:52:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-43bb8bdb-ab86-493c-8725-599a92358253 req-b567bcb5-9af9-4f6f-8aeb-af36db651918 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Received event network-changed-4f550175-ab3c-4b43-9a63-fd5b429773f3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:52:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-43bb8bdb-ab86-493c-8725-599a92358253 req-b567bcb5-9af9-4f6f-8aeb-af36db651918 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Refreshing instance network info cache due to event network-changed-4f550175-ab3c-4b43-9a63-fd5b429773f3. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:52:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-43bb8bdb-ab86-493c-8725-599a92358253 req-b567bcb5-9af9-4f6f-8aeb-af36db651918 service nova] Acquiring lock "refresh_cache-b9639ddc-0ff9-41d2-b647-3af5fce945c2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:52:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-43bb8bdb-ab86-493c-8725-599a92358253 req-b567bcb5-9af9-4f6f-8aeb-af36db651918 service nova] Acquired lock "refresh_cache-b9639ddc-0ff9-41d2-b647-3af5fce945c2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:52:50 user nova-compute[73091]: DEBUG nova.network.neutron [req-43bb8bdb-ab86-493c-8725-599a92358253 req-b567bcb5-9af9-4f6f-8aeb-af36db651918 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Refreshing network info cache for port 4f550175-ab3c-4b43-9a63-fd5b429773f3 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:52:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:50 user nova-compute[73091]: INFO nova.compute.manager [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Terminating instance
Aug 09 16:52:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:52:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:50 user nova-compute[73091]: DEBUG nova.network.neutron [req-43bb8bdb-ab86-493c-8725-599a92358253 req-b567bcb5-9af9-4f6f-8aeb-af36db651918 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Updated VIF entry in instance network info cache for port 4f550175-ab3c-4b43-9a63-fd5b429773f3. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:52:50 user nova-compute[73091]: DEBUG nova.network.neutron [req-43bb8bdb-ab86-493c-8725-599a92358253 req-b567bcb5-9af9-4f6f-8aeb-af36db651918 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Updating instance_info_cache with network_info: [{"id": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "address": "fa:16:3e:07:e7:b6", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f550175-ab", "ovs_interfaceid": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:52:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-43bb8bdb-ab86-493c-8725-599a92358253 req-b567bcb5-9af9-4f6f-8aeb-af36db651918 service nova] Releasing lock "refresh_cache-b9639ddc-0ff9-41d2-b647-3af5fce945c2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:52:51 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Instance destroyed successfully.
Aug 09 16:52:51 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lazy-loading 'resources' on Instance uuid b9639ddc-0ff9-41d2-b647-3af5fce945c2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:52:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:45:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1960222994',display_name='tempest-TestStampPattern-server-1960222994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1960222994',id=31,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6P3Qr1VZMAIk6RrDyvvqyhQ7LZCS0nJ47xUsRbhRFY0D/71qjjhLa1dc7eKXbzOlylR7y7dZ2Cb+Q/d0qINaFIYFTtHe5bUCqpIXOHo2fHfUg3zDl3U8Cw2AlPHLav2Q==',key_name='tempest-TestStampPattern-1375898526',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:45:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c79c356957db41aaa4e38a994523ba49',ramdisk_id='',reservation_id='r-afg3qheu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1011496614',owner_user_name='tempest-TestStampPattern-1011496614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:48:51Z,user_data=None,user_id='50cd847d1eb74f15bca467f2ce19941f',uuid=b9639ddc-0ff9-41d2-b647-3af5fce945c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "address": "fa:16:3e:07:e7:b6", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f550175-ab", "ovs_interfaceid": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:52:51 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Converting VIF {"id": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "address": "fa:16:3e:07:e7:b6", "network": {"id": "7a19d9ac-eff2-4fff-b74e-caad307b52ce", "bridge": "br-int", "label": "tempest-TestStampPattern-821662744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c79c356957db41aaa4e38a994523ba49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f550175-ab", "ovs_interfaceid": "4f550175-ab3c-4b43-9a63-fd5b429773f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:52:51 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:e7:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f550175-ab3c-4b43-9a63-fd5b429773f3,network=Network(7a19d9ac-eff2-4fff-b74e-caad307b52ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f550175-ab') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:52:51 user nova-compute[73091]: DEBUG os_vif [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:e7:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f550175-ab3c-4b43-9a63-fd5b429773f3,network=Network(7a19d9ac-eff2-4fff-b74e-caad307b52ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f550175-ab') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:52:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f550175-ab, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:52:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:51 user nova-compute[73091]: INFO os_vif [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:e7:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f550175-ab3c-4b43-9a63-fd5b429773f3,network=Network(7a19d9ac-eff2-4fff-b74e-caad307b52ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f550175-ab')
Aug 09 16:52:51 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Deleting instance files /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2_del
Aug 09 16:52:51 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Deletion of /opt/stack/data/nova/instances/b9639ddc-0ff9-41d2-b647-3af5fce945c2_del complete
Aug 09 16:52:51 user nova-compute[73091]: INFO nova.compute.manager [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 16:52:51 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:52:51 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:52:51 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:52:51 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:52:51 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Took 0.50 seconds to deallocate network for instance.
Aug 09 16:52:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:52 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:52:52 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:52:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:52 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Deleted allocations for instance b9639ddc-0ff9-41d2-b647-3af5fce945c2
Aug 09 16:52:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff4943b7-e3cb-401f-9b12-1b3c2f58e820 tempest-TestStampPattern-1011496614 tempest-TestStampPattern-1011496614-project-member] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.828s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-84aa7b9a-7f4b-4940-ab99-6840d26bd37b req-2b709ebe-8385-4153-8dee-c7c34fd46c53 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Received event network-vif-unplugged-4f550175-ab3c-4b43-9a63-fd5b429773f3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:52:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-84aa7b9a-7f4b-4940-ab99-6840d26bd37b req-2b709ebe-8385-4153-8dee-c7c34fd46c53 service nova] Acquiring lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-84aa7b9a-7f4b-4940-ab99-6840d26bd37b req-2b709ebe-8385-4153-8dee-c7c34fd46c53 service nova] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-84aa7b9a-7f4b-4940-ab99-6840d26bd37b req-2b709ebe-8385-4153-8dee-c7c34fd46c53 service nova] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-84aa7b9a-7f4b-4940-ab99-6840d26bd37b req-2b709ebe-8385-4153-8dee-c7c34fd46c53 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] No waiting events found dispatching network-vif-unplugged-4f550175-ab3c-4b43-9a63-fd5b429773f3 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:52:52 user nova-compute[73091]: WARNING nova.compute.manager [req-84aa7b9a-7f4b-4940-ab99-6840d26bd37b req-2b709ebe-8385-4153-8dee-c7c34fd46c53 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Received unexpected event network-vif-unplugged-4f550175-ab3c-4b43-9a63-fd5b429773f3 for instance with vm_state deleted and task_state None.
Aug 09 16:52:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-84aa7b9a-7f4b-4940-ab99-6840d26bd37b req-2b709ebe-8385-4153-8dee-c7c34fd46c53 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Received event network-vif-plugged-4f550175-ab3c-4b43-9a63-fd5b429773f3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:52:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-84aa7b9a-7f4b-4940-ab99-6840d26bd37b req-2b709ebe-8385-4153-8dee-c7c34fd46c53 service nova] Acquiring lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:52:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-84aa7b9a-7f4b-4940-ab99-6840d26bd37b req-2b709ebe-8385-4153-8dee-c7c34fd46c53 service nova] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:52:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-84aa7b9a-7f4b-4940-ab99-6840d26bd37b req-2b709ebe-8385-4153-8dee-c7c34fd46c53 service nova] Lock "b9639ddc-0ff9-41d2-b647-3af5fce945c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:52:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-84aa7b9a-7f4b-4940-ab99-6840d26bd37b req-2b709ebe-8385-4153-8dee-c7c34fd46c53 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] No waiting events found dispatching network-vif-plugged-4f550175-ab3c-4b43-9a63-fd5b429773f3 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:52:52 user nova-compute[73091]: WARNING nova.compute.manager [req-84aa7b9a-7f4b-4940-ab99-6840d26bd37b req-2b709ebe-8385-4153-8dee-c7c34fd46c53 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Received unexpected event network-vif-plugged-4f550175-ab3c-4b43-9a63-fd5b429773f3 for instance with vm_state deleted and task_state None.
Aug 09 16:52:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-84aa7b9a-7f4b-4940-ab99-6840d26bd37b req-2b709ebe-8385-4153-8dee-c7c34fd46c53 service nova] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Received event network-vif-deleted-4f550175-ab3c-4b43-9a63-fd5b429773f3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:52:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:52:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-ad5b2478-2752-4c0d-a99e-96e2bcef4a27 req-e64b9d6a-f3cd-49a3-aa9a-74539ead3631 service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Received event network-changed-b71c68c4-ac11-4419-8933-e51e7606370c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:52:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-ad5b2478-2752-4c0d-a99e-96e2bcef4a27 req-e64b9d6a-f3cd-49a3-aa9a-74539ead3631 service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Refreshing instance network info cache due to event network-changed-b71c68c4-ac11-4419-8933-e51e7606370c. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:52:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ad5b2478-2752-4c0d-a99e-96e2bcef4a27 req-e64b9d6a-f3cd-49a3-aa9a-74539ead3631 service nova] Acquiring lock "refresh_cache-bfb5340a-2329-4bd2-9f94-52ef24967a9b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:52:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ad5b2478-2752-4c0d-a99e-96e2bcef4a27 req-e64b9d6a-f3cd-49a3-aa9a-74539ead3631 service nova] Acquired lock "refresh_cache-bfb5340a-2329-4bd2-9f94-52ef24967a9b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:52:59 user nova-compute[73091]: DEBUG nova.network.neutron [req-ad5b2478-2752-4c0d-a99e-96e2bcef4a27 req-e64b9d6a-f3cd-49a3-aa9a-74539ead3631 service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Refreshing network info cache for port b71c68c4-ac11-4419-8933-e51e7606370c {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:53:00 user nova-compute[73091]: DEBUG nova.network.neutron [req-ad5b2478-2752-4c0d-a99e-96e2bcef4a27 req-e64b9d6a-f3cd-49a3-aa9a-74539ead3631 service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Updated VIF entry in instance network info cache for port b71c68c4-ac11-4419-8933-e51e7606370c. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:53:00 user nova-compute[73091]: DEBUG nova.network.neutron [req-ad5b2478-2752-4c0d-a99e-96e2bcef4a27 req-e64b9d6a-f3cd-49a3-aa9a-74539ead3631 service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Updating instance_info_cache with network_info: [{"id": "b71c68c4-ac11-4419-8933-e51e7606370c", "address": "fa:16:3e:67:84:8e", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71c68c4-ac", "ovs_interfaceid": "b71c68c4-ac11-4419-8933-e51e7606370c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:53:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ad5b2478-2752-4c0d-a99e-96e2bcef4a27 req-e64b9d6a-f3cd-49a3-aa9a-74539ead3631 service nova] Releasing lock "refresh_cache-bfb5340a-2329-4bd2-9f94-52ef24967a9b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:53:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:53:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:53:00 user nova-compute[73091]: INFO nova.compute.claims [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Claim successful on node user
Aug 09 16:53:00 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:53:00 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG nova.network.neutron [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:53:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:53:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG nova.policy [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a5c393d644c4c3f8e9cbb0805ba7c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f2275630ce4d55bf02851df830b6bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:53:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Creating image(s)
Aug 09 16:53:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "/opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "/opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.160s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk 1073741824" returned: 0 in 0.052s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.149s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:53:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:02 user nova-compute[73091]: DEBUG nova.network.neutron [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Successfully created port: 0acd9658-83ff-499d-8a65-12cb09854bce {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:53:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:02 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Cannot resize image /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:53:02 user nova-compute[73091]: DEBUG nova.objects.instance [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'migration_context' on Instance uuid fd3ac804-7b4d-43a0-9837-20a98ea7615d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:53:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:53:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Ensure instance console log exists: /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:53:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:02 user nova-compute[73091]: INFO nova.compute.manager [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Rescuing
Aug 09 16:53:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:53:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquired lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:53:02 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:53:02 user nova-compute[73091]: DEBUG nova.network.neutron [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Successfully updated port: 0acd9658-83ff-499d-8a65-12cb09854bce {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:53:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "refresh_cache-fd3ac804-7b4d-43a0-9837-20a98ea7615d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:53:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquired lock "refresh_cache-fd3ac804-7b4d-43a0-9837-20a98ea7615d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:53:02 user nova-compute[73091]: DEBUG nova.network.neutron [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:53:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-2f39151d-7f75-4f21-a9b0-46d55ea137d3 req-1ae9a022-d4bb-4bcb-adca-25ff089ec78c service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Received event network-changed-0acd9658-83ff-499d-8a65-12cb09854bce {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-2f39151d-7f75-4f21-a9b0-46d55ea137d3 req-1ae9a022-d4bb-4bcb-adca-25ff089ec78c service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Refreshing instance network info cache due to event network-changed-0acd9658-83ff-499d-8a65-12cb09854bce. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:53:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2f39151d-7f75-4f21-a9b0-46d55ea137d3 req-1ae9a022-d4bb-4bcb-adca-25ff089ec78c service nova] Acquiring lock "refresh_cache-fd3ac804-7b4d-43a0-9837-20a98ea7615d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.network.neutron [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Updating instance_info_cache with network_info: [{"id": "58bf6094-42a8-4567-abea-27c63a57cf8a", "address": "fa:16:3e:f3:dd:72", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf6094-42", "ovs_interfaceid": "58bf6094-42a8-4567-abea-27c63a57cf8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Releasing lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.network.neutron [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Updating instance_info_cache with network_info: [{"id": "0acd9658-83ff-499d-8a65-12cb09854bce", "address": "fa:16:3e:5a:e0:5a", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acd9658-83", "ovs_interfaceid": "0acd9658-83ff-499d-8a65-12cb09854bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Releasing lock "refresh_cache-fd3ac804-7b4d-43a0-9837-20a98ea7615d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Instance network_info: |[{"id": "0acd9658-83ff-499d-8a65-12cb09854bce", "address": "fa:16:3e:5a:e0:5a", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acd9658-83", "ovs_interfaceid": "0acd9658-83ff-499d-8a65-12cb09854bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2f39151d-7f75-4f21-a9b0-46d55ea137d3 req-1ae9a022-d4bb-4bcb-adca-25ff089ec78c service nova] Acquired lock "refresh_cache-fd3ac804-7b4d-43a0-9837-20a98ea7615d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.network.neutron [req-2f39151d-7f75-4f21-a9b0-46d55ea137d3 req-1ae9a022-d4bb-4bcb-adca-25ff089ec78c service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Refreshing network info cache for port 0acd9658-83ff-499d-8a65-12cb09854bce {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Start _get_guest_xml network_info=[{"id": "0acd9658-83ff-499d-8a65-12cb09854bce", "address": "fa:16:3e:5a:e0:5a", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acd9658-83", "ovs_interfaceid": "0acd9658-83ff-499d-8a65-12cb09854bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:53:03 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:53:03 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:53:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:53:03 user nova-compute[73091]: INFO nova.compute.manager [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Terminating instance
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-58046610',display_name='tempest-AttachVolumeNegativeTest-server-58046610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-58046610',id=41,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdAs15mqWwWBbPw5gJ8JGWIMLow80uN+Dwt0s16I5QiQyetMRrTMVBCP/rMPAoMI2IEcsFdfbJS9IUUNwwkd0byKG4abUBY1803wqwqoypqD4AgVcfmPNPEBsA+/FhsXw==',key_name='tempest-keypair-256076905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27f2275630ce4d55bf02851df830b6bd',ramdisk_id='',reservation_id='r-ghol9mvh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-604747333',owner_user_name='tempest-AttachVolumeNegativeTest-604747333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:53:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a5c393d644c4c3f8e9cbb0805ba7c08',uuid=fd3ac804-7b4d-43a0-9837-20a98ea7615d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0acd9658-83ff-499d-8a65-12cb09854bce", "address": "fa:16:3e:5a:e0:5a", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acd9658-83", "ovs_interfaceid": "0acd9658-83ff-499d-8a65-12cb09854bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converting VIF {"id": "0acd9658-83ff-499d-8a65-12cb09854bce", "address": "fa:16:3e:5a:e0:5a", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acd9658-83", "ovs_interfaceid": "0acd9658-83ff-499d-8a65-12cb09854bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e0:5a,bridge_name='br-int',has_traffic_filtering=True,id=0acd9658-83ff-499d-8a65-12cb09854bce,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0acd9658-83') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.objects.instance [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'pci_devices' on Instance uuid fd3ac804-7b4d-43a0-9837-20a98ea7615d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:53:03 user nova-compute[73091]:   <uuid>fd3ac804-7b4d-43a0-9837-20a98ea7615d</uuid>
Aug 09 16:53:03 user nova-compute[73091]:   <name>instance-00000029</name>
Aug 09 16:53:03 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:53:03 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:53:03 user nova-compute[73091]:   <metadata>
Aug 09 16:53:03 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:53:03 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:53:03 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeNegativeTest-server-58046610</nova:name>
Aug 09 16:53:03 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:53:03</nova:creationTime>
Aug 09 16:53:03 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:53:03 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:53:03 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:53:03 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:53:03 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:53:03 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:53:03 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:53:03 user nova-compute[73091]:       <nova:owner>
Aug 09 16:53:03 user nova-compute[73091]:         <nova:user uuid="8a5c393d644c4c3f8e9cbb0805ba7c08">tempest-AttachVolumeNegativeTest-604747333-project-member</nova:user>
Aug 09 16:53:03 user nova-compute[73091]:         <nova:project uuid="27f2275630ce4d55bf02851df830b6bd">tempest-AttachVolumeNegativeTest-604747333</nova:project>
Aug 09 16:53:03 user nova-compute[73091]:       </nova:owner>
Aug 09 16:53:03 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:53:03 user nova-compute[73091]:       <nova:ports>
Aug 09 16:53:03 user nova-compute[73091]:         <nova:port uuid="0acd9658-83ff-499d-8a65-12cb09854bce">
Aug 09 16:53:03 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 16:53:03 user nova-compute[73091]:         </nova:port>
Aug 09 16:53:03 user nova-compute[73091]:       </nova:ports>
Aug 09 16:53:03 user nova-compute[73091]:     </nova:instance>
Aug 09 16:53:03 user nova-compute[73091]:   </metadata>
Aug 09 16:53:03 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:53:03 user nova-compute[73091]:     <system>
Aug 09 16:53:03 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:53:03 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:53:03 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:53:03 user nova-compute[73091]:       <entry name="serial">fd3ac804-7b4d-43a0-9837-20a98ea7615d</entry>
Aug 09 16:53:03 user nova-compute[73091]:       <entry name="uuid">fd3ac804-7b4d-43a0-9837-20a98ea7615d</entry>
Aug 09 16:53:03 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:53:03 user nova-compute[73091]:     </system>
Aug 09 16:53:03 user nova-compute[73091]:   </sysinfo>
Aug 09 16:53:03 user nova-compute[73091]:   <os>
Aug 09 16:53:03 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:53:03 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:53:03 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:53:03 user nova-compute[73091]:   </os>
Aug 09 16:53:03 user nova-compute[73091]:   <features>
Aug 09 16:53:03 user nova-compute[73091]:     <acpi/>
Aug 09 16:53:03 user nova-compute[73091]:     <apic/>
Aug 09 16:53:03 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:53:03 user nova-compute[73091]:   </features>
Aug 09 16:53:03 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:53:03 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:53:03 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:53:03 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:53:03 user nova-compute[73091]:   </clock>
Aug 09 16:53:03 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:53:03 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:53:03 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:53:03 user nova-compute[73091]:   </cpu>
Aug 09 16:53:03 user nova-compute[73091]:   <devices>
Aug 09 16:53:03 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:53:03 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:53:03 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk"/>
Aug 09 16:53:03 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:53:03 user nova-compute[73091]:     </disk>
Aug 09 16:53:03 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:53:03 user nova-compute[73091]:       <mac address="fa:16:3e:5a:e0:5a"/>
Aug 09 16:53:03 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:53:03 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:53:03 user nova-compute[73091]:       <target dev="tap0acd9658-83"/>
Aug 09 16:53:03 user nova-compute[73091]:     </interface>
Aug 09 16:53:03 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:53:03 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/console.log" append="off"/>
Aug 09 16:53:03 user nova-compute[73091]:     </serial>
Aug 09 16:53:03 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:53:03 user nova-compute[73091]:     <video>
Aug 09 16:53:03 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:53:03 user nova-compute[73091]:     </video>
Aug 09 16:53:03 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:53:03 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:53:03 user nova-compute[73091]:     </rng>
Aug 09 16:53:03 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:53:03 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:53:03 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:53:03 user nova-compute[73091]:     </memballoon>
Aug 09 16:53:03 user nova-compute[73091]:   </devices>
Aug 09 16:53:03 user nova-compute[73091]: </domain>
Aug 09 16:53:03 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-58046610',display_name='tempest-AttachVolumeNegativeTest-server-58046610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-58046610',id=41,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdAs15mqWwWBbPw5gJ8JGWIMLow80uN+Dwt0s16I5QiQyetMRrTMVBCP/rMPAoMI2IEcsFdfbJS9IUUNwwkd0byKG4abUBY1803wqwqoypqD4AgVcfmPNPEBsA+/FhsXw==',key_name='tempest-keypair-256076905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27f2275630ce4d55bf02851df830b6bd',ramdisk_id='',reservation_id='r-ghol9mvh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-604747333',owner_user_name='tempest-AttachVolumeNegativeTest-604747333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:53:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a5c393d644c4c3f8e9cbb0805ba7c08',uuid=fd3ac804-7b4d-43a0-9837-20a98ea7615d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0acd9658-83ff-499d-8a65-12cb09854bce", "address": "fa:16:3e:5a:e0:5a", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acd9658-83", "ovs_interfaceid": "0acd9658-83ff-499d-8a65-12cb09854bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converting VIF {"id": "0acd9658-83ff-499d-8a65-12cb09854bce", "address": "fa:16:3e:5a:e0:5a", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acd9658-83", "ovs_interfaceid": "0acd9658-83ff-499d-8a65-12cb09854bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e0:5a,bridge_name='br-int',has_traffic_filtering=True,id=0acd9658-83ff-499d-8a65-12cb09854bce,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0acd9658-83') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG os_vif [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e0:5a,bridge_name='br-int',has_traffic_filtering=True,id=0acd9658-83ff-499d-8a65-12cb09854bce,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0acd9658-83') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0acd9658-83, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0acd9658-83, col_values=(('external_ids', {'iface-id': '0acd9658-83ff-499d-8a65-12cb09854bce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:e0:5a', 'vm-uuid': 'fd3ac804-7b4d-43a0-9837-20a98ea7615d'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:03 user nova-compute[73091]: INFO os_vif [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e0:5a,bridge_name='br-int',has_traffic_filtering=True,id=0acd9658-83ff-499d-8a65-12cb09854bce,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0acd9658-83')
Aug 09 16:53:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] No VIF found with MAC fa:16:3e:5a:e0:5a, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:53:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-13ad8ad5-1077-4c2d-b195-42a8ca55dd4c req-1c1b7a0e-7e3e-4547-9acf-adc95117ea6f service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Received event network-vif-unplugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-13ad8ad5-1077-4c2d-b195-42a8ca55dd4c req-1c1b7a0e-7e3e-4547-9acf-adc95117ea6f service nova] Acquiring lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-13ad8ad5-1077-4c2d-b195-42a8ca55dd4c req-1c1b7a0e-7e3e-4547-9acf-adc95117ea6f service nova] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-13ad8ad5-1077-4c2d-b195-42a8ca55dd4c req-1c1b7a0e-7e3e-4547-9acf-adc95117ea6f service nova] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-13ad8ad5-1077-4c2d-b195-42a8ca55dd4c req-1c1b7a0e-7e3e-4547-9acf-adc95117ea6f service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] No waiting events found dispatching network-vif-unplugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:53:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-13ad8ad5-1077-4c2d-b195-42a8ca55dd4c req-1c1b7a0e-7e3e-4547-9acf-adc95117ea6f service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Received event network-vif-unplugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:53:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Instance destroyed successfully.
Aug 09 16:53:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Attempting a stable device rescue
Aug 09 16:53:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73091) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 16:53:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 16:53:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Creating image(s)
Aug 09 16:53:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "/opt/stack/data/nova/instances/76055017-05ff-4ea7-ae9c-66d2e502e090/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "/opt/stack/data/nova/instances/76055017-05ff-4ea7-ae9c-66d2e502e090/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "/opt/stack/data/nova/instances/76055017-05ff-4ea7-ae9c-66d2e502e090/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:04 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'trusted_certs' on Instance uuid 76055017-05ff-4ea7-ae9c-66d2e502e090 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:53:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "045679c5680831b6044b74c1b3ccd1dd702831e6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "045679c5680831b6044b74c1b3ccd1dd702831e6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/045679c5680831b6044b74c1b3ccd1dd702831e6.part --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-269665fc-5be2-41bb-b223-ab371cb27d1c req-9d6d37ba-f359-4a91-91f1-02627bc29c6d service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received event network-vif-unplugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-269665fc-5be2-41bb-b223-ab371cb27d1c req-9d6d37ba-f359-4a91-91f1-02627bc29c6d service nova] Acquiring lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-269665fc-5be2-41bb-b223-ab371cb27d1c req-9d6d37ba-f359-4a91-91f1-02627bc29c6d service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-269665fc-5be2-41bb-b223-ab371cb27d1c req-9d6d37ba-f359-4a91-91f1-02627bc29c6d service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-269665fc-5be2-41bb-b223-ab371cb27d1c req-9d6d37ba-f359-4a91-91f1-02627bc29c6d service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] No waiting events found dispatching network-vif-unplugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:53:05 user nova-compute[73091]: WARNING nova.compute.manager [req-269665fc-5be2-41bb-b223-ab371cb27d1c req-9d6d37ba-f359-4a91-91f1-02627bc29c6d service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received unexpected event network-vif-unplugged-58bf6094-42a8-4567-abea-27c63a57cf8a for instance with vm_state active and task_state rescuing.
Aug 09 16:53:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-269665fc-5be2-41bb-b223-ab371cb27d1c req-9d6d37ba-f359-4a91-91f1-02627bc29c6d service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received event network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-269665fc-5be2-41bb-b223-ab371cb27d1c req-9d6d37ba-f359-4a91-91f1-02627bc29c6d service nova] Acquiring lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-269665fc-5be2-41bb-b223-ab371cb27d1c req-9d6d37ba-f359-4a91-91f1-02627bc29c6d service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-269665fc-5be2-41bb-b223-ab371cb27d1c req-9d6d37ba-f359-4a91-91f1-02627bc29c6d service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-269665fc-5be2-41bb-b223-ab371cb27d1c req-9d6d37ba-f359-4a91-91f1-02627bc29c6d service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] No waiting events found dispatching network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:53:05 user nova-compute[73091]: WARNING nova.compute.manager [req-269665fc-5be2-41bb-b223-ab371cb27d1c req-9d6d37ba-f359-4a91-91f1-02627bc29c6d service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received unexpected event network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a for instance with vm_state active and task_state rescuing.
Aug 09 16:53:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Instance destroyed successfully.
Aug 09 16:53:06 user nova-compute[73091]: DEBUG nova.objects.instance [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lazy-loading 'resources' on Instance uuid 18d8e887-0f91-42e1-ba79-13db5aa9b84b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T16:36:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1364187165',display_name='tempest-ServerActionsTestOtherA-server-1013159509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1364187165',id=13,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILfado63mW6+CgjHmwYiNct4RkaQ/hFrQzjzGZX9fcd5tmDChxbl9riU31kjgrW3xhMcxzy/FY8sPsumtyuqQ7ittcRZasxYBvL6XWrt/5jr8BpeJz8IvTq6jqpzExzYw==',key_name='tempest-keypair-1434010925',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:40:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38c913ceef2c4610a26bd19df29ee896',ramdisk_id='',reservation_id='r-m5ng6wc3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-813213856',owner_user_name='tempest-ServerActionsTestOtherA-813213856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:40:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8956fad221ec4dedb700f034d5230c06',uuid=18d8e887-0f91-42e1-ba79-13db5aa9b84b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converting VIF {"id": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "address": "fa:16:3e:45:c1:ba", "network": {"id": "afca16ef-970a-4bb4-8812-3287508153f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-597214137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c913ceef2c4610a26bd19df29ee896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c1bb8c-58", "ovs_interfaceid": "54c1bb8c-584f-446c-9b64-c840c486a4f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:c1:ba,bridge_name='br-int',has_traffic_filtering=True,id=54c1bb8c-584f-446c-9b64-c840c486a4f1,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c1bb8c-58') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG os_vif [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:c1:ba,bridge_name='br-int',has_traffic_filtering=True,id=54c1bb8c-584f-446c-9b64-c840c486a4f1,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c1bb8c-58') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54c1bb8c-58, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/045679c5680831b6044b74c1b3ccd1dd702831e6.part --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG nova.virt.images [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] 4e18c016-1900-45f1-93f7-7d863624111a was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/045679c5680831b6044b74c1b3ccd1dd702831e6.part /opt/stack/data/nova/instances/_base/045679c5680831b6044b74c1b3ccd1dd702831e6.converted {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:53:06 user nova-compute[73091]: INFO os_vif [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:c1:ba,bridge_name='br-int',has_traffic_filtering=True,id=54c1bb8c-584f-446c-9b64-c840c486a4f1,network=Network(afca16ef-970a-4bb4-8812-3287508153f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c1bb8c-58')
Aug 09 16:53:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Deleting instance files /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b_del
Aug 09 16:53:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Deletion of /opt/stack/data/nova/instances/18d8e887-0f91-42e1-ba79-13db5aa9b84b_del complete
Aug 09 16:53:06 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599971.167667, b9639ddc-0ff9-41d2-b647-3af5fce945c2 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:53:06 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] VM Stopped (Lifecycle Event)
Aug 09 16:53:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e9f74313-adda-425b-b9b6-dba4249ea121 None None] [instance: b9639ddc-0ff9-41d2-b647-3af5fce945c2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-0cce4dcc-b88f-48c6-ba02-c7b782a2d3e0 req-1fc17ece-76fc-4347-8813-a42a127447ee service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Received event network-vif-plugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0cce4dcc-b88f-48c6-ba02-c7b782a2d3e0 req-1fc17ece-76fc-4347-8813-a42a127447ee service nova] Acquiring lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0cce4dcc-b88f-48c6-ba02-c7b782a2d3e0 req-1fc17ece-76fc-4347-8813-a42a127447ee service nova] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0cce4dcc-b88f-48c6-ba02-c7b782a2d3e0 req-1fc17ece-76fc-4347-8813-a42a127447ee service nova] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-0cce4dcc-b88f-48c6-ba02-c7b782a2d3e0 req-1fc17ece-76fc-4347-8813-a42a127447ee service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] No waiting events found dispatching network-vif-plugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:53:06 user nova-compute[73091]: WARNING nova.compute.manager [req-0cce4dcc-b88f-48c6-ba02-c7b782a2d3e0 req-1fc17ece-76fc-4347-8813-a42a127447ee service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Received unexpected event network-vif-plugged-54c1bb8c-584f-446c-9b64-c840c486a4f1 for instance with vm_state active and task_state deleting.
Aug 09 16:53:06 user nova-compute[73091]: DEBUG nova.network.neutron [req-2f39151d-7f75-4f21-a9b0-46d55ea137d3 req-1ae9a022-d4bb-4bcb-adca-25ff089ec78c service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Updated VIF entry in instance network info cache for port 0acd9658-83ff-499d-8a65-12cb09854bce. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG nova.network.neutron [req-2f39151d-7f75-4f21-a9b0-46d55ea137d3 req-1ae9a022-d4bb-4bcb-adca-25ff089ec78c service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Updating instance_info_cache with network_info: [{"id": "0acd9658-83ff-499d-8a65-12cb09854bce", "address": "fa:16:3e:5a:e0:5a", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acd9658-83", "ovs_interfaceid": "0acd9658-83ff-499d-8a65-12cb09854bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2f39151d-7f75-4f21-a9b0-46d55ea137d3 req-1ae9a022-d4bb-4bcb-adca-25ff089ec78c service nova] Releasing lock "refresh_cache-fd3ac804-7b4d-43a0-9837-20a98ea7615d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:53:06 user nova-compute[73091]: INFO nova.compute.manager [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Took 2.77 seconds to destroy the instance on the hypervisor.
Aug 09 16:53:06 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/045679c5680831b6044b74c1b3ccd1dd702831e6.part /opt/stack/data/nova/instances/_base/045679c5680831b6044b74c1b3ccd1dd702831e6.converted" returned: 0 in 0.715s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/045679c5680831b6044b74c1b3ccd1dd702831e6.converted --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/045679c5680831b6044b74c1b3ccd1dd702831e6.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "045679c5680831b6044b74c1b3ccd1dd702831e6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.574s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "045679c5680831b6044b74c1b3ccd1dd702831e6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "045679c5680831b6044b74c1b3ccd1dd702831e6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/045679c5680831b6044b74c1b3ccd1dd702831e6 --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:53:07 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Took 0.81 seconds to deallocate network for instance.
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-f7203923-03b2-42cf-8a69-cda85938b089 req-47596ff6-7b60-4d9e-afdd-2d5cce9d2818 service nova] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Received event network-vif-deleted-54c1bb8c-584f-446c-9b64-c840c486a4f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/045679c5680831b6044b74c1b3ccd1dd702831e6 --force-share --output=json" returned: 0 in 0.163s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/045679c5680831b6044b74c1b3ccd1dd702831e6,backing_fmt=raw /opt/stack/data/nova/instances/76055017-05ff-4ea7-ae9c-66d2e502e090/disk.rescue {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/045679c5680831b6044b74c1b3ccd1dd702831e6,backing_fmt=raw /opt/stack/data/nova/instances/76055017-05ff-4ea7-ae9c-66d2e502e090/disk.rescue" returned: 0 in 0.062s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "045679c5680831b6044b74c1b3ccd1dd702831e6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'migration_context' on Instance uuid 76055017-05ff-4ea7-ae9c-66d2e502e090 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Start _get_guest_xml network_info=[{"id": "58bf6094-42a8-4567-abea-27c63a57cf8a", "address": "fa:16:3e:f3:dd:72", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "vif_mac": "fa:16:3e:f3:dd:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf6094-42", "ovs_interfaceid": "58bf6094-42a8-4567-abea-27c63a57cf8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4e18c016-1900-45f1-93f7-7d863624111a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'b91ff362-4edf-4d57-9214-9d5633127543', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQivsqeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '76055017-05ff-4ea7-ae9c-66d2e502e090', 'attached_at': '', 'detached_at': '', 'volume_id': '06296a53-7a38-4d42-836c-f02cf17391b5', 'serial': '06296a53-7a38-4d42-836c-f02cf17391b5'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'resources' on Instance uuid 76055017-05ff-4ea7-ae9c-66d2e502e090 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'numa_topology' on Instance uuid 76055017-05ff-4ea7-ae9c-66d2e502e090 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:53:07 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:53:07 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'vcpu_model' on Instance uuid 76055017-05ff-4ea7-ae9c-66d2e502e090 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQivsqeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:53:07 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:53:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:53:07 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:53:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:53:07 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6429b3-e9e8-4b71-8056-d75389656f30]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = EQivsqeH\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 16:53:07 user nova-compute[73091]: node.name = iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5
Aug 09 16:53:07 user nova-compute[73091]: node.tpgt = -1
Aug 09 16:53:07 user nova-compute[73091]: node.startup = automatic
Aug 09 16:53:07 user nova-compute[73091]: node.leading_login = No
Aug 09 16:53:07 user nova-compute[73091]: iface.iscsi_ifacename = default
Aug 09 16:53:07 user nova-compute[73091]: iface.net_ifacename = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.ipaddress = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.prefix_len = 0
Aug 09 16:53:07 user nova-compute[73091]: iface.hwaddress = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.transport_name = tcp
Aug 09 16:53:07 user nova-compute[73091]: iface.initiatorname = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.state = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.vlan_id = 0
Aug 09 16:53:07 user nova-compute[73091]: iface.vlan_priority = 0
Aug 09 16:53:07 user nova-compute[73091]: iface.vlan_state = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.iface_num = 0
Aug 09 16:53:07 user nova-compute[73091]: iface.mtu = 0
Aug 09 16:53:07 user nova-compute[73091]: iface.port = 0
Aug 09 16:53:07 user nova-compute[73091]: iface.bootproto = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.subnet_mask = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.gateway = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.dhcp_alt_client_id = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.dhcp_dns = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.dhcp_learn_iqn = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.dhcp_vendor_id_state = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.dhcp_vendor_id = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.dhcp_slp_da = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.fragmentation = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.gratuitous_arp = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.incoming_forwarding = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.tos_state = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.tos = 0
Aug 09 16:53:07 user nova-compute[73091]: iface.ttl = 0
Aug 09 16:53:07 user nova-compute[73091]: iface.delayed_ack = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.tcp_nagle = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.tcp_wsf_state = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.tcp_wsf = 0
Aug 09 16:53:07 user nova-compute[73091]: iface.tcp_timer_scale = 0
Aug 09 16:53:07 user nova-compute[73091]: iface.tcp_timestamp = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.redirect = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.def_task_mgmt_timeout = 0
Aug 09 16:53:07 user nova-compute[73091]: iface.header_digest = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.data_digest = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.immediate_data = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.initial_r2t = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.data_seq_inorder = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.data_pdu_inorder = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.erl = 0
Aug 09 16:53:07 user nova-compute[73091]: iface.max_receive_data_len = 0
Aug 09 16:53:07 user nova-compute[73091]: iface.first_burst_len = 0
Aug 09 16:53:07 user nova-compute[73091]: iface.max_outstanding_r2t = 0
Aug 09 16:53:07 user nova-compute[73091]: iface.max_burst_len = 0
Aug 09 16:53:07 user nova-compute[73091]: iface.chap_auth = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.bidi_chap = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.strict_login_compliance = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.discovery_auth = <empty>
Aug 09 16:53:07 user nova-compute[73091]: iface.discovery_logout = <empty>
Aug 09 16:53:07 user nova-compute[73091]: node.discovery_address = <empty>
Aug 09 16:53:07 user nova-compute[73091]: node.discovery_port = 0
Aug 09 16:53:07 user nova-compute[73091]: node.discovery_type = static
Aug 09 16:53:07 user nova-compute[73091]: node.session.initial_cmdsn = 0
Aug 09 16:53:07 user nova-compute[73091]: node.session.initial_login_retry_max = 8
Aug 09 16:53:07 user nova-compute[73091]: node.session.xmit_thread_priority = -20
Aug 09 16:53:07 user nova-compute[73091]: node.session.cmds_max = 128
Aug 09 16:53:07 user nova-compute[73091]: node.session.queue_depth = 32
Aug 09 16:53:07 user nova-compute[73091]: node.session.nr_sessions = 1
Aug 09 16:53:07 user nova-compute[73091]: node.session.auth.authmethod = CHAP
Aug 09 16:53:07 user nova-compute[73091]: node.session.auth.username = EQivsqeH
Aug 09 16:53:07 user nova-compute[73091]: node.session.auth.password = ***
Aug 09 16:53:07 user nova-compute[73091]: node.session.auth.username_in = <empty>
Aug 09 16:53:07 user nova-compute[73091]: node.session.auth.password_in = <empty>
Aug 09 16:53:07 user nova-compute[73091]: node.session.auth.chap_algs = MD5
Aug 09 16:53:07 user nova-compute[73091]: node.session.timeo.replacement_timeout = 120
Aug 09 16:53:07 user nova-compute[73091]: node.session.err_timeo.abort_timeout = 15
Aug 09 16:53:07 user nova-compute[73091]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 16:53:07 user nova-compute[73091]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 16:53:07 user nova-compute[73091]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 16:53:07 user nova-compute[73091]: node.session.iscsi.FastAbort = Yes
Aug 09 16:53:07 user nova-compute[73091]: node.session.iscsi.InitialR2T = No
Aug 09 16:53:07 user nova-compute[73091]: node.session.iscsi.ImmediateData = Yes
Aug 09 16:53:07 user nova-compute[73091]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 16:53:07 user nova-compute[73091]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 16:53:07 user nova-compute[73091]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 16:53:07 user nova-compute[73091]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 16:53:07 user nova-compute[73091]: node.session.iscsi.MaxConnections = 1
Aug 09 16:53:07 user nova-compute[73091]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 16:53:07 user nova-compute[73091]: node.session.iscsi.ERL = 0
Aug 09 16:53:07 user nova-compute[73091]: node.session.scan = manual
Aug 09 16:53:07 user nova-compute[73091]: node.session.reopen_max = 0
Aug 09 16:53:07 user nova-compute[73091]: node.conn[0].address = 172.16.0.220
Aug 09 16:53:07 user nova-compute[73091]: node.conn[0].port = 3260
Aug 09 16:53:07 user nova-compute[73091]: node.conn[0].startup = manual
Aug 09 16:53:07 user nova-compute[73091]: node.conn[0].tcp.window_size = 524288
Aug 09 16:53:07 user nova-compute[73091]: node.conn[0].tcp.type_of_service = 0
Aug 09 16:53:07 user nova-compute[73091]: node.conn[0].timeo.logout_timeout = 15
Aug 09 16:53:07 user nova-compute[73091]: node.conn[0].timeo.login_timeout = 15
Aug 09 16:53:07 user nova-compute[73091]: node.conn[0].timeo.auth_timeout = 45
Aug 09 16:53:07 user nova-compute[73091]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 16:53:07 user nova-compute[73091]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 16:53:07 user nova-compute[73091]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 16:53:07 user nova-compute[73091]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 16:53:07 user nova-compute[73091]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 16:53:07 user nova-compute[73091]: node.conn[0].iscsi.DataDigest = None
Aug 09 16:53:07 user nova-compute[73091]: node.conn[0].iscsi.IFMarker = No
Aug 09 16:53:07 user nova-compute[73091]: node.conn[0].iscsi.OFMarker = No
Aug 09 16:53:07 user nova-compute[73091]: # END RECORD
Aug 09 16:53:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7f5b18-0e3f-4c1d-b0a9-b921c17a2358]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63aa8da-97f2-4aee-9b12-3b5806ead787]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EQivsqeH {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EQivsqeH" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a47147-c44f-4541-8882-85824874c282]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EQivsqeH'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8a9735-6ddb-400e-a63b-e491de60daa1]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f17f4d8-ea17-4313-b05d-9d6099831ba2]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:53:07 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:53:07 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:53:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:53:07 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:53:07 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:53:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.172s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] HCTL ('35', '0', '0', 0) found on session 43 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3a199f-0884-4610-8f6d-5b5140a02f5e]: (4, ('0 0 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Searching for a device in session 43 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQivsqeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.206s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] <== connect_volume: return (208ms) {'type': 'block', 'scsi_wwn': '23437366337323766', 'path': '/dev/sdd'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437366337323766', 'path': '/dev/sdd'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-778120530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-778120530',id=40,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:51:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39308f2160f14a1cb5ee136458054726',ramdisk_id='',reservation_id='r-i2p91t84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:51:33Z,user_data=None,user_id='1b831573c2594072890b548abda013e3',uuid=76055017-05ff-4ea7-ae9c-66d2e502e090,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58bf6094-42a8-4567-abea-27c63a57cf8a", "address": "fa:16:3e:f3:dd:72", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "vif_mac": "fa:16:3e:f3:dd:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf6094-42", "ovs_interfaceid": "58bf6094-42a8-4567-abea-27c63a57cf8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converting VIF {"id": "58bf6094-42a8-4567-abea-27c63a57cf8a", "address": "fa:16:3e:f3:dd:72", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "vif_mac": "fa:16:3e:f3:dd:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf6094-42", "ovs_interfaceid": "58bf6094-42a8-4567-abea-27c63a57cf8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:dd:72,bridge_name='br-int',has_traffic_filtering=True,id=58bf6094-42a8-4567-abea-27c63a57cf8a,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58bf6094-42') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'pci_devices' on Instance uuid 76055017-05ff-4ea7-ae9c-66d2e502e090 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:53:07 user nova-compute[73091]:   <uuid>76055017-05ff-4ea7-ae9c-66d2e502e090</uuid>
Aug 09 16:53:07 user nova-compute[73091]:   <name>instance-00000028</name>
Aug 09 16:53:07 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:53:07 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:53:07 user nova-compute[73091]:   <metadata>
Aug 09 16:53:07 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:53:07 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:53:07 user nova-compute[73091]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-778120530</nova:name>
Aug 09 16:53:07 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:53:07</nova:creationTime>
Aug 09 16:53:07 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:53:07 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:53:07 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:53:07 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:53:07 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:53:07 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:53:07 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:53:07 user nova-compute[73091]:       <nova:owner>
Aug 09 16:53:07 user nova-compute[73091]:         <nova:user uuid="1b831573c2594072890b548abda013e3">tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member</nova:user>
Aug 09 16:53:07 user nova-compute[73091]:         <nova:project uuid="39308f2160f14a1cb5ee136458054726">tempest-ServerBootFromVolumeStableRescueTest-1999746022</nova:project>
Aug 09 16:53:07 user nova-compute[73091]:       </nova:owner>
Aug 09 16:53:07 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:53:07 user nova-compute[73091]:       <nova:ports>
Aug 09 16:53:07 user nova-compute[73091]:         <nova:port uuid="58bf6094-42a8-4567-abea-27c63a57cf8a">
Aug 09 16:53:07 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 16:53:07 user nova-compute[73091]:         </nova:port>
Aug 09 16:53:07 user nova-compute[73091]:       </nova:ports>
Aug 09 16:53:07 user nova-compute[73091]:     </nova:instance>
Aug 09 16:53:07 user nova-compute[73091]:   </metadata>
Aug 09 16:53:07 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:53:07 user nova-compute[73091]:     <system>
Aug 09 16:53:07 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:53:07 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:53:07 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:53:07 user nova-compute[73091]:       <entry name="serial">76055017-05ff-4ea7-ae9c-66d2e502e090</entry>
Aug 09 16:53:07 user nova-compute[73091]:       <entry name="uuid">76055017-05ff-4ea7-ae9c-66d2e502e090</entry>
Aug 09 16:53:07 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:53:07 user nova-compute[73091]:     </system>
Aug 09 16:53:07 user nova-compute[73091]:   </sysinfo>
Aug 09 16:53:07 user nova-compute[73091]:   <os>
Aug 09 16:53:07 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:53:07 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:53:07 user nova-compute[73091]:   </os>
Aug 09 16:53:07 user nova-compute[73091]:   <features>
Aug 09 16:53:07 user nova-compute[73091]:     <acpi/>
Aug 09 16:53:07 user nova-compute[73091]:     <apic/>
Aug 09 16:53:07 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:53:07 user nova-compute[73091]:   </features>
Aug 09 16:53:07 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:53:07 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:53:07 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:53:07 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:53:07 user nova-compute[73091]:   </clock>
Aug 09 16:53:07 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:53:07 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:53:07 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:53:07 user nova-compute[73091]:   </cpu>
Aug 09 16:53:07 user nova-compute[73091]:   <devices>
Aug 09 16:53:07 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:53:07 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:53:07 user nova-compute[73091]:       <source dev="/dev/sdd"/>
Aug 09 16:53:07 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:53:07 user nova-compute[73091]:       <serial>06296a53-7a38-4d42-836c-f02cf17391b5</serial>
Aug 09 16:53:07 user nova-compute[73091]:     </disk>
Aug 09 16:53:07 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:53:07 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:53:07 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/76055017-05ff-4ea7-ae9c-66d2e502e090/disk.rescue"/>
Aug 09 16:53:07 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 09 16:53:07 user nova-compute[73091]:       <boot order="1"/>
Aug 09 16:53:07 user nova-compute[73091]:     </disk>
Aug 09 16:53:07 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:53:07 user nova-compute[73091]:       <mac address="fa:16:3e:f3:dd:72"/>
Aug 09 16:53:07 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:53:07 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:53:07 user nova-compute[73091]:       <target dev="tap58bf6094-42"/>
Aug 09 16:53:07 user nova-compute[73091]:     </interface>
Aug 09 16:53:07 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:53:07 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/76055017-05ff-4ea7-ae9c-66d2e502e090/console.log" append="off"/>
Aug 09 16:53:07 user nova-compute[73091]:     </serial>
Aug 09 16:53:07 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:53:07 user nova-compute[73091]:     <video>
Aug 09 16:53:07 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:53:07 user nova-compute[73091]:     </video>
Aug 09 16:53:07 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:53:07 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:53:07 user nova-compute[73091]:     </rng>
Aug 09 16:53:07 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:53:07 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:53:07 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:53:07 user nova-compute[73091]:     </memballoon>
Aug 09 16:53:07 user nova-compute[73091]:   </devices>
Aug 09 16:53:07 user nova-compute[73091]: </domain>
Aug 09 16:53:07 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:53:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Instance destroyed successfully.
Aug 09 16:53:07 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Deleted allocations for instance 18d8e887-0f91-42e1-ba79-13db5aa9b84b
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] No VIF found with MAC fa:16:3e:f3:dd:72, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:53:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17c771e1-0d9f-4fac-a064-45ac7cd2c496 tempest-ServerActionsTestOtherA-813213856 tempest-ServerActionsTestOtherA-813213856-project-member] Lock "18d8e887-0f91-42e1-ba79-13db5aa9b84b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.241s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-a9b6ef0f-66f7-4d8e-a59e-6804b547fd11 req-6d019e1c-5fa5-44a5-a72b-2fe0c0d34551 service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Received event network-vif-plugged-0acd9658-83ff-499d-8a65-12cb09854bce {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9b6ef0f-66f7-4d8e-a59e-6804b547fd11 req-6d019e1c-5fa5-44a5-a72b-2fe0c0d34551 service nova] Acquiring lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9b6ef0f-66f7-4d8e-a59e-6804b547fd11 req-6d019e1c-5fa5-44a5-a72b-2fe0c0d34551 service nova] Lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9b6ef0f-66f7-4d8e-a59e-6804b547fd11 req-6d019e1c-5fa5-44a5-a72b-2fe0c0d34551 service nova] Lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-a9b6ef0f-66f7-4d8e-a59e-6804b547fd11 req-6d019e1c-5fa5-44a5-a72b-2fe0c0d34551 service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] No waiting events found dispatching network-vif-plugged-0acd9658-83ff-499d-8a65-12cb09854bce {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:53:08 user nova-compute[73091]: WARNING nova.compute.manager [req-a9b6ef0f-66f7-4d8e-a59e-6804b547fd11 req-6d019e1c-5fa5-44a5-a72b-2fe0c0d34551 service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Received unexpected event network-vif-plugged-0acd9658-83ff-499d-8a65-12cb09854bce for instance with vm_state building and task_state spawning.
Aug 09 16:53:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-a9b6ef0f-66f7-4d8e-a59e-6804b547fd11 req-6d019e1c-5fa5-44a5-a72b-2fe0c0d34551 service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Received event network-vif-plugged-0acd9658-83ff-499d-8a65-12cb09854bce {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9b6ef0f-66f7-4d8e-a59e-6804b547fd11 req-6d019e1c-5fa5-44a5-a72b-2fe0c0d34551 service nova] Acquiring lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9b6ef0f-66f7-4d8e-a59e-6804b547fd11 req-6d019e1c-5fa5-44a5-a72b-2fe0c0d34551 service nova] Lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9b6ef0f-66f7-4d8e-a59e-6804b547fd11 req-6d019e1c-5fa5-44a5-a72b-2fe0c0d34551 service nova] Lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-a9b6ef0f-66f7-4d8e-a59e-6804b547fd11 req-6d019e1c-5fa5-44a5-a72b-2fe0c0d34551 service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] No waiting events found dispatching network-vif-plugged-0acd9658-83ff-499d-8a65-12cb09854bce {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:53:08 user nova-compute[73091]: WARNING nova.compute.manager [req-a9b6ef0f-66f7-4d8e-a59e-6804b547fd11 req-6d019e1c-5fa5-44a5-a72b-2fe0c0d34551 service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Received unexpected event network-vif-plugged-0acd9658-83ff-499d-8a65-12cb09854bce for instance with vm_state building and task_state spawning.
Aug 09 16:53:08 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599988.4819367, fd3ac804-7b4d-43a0-9837-20a98ea7615d => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:53:08 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] VM Resumed (Lifecycle Event)
Aug 09 16:53:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:53:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:53:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Instance spawned successfully.
Aug 09 16:53:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:53:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:53:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:53:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:08 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:53:08 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599988.482077, fd3ac804-7b4d-43a0-9837-20a98ea7615d => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:53:08 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] VM Started (Lifecycle Event)
Aug 09 16:53:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:53:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:53:08 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:53:08 user nova-compute[73091]: INFO nova.compute.manager [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Took 7.48 seconds to spawn the instance on the hypervisor.
Aug 09 16:53:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:53:08 user nova-compute[73091]: INFO nova.compute.manager [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Took 8.30 seconds to build instance.
Aug 09 16:53:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-367b44a1-287f-4cc7-99ac-3497376c3321 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.398s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-8c1ca4f8-c4a0-494c-8d0e-09739343b59a req-57bdbe4a-fa19-4f51-9960-ce75a95ebc89 service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received event network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8c1ca4f8-c4a0-494c-8d0e-09739343b59a req-57bdbe4a-fa19-4f51-9960-ce75a95ebc89 service nova] Acquiring lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8c1ca4f8-c4a0-494c-8d0e-09739343b59a req-57bdbe4a-fa19-4f51-9960-ce75a95ebc89 service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8c1ca4f8-c4a0-494c-8d0e-09739343b59a req-57bdbe4a-fa19-4f51-9960-ce75a95ebc89 service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-8c1ca4f8-c4a0-494c-8d0e-09739343b59a req-57bdbe4a-fa19-4f51-9960-ce75a95ebc89 service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] No waiting events found dispatching network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:53:09 user nova-compute[73091]: WARNING nova.compute.manager [req-8c1ca4f8-c4a0-494c-8d0e-09739343b59a req-57bdbe4a-fa19-4f51-9960-ce75a95ebc89 service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received unexpected event network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a for instance with vm_state active and task_state rescuing.
Aug 09 16:53:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-cca49834-45a9-43be-9db3-07c0425334c6 req-fcabee87-366b-44ef-a46e-9e7905aa94ce service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received event network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cca49834-45a9-43be-9db3-07c0425334c6 req-fcabee87-366b-44ef-a46e-9e7905aa94ce service nova] Acquiring lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cca49834-45a9-43be-9db3-07c0425334c6 req-fcabee87-366b-44ef-a46e-9e7905aa94ce service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cca49834-45a9-43be-9db3-07c0425334c6 req-fcabee87-366b-44ef-a46e-9e7905aa94ce service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-cca49834-45a9-43be-9db3-07c0425334c6 req-fcabee87-366b-44ef-a46e-9e7905aa94ce service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] No waiting events found dispatching network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:53:11 user nova-compute[73091]: WARNING nova.compute.manager [req-cca49834-45a9-43be-9db3-07c0425334c6 req-fcabee87-366b-44ef-a46e-9e7905aa94ce service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received unexpected event network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a for instance with vm_state active and task_state rescuing.
Aug 09 16:53:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Removed pending event for 76055017-05ff-4ea7-ae9c-66d2e502e090 due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 16:53:11 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599991.447903, 76055017-05ff-4ea7-ae9c-66d2e502e090 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:53:11 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] VM Resumed (Lifecycle Event)
Aug 09 16:53:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b63fa2d0-8346-4503-86e1-e310de75ee22 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:53:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:53:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:53:11 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 16:53:11 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691599991.4489393, 76055017-05ff-4ea7-ae9c-66d2e502e090 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:53:11 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] VM Started (Lifecycle Event)
Aug 09 16:53:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:53:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:53:11 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 16:53:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:53:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:53:13 user nova-compute[73091]: INFO nova.compute.claims [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Claim successful on node user
Aug 09 16:53:13 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:53:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:53:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:53:14 user nova-compute[73091]: INFO nova.virt.block_device [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Booting with volume e0301516-83e4-4c1b-8bfa-e2ed70ac2715 at /dev/vda
Aug 09 16:53:14 user nova-compute[73091]: DEBUG nova.policy [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69ccebf0e9d54502a2318c809ce11369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d3dfd232d54594808dad271baa5192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG os_brick.utils [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2e508d-ddda-449c-a8b2-1f7e73ae7a65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[70134480-ec2a-4702-ab06-0e0350932618]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06fbecf-b7cb-4ffc-928b-522588c4f879]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df093c3-d805-4ecf-b026-5fc087129395]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:53:14 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:53:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4881c8d-67f3-4570-882d-432666069472]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG os_brick.utils [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Updating existing volume attachment record: efed9f9c-4b83-4997-874e-7cf8264c3bd1 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:53:14 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:53:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Successfully created port: cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:53:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:53:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:53:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Successfully updated port: cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:53:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "refresh_cache-bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:53:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquired lock "refresh_cache-bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:53:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:53:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-974abfea-4393-41b9-81ab-aa8686745045 req-577746a8-a58f-4313-ab92-5765b6bb5bc8 service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Received event network-changed-cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-974abfea-4393-41b9-81ab-aa8686745045 req-577746a8-a58f-4313-ab92-5765b6bb5bc8 service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Refreshing instance network info cache due to event network-changed-cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:53:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-974abfea-4393-41b9-81ab-aa8686745045 req-577746a8-a58f-4313-ab92-5765b6bb5bc8 service nova] Acquiring lock "refresh_cache-bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:53:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:53:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Updating instance_info_cache with network_info: [{"id": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "address": "fa:16:3e:28:90:8c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd30f6db-9d", "ovs_interfaceid": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:53:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Releasing lock "refresh_cache-bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:53:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Instance network_info: |[{"id": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "address": "fa:16:3e:28:90:8c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd30f6db-9d", "ovs_interfaceid": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:53:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-974abfea-4393-41b9-81ab-aa8686745045 req-577746a8-a58f-4313-ab92-5765b6bb5bc8 service nova] Acquired lock "refresh_cache-bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:53:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-974abfea-4393-41b9-81ab-aa8686745045 req-577746a8-a58f-4313-ab92-5765b6bb5bc8 service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Refreshing network info cache for port cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:53:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-974abfea-4393-41b9-81ab-aa8686745045 req-577746a8-a58f-4313-ab92-5765b6bb5bc8 service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Updated VIF entry in instance network info cache for port cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:53:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-974abfea-4393-41b9-81ab-aa8686745045 req-577746a8-a58f-4313-ab92-5765b6bb5bc8 service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Updating instance_info_cache with network_info: [{"id": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "address": "fa:16:3e:28:90:8c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd30f6db-9d", "ovs_interfaceid": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:53:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-974abfea-4393-41b9-81ab-aa8686745045 req-577746a8-a58f-4313-ab92-5765b6bb5bc8 service nova] Releasing lock "refresh_cache-bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:53:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:53:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:53:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:53:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:53:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:53:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Updating instance_info_cache with network_info: [{"id": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "address": "fa:16:3e:6e:98:76", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb647b7d-fa", "ovs_interfaceid": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:53:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:53:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:53:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:20 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691599985.0128443, 18d8e887-0f91-42e1-ba79-13db5aa9b84b => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:53:20 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] VM Stopped (Lifecycle Event)
Aug 09 16:53:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6dfa86a2-3cbd-4e3e-8521-fd3854d0740c None None] [instance: 18d8e887-0f91-42e1-ba79-13db5aa9b84b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:53:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:53:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:53:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:53:22 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:53:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:53:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:53:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76055017-05ff-4ea7-ae9c-66d2e502e090/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76055017-05ff-4ea7-ae9c-66d2e502e090/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76055017-05ff-4ea7-ae9c-66d2e502e090/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76055017-05ff-4ea7-ae9c-66d2e502e090/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:53:24 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Creating image(s)
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Ensure instance console log exists: /opt/stack/data/nova/instances/bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Start _get_guest_xml network_info=[{"id": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "address": "fa:16:3e:28:90:8c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd30f6db-9d", "ovs_interfaceid": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'efed9f9c-4b83-4997-874e-7cf8264c3bd1', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrRMmbtK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0301516-83e4-4c1b-8bfa-e2ed70ac2715', 'serial': 'e0301516-83e4-4c1b-8bfa-e2ed70ac2715'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:53:24 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:53:24 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrRMmbtK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:53:24 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:53:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:53:24 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:53:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:53:24 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:53:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae51055-0f63-41ea-84c6-9dba237b7ab4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:53:24 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:53:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e32533-9be8-456a-9ec4-0414eb100835]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715] added
Aug 09 16:53:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[00136799-d40c-44c9-8eaa-9cd3c71d06b8]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3a031f-5347-44d9-85e6-faca2d52e3f1]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hrRMmbtK {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hrRMmbtK" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d250d9a-5ab9-41e5-9132-422aa9bbfc64]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hrRMmbtK'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7367d7b7-f23b-4650-a8c6-44269b24877b]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e68ae98-1a09-423d-a077-9be41b3670a2]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:53:25 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:53:25 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:53:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:53:25 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:53:25 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:53:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e48792d-6506-40e6-8c49-90ab4c974e18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715, portal: 172.16.0.220,3260]
Aug 09 16:53:25 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715, portal: 172.16.0.220,3260] successful.
Aug 09 16:53:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4758eb80-b326-47d6-843a-6d0d477d615c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[76339d18-c4b0-4dcd-9156-71d07fa03206]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:53:25 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:53:25 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:53:25 user nova-compute[73091]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 (non-flash)
Aug 09 16:53:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:53:25 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:53:25 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:53:25 user nova-compute[73091]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 (non-flash)
Aug 09 16:53:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d872ff5-4389-4e03-b70d-6cf4b6e71258]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrRMmbtK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] <== connect_volume: return (1468ms) {'type': 'block', 'scsi_wwn': '23832326566616437', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832326566616437', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:53:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1998680365',display_name='tempest-TestVolumeBootPattern-server-1998680365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1998680365',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSSzWQUVuDlac0eUgyT2z4iM1Y0qg2BfVrMrtynGR00pxQ570GYD8As3UZF1alKpRXt3lDEuXxBRenfT0VFniILv2ftKfjpM7Z1J3bJewWzw1Fr2JnxHpTfKfQmiSEWpw==',key_name='tempest-TestVolumeBootPattern-2063534983',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d3dfd232d54594808dad271baa5192',ramdisk_id='',reservation_id='r-2gctoq20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1605875873',owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:53:14Z,user_data=None,user_id='69ccebf0e9d54502a2318c809ce11369',uuid=bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "address": "fa:16:3e:28:90:8c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd30f6db-9d", "ovs_interfaceid": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converting VIF {"id": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "address": "fa:16:3e:28:90:8c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd30f6db-9d", "ovs_interfaceid": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:90:8c,bridge_name='br-int',has_traffic_filtering=True,id=cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd30f6db-9d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lazy-loading 'pci_devices' on Instance uuid bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:53:26 user nova-compute[73091]:   <uuid>bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1</uuid>
Aug 09 16:53:26 user nova-compute[73091]:   <name>instance-0000002a</name>
Aug 09 16:53:26 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:53:26 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:53:26 user nova-compute[73091]:   <metadata>
Aug 09 16:53:26 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:53:26 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:53:26 user nova-compute[73091]:       <nova:name>tempest-TestVolumeBootPattern-server-1998680365</nova:name>
Aug 09 16:53:26 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:53:24</nova:creationTime>
Aug 09 16:53:26 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:53:26 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:53:26 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:53:26 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:53:26 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:53:26 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:53:26 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:53:26 user nova-compute[73091]:       <nova:owner>
Aug 09 16:53:26 user nova-compute[73091]:         <nova:user uuid="69ccebf0e9d54502a2318c809ce11369">tempest-TestVolumeBootPattern-1605875873-project-member</nova:user>
Aug 09 16:53:26 user nova-compute[73091]:         <nova:project uuid="64d3dfd232d54594808dad271baa5192">tempest-TestVolumeBootPattern-1605875873</nova:project>
Aug 09 16:53:26 user nova-compute[73091]:       </nova:owner>
Aug 09 16:53:26 user nova-compute[73091]:       <nova:ports>
Aug 09 16:53:26 user nova-compute[73091]:         <nova:port uuid="cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a">
Aug 09 16:53:26 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 16:53:26 user nova-compute[73091]:         </nova:port>
Aug 09 16:53:26 user nova-compute[73091]:       </nova:ports>
Aug 09 16:53:26 user nova-compute[73091]:     </nova:instance>
Aug 09 16:53:26 user nova-compute[73091]:   </metadata>
Aug 09 16:53:26 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:53:26 user nova-compute[73091]:     <system>
Aug 09 16:53:26 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:53:26 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:53:26 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:53:26 user nova-compute[73091]:       <entry name="serial">bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1</entry>
Aug 09 16:53:26 user nova-compute[73091]:       <entry name="uuid">bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1</entry>
Aug 09 16:53:26 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:53:26 user nova-compute[73091]:     </system>
Aug 09 16:53:26 user nova-compute[73091]:   </sysinfo>
Aug 09 16:53:26 user nova-compute[73091]:   <os>
Aug 09 16:53:26 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:53:26 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:53:26 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:53:26 user nova-compute[73091]:   </os>
Aug 09 16:53:26 user nova-compute[73091]:   <features>
Aug 09 16:53:26 user nova-compute[73091]:     <acpi/>
Aug 09 16:53:26 user nova-compute[73091]:     <apic/>
Aug 09 16:53:26 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:53:26 user nova-compute[73091]:   </features>
Aug 09 16:53:26 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:53:26 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:53:26 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:53:26 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:53:26 user nova-compute[73091]:   </clock>
Aug 09 16:53:26 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:53:26 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:53:26 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:53:26 user nova-compute[73091]:   </cpu>
Aug 09 16:53:26 user nova-compute[73091]:   <devices>
Aug 09 16:53:26 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:53:26 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:53:26 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 09 16:53:26 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:53:26 user nova-compute[73091]:       <serial>e0301516-83e4-4c1b-8bfa-e2ed70ac2715</serial>
Aug 09 16:53:26 user nova-compute[73091]:     </disk>
Aug 09 16:53:26 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:53:26 user nova-compute[73091]:       <mac address="fa:16:3e:28:90:8c"/>
Aug 09 16:53:26 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:53:26 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:53:26 user nova-compute[73091]:       <target dev="tapcd30f6db-9d"/>
Aug 09 16:53:26 user nova-compute[73091]:     </interface>
Aug 09 16:53:26 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:53:26 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1/console.log" append="off"/>
Aug 09 16:53:26 user nova-compute[73091]:     </serial>
Aug 09 16:53:26 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:53:26 user nova-compute[73091]:     <video>
Aug 09 16:53:26 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:53:26 user nova-compute[73091]:     </video>
Aug 09 16:53:26 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:53:26 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:53:26 user nova-compute[73091]:     </rng>
Aug 09 16:53:26 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:53:26 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:53:26 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:53:26 user nova-compute[73091]:     </memballoon>
Aug 09 16:53:26 user nova-compute[73091]:   </devices>
Aug 09 16:53:26 user nova-compute[73091]: </domain>
Aug 09 16:53:26 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:53:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1998680365',display_name='tempest-TestVolumeBootPattern-server-1998680365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1998680365',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSSzWQUVuDlac0eUgyT2z4iM1Y0qg2BfVrMrtynGR00pxQ570GYD8As3UZF1alKpRXt3lDEuXxBRenfT0VFniILv2ftKfjpM7Z1J3bJewWzw1Fr2JnxHpTfKfQmiSEWpw==',key_name='tempest-TestVolumeBootPattern-2063534983',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d3dfd232d54594808dad271baa5192',ramdisk_id='',reservation_id='r-2gctoq20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1605875873',owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:53:14Z,user_data=None,user_id='69ccebf0e9d54502a2318c809ce11369',uuid=bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "address": "fa:16:3e:28:90:8c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd30f6db-9d", "ovs_interfaceid": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converting VIF {"id": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "address": "fa:16:3e:28:90:8c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd30f6db-9d", "ovs_interfaceid": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:90:8c,bridge_name='br-int',has_traffic_filtering=True,id=cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd30f6db-9d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG os_vif [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:90:8c,bridge_name='br-int',has_traffic_filtering=True,id=cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd30f6db-9d') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd30f6db-9d, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcd30f6db-9d, col_values=(('external_ids', {'iface-id': 'cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:90:8c', 'vm-uuid': 'bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:26 user nova-compute[73091]: INFO os_vif [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:90:8c,bridge_name='br-int',has_traffic_filtering=True,id=cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd30f6db-9d')
Aug 09 16:53:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] No VIF found with MAC fa:16:3e:28:90:8c, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:53:26 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:53:26 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:53:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7711MB free_disk=25.07464599609375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f939fe27-017a-481e-babc-147bf98e0132 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:53:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8fc884a8-24bb-488a-baeb-ef2b1faf239d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:53:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:53:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c3871ef4-45e7-4118-8227-e48cc857d481 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:53:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance bfb5340a-2329-4bd2-9f94-52ef24967a9b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:53:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 76055017-05ff-4ea7-ae9c-66d2e502e090 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:53:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance fd3ac804-7b4d-43a0-9837-20a98ea7615d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:53:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:53:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:53:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:53:27 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:53:27 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:53:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:53:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-37b8ff68-d08c-498f-b490-748ebfa87adb req-79f5c177-9c9f-4366-85ab-91fcfe96a709 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received event network-changed-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-37b8ff68-d08c-498f-b490-748ebfa87adb req-79f5c177-9c9f-4366-85ab-91fcfe96a709 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Refreshing instance network info cache due to event network-changed-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:53:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-37b8ff68-d08c-498f-b490-748ebfa87adb req-79f5c177-9c9f-4366-85ab-91fcfe96a709 service nova] Acquiring lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:53:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-37b8ff68-d08c-498f-b490-748ebfa87adb req-79f5c177-9c9f-4366-85ab-91fcfe96a709 service nova] Acquired lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:53:28 user nova-compute[73091]: DEBUG nova.network.neutron [req-37b8ff68-d08c-498f-b490-748ebfa87adb req-79f5c177-9c9f-4366-85ab-91fcfe96a709 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Refreshing network info cache for port eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:53:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-4afdb121-a9c3-4fba-b72b-f1e4a317ee87 req-78d46995-43b4-4180-ae5b-d828f5514004 service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Received event network-vif-plugged-cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4afdb121-a9c3-4fba-b72b-f1e4a317ee87 req-78d46995-43b4-4180-ae5b-d828f5514004 service nova] Acquiring lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4afdb121-a9c3-4fba-b72b-f1e4a317ee87 req-78d46995-43b4-4180-ae5b-d828f5514004 service nova] Lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4afdb121-a9c3-4fba-b72b-f1e4a317ee87 req-78d46995-43b4-4180-ae5b-d828f5514004 service nova] Lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-4afdb121-a9c3-4fba-b72b-f1e4a317ee87 req-78d46995-43b4-4180-ae5b-d828f5514004 service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] No waiting events found dispatching network-vif-plugged-cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:53:28 user nova-compute[73091]: WARNING nova.compute.manager [req-4afdb121-a9c3-4fba-b72b-f1e4a317ee87 req-78d46995-43b4-4180-ae5b-d828f5514004 service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Received unexpected event network-vif-plugged-cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a for instance with vm_state building and task_state spawning.
Aug 09 16:53:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:28 user nova-compute[73091]: INFO nova.compute.manager [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Detaching volume ae31d517-103e-4833-850a-d27291be1344
Aug 09 16:53:28 user nova-compute[73091]: INFO nova.virt.block_device [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Attempting to driver detach volume ae31d517-103e-4833-850a-d27291be1344 from mountpoint /dev/vdb
Aug 09 16:53:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Attempting to detach device vdb from instance 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:53:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:53:28 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:53:28 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 09 16:53:28 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:53:28 user nova-compute[73091]:   <serial>ae31d517-103e-4833-850a-d27291be1344</serial>
Aug 09 16:53:28 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:53:28 user nova-compute[73091]: </disk>
Aug 09 16:53:28 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:53:28 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Successfully detached device vdb from instance 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 from the persistent domain config.
Aug 09 16:53:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:53:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:53:28 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:53:28 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 09 16:53:28 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:53:28 user nova-compute[73091]:   <serial>ae31d517-103e-4833-850a-d27291be1344</serial>
Aug 09 16:53:28 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:53:28 user nova-compute[73091]: </disk>
Aug 09 16:53:28 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691600009.416701, 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:53:29 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Successfully detached device vdb from instance 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 from the live domain config.
Aug 09 16:53:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgKJYwTS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:53:29 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:53:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f0ded4-74be-45bf-80bd-2e1029a771ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe1a498-b7a4-45fd-9c95-2a78a8ea1b1e]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:53:29 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:53:29 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:53:29 user nova-compute[73091]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 (non-flash)
Aug 09 16:53:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 (non-flash)
Aug 09 16:53:29 user nova-compute[73091]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:53:29 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:53:29 user nova-compute[73091]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 (non-flash)
Aug 09 16:53:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff060255bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Removing single pathed devices sde {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG nova.network.neutron [req-37b8ff68-d08c-498f-b490-748ebfa87adb req-79f5c177-9c9f-4366-85ab-91fcfe96a709 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Updated VIF entry in instance network info cache for port eb647b7d-fa5b-4876-99da-b3c3ef59c0e7. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG nova.network.neutron [req-37b8ff68-d08c-498f-b490-748ebfa87adb req-79f5c177-9c9f-4366-85ab-91fcfe96a709 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Updating instance_info_cache with network_info: [{"id": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "address": "fa:16:3e:6e:98:76", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb647b7d-fa", "ovs_interfaceid": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df0fbc2-a7c1-4502-aa7d-dbd9f6e37f54]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-37b8ff68-d08c-498f-b490-748ebfa87adb req-79f5c177-9c9f-4366-85ab-91fcfe96a709 service nova] Releasing lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.030s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a30d135-9938-4036-85e6-2f1753cc3220]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[df34aa93-96f5-42a1-b264-68585a60dda6]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[464bfbfd-186a-4300-b069-d5d343de1294]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[76396277-6aed-466c-8c6c-6a2910ce28c7]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9710b851-eb60-49a5-ae57-c4e7ccb821ea]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344, portal: 172.16.0.220,3260]
Aug 09 16:53:29 user nova-compute[73091]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344, portal: 172.16.0.220,3260] successful.
Aug 09 16:53:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae31d517-103e-4833-850a-d27291be1344 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaca3c2a-2761-4e74-ad3a-a48cab6bc60a]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] <== disconnect_volume: return (351ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:53:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-5cafd229-633b-46b1-8e4c-bd2283e750cc req-ad35e7e5-45a4-4e01-977e-2854a302a0e9 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received event network-changed-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-5cafd229-633b-46b1-8e4c-bd2283e750cc req-ad35e7e5-45a4-4e01-977e-2854a302a0e9 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Refreshing instance network info cache due to event network-changed-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5cafd229-633b-46b1-8e4c-bd2283e750cc req-ad35e7e5-45a4-4e01-977e-2854a302a0e9 service nova] Acquiring lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5cafd229-633b-46b1-8e4c-bd2283e750cc req-ad35e7e5-45a4-4e01-977e-2854a302a0e9 service nova] Acquired lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.network.neutron [req-5cafd229-633b-46b1-8e4c-bd2283e750cc req-ad35e7e5-45a4-4e01-977e-2854a302a0e9 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Refreshing network info cache for port eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600010.538774, bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:53:30 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] VM Resumed (Lifecycle Event)
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:53:30 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Instance spawned successfully.
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:30 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600010.5403514, bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:53:30 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] VM Started (Lifecycle Event)
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-bcd5b620-9330-457b-81db-b5994971d62e req-99f7c134-6681-44a6-9f82-88baf20d74bb service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Received event network-vif-plugged-cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bcd5b620-9330-457b-81db-b5994971d62e req-99f7c134-6681-44a6-9f82-88baf20d74bb service nova] Acquiring lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bcd5b620-9330-457b-81db-b5994971d62e req-99f7c134-6681-44a6-9f82-88baf20d74bb service nova] Lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bcd5b620-9330-457b-81db-b5994971d62e req-99f7c134-6681-44a6-9f82-88baf20d74bb service nova] Lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-bcd5b620-9330-457b-81db-b5994971d62e req-99f7c134-6681-44a6-9f82-88baf20d74bb service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] No waiting events found dispatching network-vif-plugged-cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:53:30 user nova-compute[73091]: WARNING nova.compute.manager [req-bcd5b620-9330-457b-81db-b5994971d62e req-99f7c134-6681-44a6-9f82-88baf20d74bb service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Received unexpected event network-vif-plugged-cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a for instance with vm_state building and task_state spawning.
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'flavor' on Instance uuid 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c48baf3e-0c68-4605-832b-52ee3fa039fb tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.902s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:30 user nova-compute[73091]: INFO nova.compute.manager [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Took 5.93 seconds to spawn the instance on the hypervisor.
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:53:30 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.network.neutron [req-5cafd229-633b-46b1-8e4c-bd2283e750cc req-ad35e7e5-45a4-4e01-977e-2854a302a0e9 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Updated VIF entry in instance network info cache for port eb647b7d-fa5b-4876-99da-b3c3ef59c0e7. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG nova.network.neutron [req-5cafd229-633b-46b1-8e4c-bd2283e750cc req-ad35e7e5-45a4-4e01-977e-2854a302a0e9 service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Updating instance_info_cache with network_info: [{"id": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "address": "fa:16:3e:6e:98:76", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb647b7d-fa", "ovs_interfaceid": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:53:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5cafd229-633b-46b1-8e4c-bd2283e750cc req-ad35e7e5-45a4-4e01-977e-2854a302a0e9 service nova] Releasing lock "refresh_cache-3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:53:30 user nova-compute[73091]: INFO nova.compute.manager [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Took 17.15 seconds to build instance.
Aug 09 16:53:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b8f69d46-7d2d-4473-bfda-d0c2a4bbd898 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.483s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:53:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:53:33 user nova-compute[73091]: INFO nova.compute.claims [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Claim successful on node user
Aug 09 16:53:34 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:53:34 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:53:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:53:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:53:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:53:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:53:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:53:34 user nova-compute[73091]: DEBUG nova.policy [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cab8def6097d414daf1d2b5a4b2a56c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e26fc699254693b43c6d3a097b56ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:53:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:53:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:53:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Creating image(s)
Aug 09 16:53:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "/opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "/opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk 1073741824" returned: 0 in 0.062s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:35 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:53:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:35 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Cannot resize image /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:53:35 user nova-compute[73091]: DEBUG nova.objects.instance [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lazy-loading 'migration_context' on Instance uuid bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:53:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:53:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Ensure instance console log exists: /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:53:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Successfully created port: 236391c4-e172-433a-bb75-b3324f92ec1d {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Successfully updated port: 236391c4-e172-433a-bb75-b3324f92ec1d {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "refresh_cache-bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquired lock "refresh_cache-bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-e95a1dfa-6f19-4c7a-a5ae-c8fbeaf429b0 req-d48c1c66-a429-468c-9ef8-4f87acb1ff91 service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Received event network-changed-236391c4-e172-433a-bb75-b3324f92ec1d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-e95a1dfa-6f19-4c7a-a5ae-c8fbeaf429b0 req-d48c1c66-a429-468c-9ef8-4f87acb1ff91 service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Refreshing instance network info cache due to event network-changed-236391c4-e172-433a-bb75-b3324f92ec1d. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e95a1dfa-6f19-4c7a-a5ae-c8fbeaf429b0 req-d48c1c66-a429-468c-9ef8-4f87acb1ff91 service nova] Acquiring lock "refresh_cache-bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Updating instance_info_cache with network_info: [{"id": "236391c4-e172-433a-bb75-b3324f92ec1d", "address": "fa:16:3e:20:bc:16", "network": {"id": "b81dfad5-9bb3-4c52-ae30-27b42f42bda0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-349073738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e26fc699254693b43c6d3a097b56ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236391c4-e1", "ovs_interfaceid": "236391c4-e172-433a-bb75-b3324f92ec1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Releasing lock "refresh_cache-bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Instance network_info: |[{"id": "236391c4-e172-433a-bb75-b3324f92ec1d", "address": "fa:16:3e:20:bc:16", "network": {"id": "b81dfad5-9bb3-4c52-ae30-27b42f42bda0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-349073738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e26fc699254693b43c6d3a097b56ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236391c4-e1", "ovs_interfaceid": "236391c4-e172-433a-bb75-b3324f92ec1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e95a1dfa-6f19-4c7a-a5ae-c8fbeaf429b0 req-d48c1c66-a429-468c-9ef8-4f87acb1ff91 service nova] Acquired lock "refresh_cache-bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-e95a1dfa-6f19-4c7a-a5ae-c8fbeaf429b0 req-d48c1c66-a429-468c-9ef8-4f87acb1ff91 service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Refreshing network info cache for port 236391c4-e172-433a-bb75-b3324f92ec1d {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Start _get_guest_xml network_info=[{"id": "236391c4-e172-433a-bb75-b3324f92ec1d", "address": "fa:16:3e:20:bc:16", "network": {"id": "b81dfad5-9bb3-4c52-ae30-27b42f42bda0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-349073738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e26fc699254693b43c6d3a097b56ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236391c4-e1", "ovs_interfaceid": "236391c4-e172-433a-bb75-b3324f92ec1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:53:36 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:53:36 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:53:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1525806518',display_name='tempest-TestServerVolumeAttachmentScenario-server-1525806518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1525806518',id=43,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0ut9lNmoEV0hgtWduhzJd+NiW35iXYnFeydNtKTvE9+gIQHY8OlujRzFeU6RoZMuvFu95HaVrnoRpPILolxxGwQ1OHYyrZDup9HSgWglSC28LJ9db1JNUOcIPUXiNW2w==',key_name='tempest-keypair-2050407441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4e26fc699254693b43c6d3a097b56ff',ramdisk_id='',reservation_id='r-4q21ykav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-206736863',owner_user_name='tempest-TestServerVolumeAttachmentScenario-206736863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:53:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cab8def6097d414daf1d2b5a4b2a56c9',uuid=bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "236391c4-e172-433a-bb75-b3324f92ec1d", "address": "fa:16:3e:20:bc:16", "network": {"id": "b81dfad5-9bb3-4c52-ae30-27b42f42bda0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-349073738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e26fc699254693b43c6d3a097b56ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236391c4-e1", "ovs_interfaceid": "236391c4-e172-433a-bb75-b3324f92ec1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Converting VIF {"id": "236391c4-e172-433a-bb75-b3324f92ec1d", "address": "fa:16:3e:20:bc:16", "network": {"id": "b81dfad5-9bb3-4c52-ae30-27b42f42bda0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-349073738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e26fc699254693b43c6d3a097b56ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236391c4-e1", "ovs_interfaceid": "236391c4-e172-433a-bb75-b3324f92ec1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:bc:16,bridge_name='br-int',has_traffic_filtering=True,id=236391c4-e172-433a-bb75-b3324f92ec1d,network=Network(b81dfad5-9bb3-4c52-ae30-27b42f42bda0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236391c4-e1') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.objects.instance [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lazy-loading 'pci_devices' on Instance uuid bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:53:36 user nova-compute[73091]:   <uuid>bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76</uuid>
Aug 09 16:53:36 user nova-compute[73091]:   <name>instance-0000002b</name>
Aug 09 16:53:36 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:53:36 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:53:36 user nova-compute[73091]:   <metadata>
Aug 09 16:53:36 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:53:36 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:53:36 user nova-compute[73091]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1525806518</nova:name>
Aug 09 16:53:36 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:53:36</nova:creationTime>
Aug 09 16:53:36 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:53:36 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:53:36 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:53:36 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:53:36 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:53:36 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:53:36 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:53:36 user nova-compute[73091]:       <nova:owner>
Aug 09 16:53:36 user nova-compute[73091]:         <nova:user uuid="cab8def6097d414daf1d2b5a4b2a56c9">tempest-TestServerVolumeAttachmentScenario-206736863-project-member</nova:user>
Aug 09 16:53:36 user nova-compute[73091]:         <nova:project uuid="e4e26fc699254693b43c6d3a097b56ff">tempest-TestServerVolumeAttachmentScenario-206736863</nova:project>
Aug 09 16:53:36 user nova-compute[73091]:       </nova:owner>
Aug 09 16:53:36 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:53:36 user nova-compute[73091]:       <nova:ports>
Aug 09 16:53:36 user nova-compute[73091]:         <nova:port uuid="236391c4-e172-433a-bb75-b3324f92ec1d">
Aug 09 16:53:36 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 16:53:36 user nova-compute[73091]:         </nova:port>
Aug 09 16:53:36 user nova-compute[73091]:       </nova:ports>
Aug 09 16:53:36 user nova-compute[73091]:     </nova:instance>
Aug 09 16:53:36 user nova-compute[73091]:   </metadata>
Aug 09 16:53:36 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:53:36 user nova-compute[73091]:     <system>
Aug 09 16:53:36 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:53:36 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:53:36 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:53:36 user nova-compute[73091]:       <entry name="serial">bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76</entry>
Aug 09 16:53:36 user nova-compute[73091]:       <entry name="uuid">bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76</entry>
Aug 09 16:53:36 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:53:36 user nova-compute[73091]:     </system>
Aug 09 16:53:36 user nova-compute[73091]:   </sysinfo>
Aug 09 16:53:36 user nova-compute[73091]:   <os>
Aug 09 16:53:36 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:53:36 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:53:36 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:53:36 user nova-compute[73091]:   </os>
Aug 09 16:53:36 user nova-compute[73091]:   <features>
Aug 09 16:53:36 user nova-compute[73091]:     <acpi/>
Aug 09 16:53:36 user nova-compute[73091]:     <apic/>
Aug 09 16:53:36 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:53:36 user nova-compute[73091]:   </features>
Aug 09 16:53:36 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:53:36 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:53:36 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:53:36 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:53:36 user nova-compute[73091]:   </clock>
Aug 09 16:53:36 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:53:36 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:53:36 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:53:36 user nova-compute[73091]:   </cpu>
Aug 09 16:53:36 user nova-compute[73091]:   <devices>
Aug 09 16:53:36 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:53:36 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:53:36 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk"/>
Aug 09 16:53:36 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:53:36 user nova-compute[73091]:     </disk>
Aug 09 16:53:36 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:53:36 user nova-compute[73091]:       <mac address="fa:16:3e:20:bc:16"/>
Aug 09 16:53:36 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:53:36 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:53:36 user nova-compute[73091]:       <target dev="tap236391c4-e1"/>
Aug 09 16:53:36 user nova-compute[73091]:     </interface>
Aug 09 16:53:36 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:53:36 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/console.log" append="off"/>
Aug 09 16:53:36 user nova-compute[73091]:     </serial>
Aug 09 16:53:36 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:53:36 user nova-compute[73091]:     <video>
Aug 09 16:53:36 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:53:36 user nova-compute[73091]:     </video>
Aug 09 16:53:36 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:53:36 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:53:36 user nova-compute[73091]:     </rng>
Aug 09 16:53:36 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:53:36 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:53:36 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:53:36 user nova-compute[73091]:     </memballoon>
Aug 09 16:53:36 user nova-compute[73091]:   </devices>
Aug 09 16:53:36 user nova-compute[73091]: </domain>
Aug 09 16:53:36 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:53:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1525806518',display_name='tempest-TestServerVolumeAttachmentScenario-server-1525806518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1525806518',id=43,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0ut9lNmoEV0hgtWduhzJd+NiW35iXYnFeydNtKTvE9+gIQHY8OlujRzFeU6RoZMuvFu95HaVrnoRpPILolxxGwQ1OHYyrZDup9HSgWglSC28LJ9db1JNUOcIPUXiNW2w==',key_name='tempest-keypair-2050407441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4e26fc699254693b43c6d3a097b56ff',ramdisk_id='',reservation_id='r-4q21ykav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-206736863',owner_user_name='tempest-TestServerVolumeAttachmentScenario-206736863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:53:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cab8def6097d414daf1d2b5a4b2a56c9',uuid=bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "236391c4-e172-433a-bb75-b3324f92ec1d", "address": "fa:16:3e:20:bc:16", "network": {"id": "b81dfad5-9bb3-4c52-ae30-27b42f42bda0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-349073738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e26fc699254693b43c6d3a097b56ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236391c4-e1", "ovs_interfaceid": "236391c4-e172-433a-bb75-b3324f92ec1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Converting VIF {"id": "236391c4-e172-433a-bb75-b3324f92ec1d", "address": "fa:16:3e:20:bc:16", "network": {"id": "b81dfad5-9bb3-4c52-ae30-27b42f42bda0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-349073738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e26fc699254693b43c6d3a097b56ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236391c4-e1", "ovs_interfaceid": "236391c4-e172-433a-bb75-b3324f92ec1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:bc:16,bridge_name='br-int',has_traffic_filtering=True,id=236391c4-e172-433a-bb75-b3324f92ec1d,network=Network(b81dfad5-9bb3-4c52-ae30-27b42f42bda0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236391c4-e1') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG os_vif [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:bc:16,bridge_name='br-int',has_traffic_filtering=True,id=236391c4-e172-433a-bb75-b3324f92ec1d,network=Network(b81dfad5-9bb3-4c52-ae30-27b42f42bda0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236391c4-e1') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap236391c4-e1, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap236391c4-e1, col_values=(('external_ids', {'iface-id': '236391c4-e172-433a-bb75-b3324f92ec1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:bc:16', 'vm-uuid': 'bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:36 user nova-compute[73091]: INFO os_vif [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:bc:16,bridge_name='br-int',has_traffic_filtering=True,id=236391c4-e172-433a-bb75-b3324f92ec1d,network=Network(b81dfad5-9bb3-4c52-ae30-27b42f42bda0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236391c4-e1')
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:53:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] No VIF found with MAC fa:16:3e:20:bc:16, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:53:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-e95a1dfa-6f19-4c7a-a5ae-c8fbeaf429b0 req-d48c1c66-a429-468c-9ef8-4f87acb1ff91 service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Updated VIF entry in instance network info cache for port 236391c4-e172-433a-bb75-b3324f92ec1d. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:53:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-e95a1dfa-6f19-4c7a-a5ae-c8fbeaf429b0 req-d48c1c66-a429-468c-9ef8-4f87acb1ff91 service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Updating instance_info_cache with network_info: [{"id": "236391c4-e172-433a-bb75-b3324f92ec1d", "address": "fa:16:3e:20:bc:16", "network": {"id": "b81dfad5-9bb3-4c52-ae30-27b42f42bda0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-349073738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e26fc699254693b43c6d3a097b56ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236391c4-e1", "ovs_interfaceid": "236391c4-e172-433a-bb75-b3324f92ec1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:53:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e95a1dfa-6f19-4c7a-a5ae-c8fbeaf429b0 req-d48c1c66-a429-468c-9ef8-4f87acb1ff91 service nova] Releasing lock "refresh_cache-bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:53:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-f2c34dab-7daf-46be-895d-ff0125d6ed14 req-780b47d4-e6bd-4bf7-a89d-e67db2b9c6fd service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Received event network-vif-plugged-236391c4-e172-433a-bb75-b3324f92ec1d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f2c34dab-7daf-46be-895d-ff0125d6ed14 req-780b47d4-e6bd-4bf7-a89d-e67db2b9c6fd service nova] Acquiring lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f2c34dab-7daf-46be-895d-ff0125d6ed14 req-780b47d4-e6bd-4bf7-a89d-e67db2b9c6fd service nova] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f2c34dab-7daf-46be-895d-ff0125d6ed14 req-780b47d4-e6bd-4bf7-a89d-e67db2b9c6fd service nova] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-f2c34dab-7daf-46be-895d-ff0125d6ed14 req-780b47d4-e6bd-4bf7-a89d-e67db2b9c6fd service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] No waiting events found dispatching network-vif-plugged-236391c4-e172-433a-bb75-b3324f92ec1d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:53:38 user nova-compute[73091]: WARNING nova.compute.manager [req-f2c34dab-7daf-46be-895d-ff0125d6ed14 req-780b47d4-e6bd-4bf7-a89d-e67db2b9c6fd service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Received unexpected event network-vif-plugged-236391c4-e172-433a-bb75-b3324f92ec1d for instance with vm_state building and task_state spawning.
Aug 09 16:53:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:53:40 user nova-compute[73091]: INFO nova.compute.claims [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Claim successful on node user
Aug 09 16:53:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-da1c4458-92fd-4807-8cdd-ab76d88f1dbd req-c1134b34-5ef0-4b22-8c4b-6e973b1ac985 service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Received event network-vif-plugged-236391c4-e172-433a-bb75-b3324f92ec1d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da1c4458-92fd-4807-8cdd-ab76d88f1dbd req-c1134b34-5ef0-4b22-8c4b-6e973b1ac985 service nova] Acquiring lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da1c4458-92fd-4807-8cdd-ab76d88f1dbd req-c1134b34-5ef0-4b22-8c4b-6e973b1ac985 service nova] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da1c4458-92fd-4807-8cdd-ab76d88f1dbd req-c1134b34-5ef0-4b22-8c4b-6e973b1ac985 service nova] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-da1c4458-92fd-4807-8cdd-ab76d88f1dbd req-c1134b34-5ef0-4b22-8c4b-6e973b1ac985 service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] No waiting events found dispatching network-vif-plugged-236391c4-e172-433a-bb75-b3324f92ec1d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:53:40 user nova-compute[73091]: WARNING nova.compute.manager [req-da1c4458-92fd-4807-8cdd-ab76d88f1dbd req-c1134b34-5ef0-4b22-8c4b-6e973b1ac985 service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Received unexpected event network-vif-plugged-236391c4-e172-433a-bb75-b3324f92ec1d for instance with vm_state building and task_state spawning.
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600020.5604527, bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:53:40 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] VM Resumed (Lifecycle Event)
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:53:40 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Instance spawned successfully.
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:53:40 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600020.5639546, bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:53:40 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] VM Started (Lifecycle Event)
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:53:40 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:53:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.668s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:53:40 user nova-compute[73091]: INFO nova.compute.manager [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Took 6.20 seconds to spawn the instance on the hypervisor.
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:53:40 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:53:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:53:40 user nova-compute[73091]: INFO nova.compute.manager [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Took 7.00 seconds to build instance.
Aug 09 16:53:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-45b10561-52eb-40c6-9295-2563a63ea75e tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.106s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG nova.policy [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77d81649b61a40ee87e4fc3c7cc56c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6982c498eeb94d8381a610cb59694191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:53:41 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Creating image(s)
Aug 09 16:53:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "/opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "/opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.168s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7/disk 1073741824" returned: 0 in 0.071s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.153s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Successfully created port: 46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Cannot resize image /opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lazy-loading 'migration_context' on Instance uuid 2c34fc68-d3d4-4924-b522-eb6817d8f9d7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Ensure instance console log exists: /opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Successfully updated port: 46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:53:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "refresh_cache-2c34fc68-d3d4-4924-b522-eb6817d8f9d7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:53:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquired lock "refresh_cache-2c34fc68-d3d4-4924-b522-eb6817d8f9d7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:53:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:53:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-9a34fb17-599a-461a-b584-f9bb10a508f6 req-07041e55-a925-4c0c-8c7c-75fc08ef49a6 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Received event network-changed-46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-9a34fb17-599a-461a-b584-f9bb10a508f6 req-07041e55-a925-4c0c-8c7c-75fc08ef49a6 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Refreshing instance network info cache due to event network-changed-46015a6f-b90c-43c0-877f-ed3c2b64a1ae. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:53:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9a34fb17-599a-461a-b584-f9bb10a508f6 req-07041e55-a925-4c0c-8c7c-75fc08ef49a6 service nova] Acquiring lock "refresh_cache-2c34fc68-d3d4-4924-b522-eb6817d8f9d7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:53:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Updating instance_info_cache with network_info: [{"id": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "address": "fa:16:3e:98:90:b0", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46015a6f-b9", "ovs_interfaceid": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Releasing lock "refresh_cache-2c34fc68-d3d4-4924-b522-eb6817d8f9d7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Instance network_info: |[{"id": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "address": "fa:16:3e:98:90:b0", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46015a6f-b9", "ovs_interfaceid": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9a34fb17-599a-461a-b584-f9bb10a508f6 req-07041e55-a925-4c0c-8c7c-75fc08ef49a6 service nova] Acquired lock "refresh_cache-2c34fc68-d3d4-4924-b522-eb6817d8f9d7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-9a34fb17-599a-461a-b584-f9bb10a508f6 req-07041e55-a925-4c0c-8c7c-75fc08ef49a6 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Refreshing network info cache for port 46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Start _get_guest_xml network_info=[{"id": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "address": "fa:16:3e:98:90:b0", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46015a6f-b9", "ovs_interfaceid": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:53:43 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:53:43 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1368039725',display_name='tempest-VolumesSnapshotTestJSON-instance-1368039725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1368039725',id=44,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtevzp2w+iSaGZxrO+lZJ1tYskOgeM72gTDIGlJOFhfdb9rgtn+c1VXfWp2YVK3EBFjTZY6S6h9vQ371VsX5c48HPMBCNXPvnOimYurq7wRpGnvm5vnna9vLXorrg+tUw==',key_name='tempest-keypair-1107695877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6982c498eeb94d8381a610cb59694191',ramdisk_id='',reservation_id='r-v370coc9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-472009357',owner_user_name='tempest-VolumesSnapshotTestJSON-472009357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:53:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77d81649b61a40ee87e4fc3c7cc56c7d',uuid=2c34fc68-d3d4-4924-b522-eb6817d8f9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "address": "fa:16:3e:98:90:b0", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46015a6f-b9", "ovs_interfaceid": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Converting VIF {"id": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "address": "fa:16:3e:98:90:b0", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46015a6f-b9", "ovs_interfaceid": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:90:b0,bridge_name='br-int',has_traffic_filtering=True,id=46015a6f-b90c-43c0-877f-ed3c2b64a1ae,network=Network(8b1a154d-9ae1-4829-a3f1-001cf4ae3658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46015a6f-b9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c34fc68-d3d4-4924-b522-eb6817d8f9d7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:53:43 user nova-compute[73091]:   <uuid>2c34fc68-d3d4-4924-b522-eb6817d8f9d7</uuid>
Aug 09 16:53:43 user nova-compute[73091]:   <name>instance-0000002c</name>
Aug 09 16:53:43 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:53:43 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:53:43 user nova-compute[73091]:   <metadata>
Aug 09 16:53:43 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:53:43 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:53:43 user nova-compute[73091]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1368039725</nova:name>
Aug 09 16:53:43 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:53:43</nova:creationTime>
Aug 09 16:53:43 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:53:43 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:53:43 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:53:43 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:53:43 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:53:43 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:53:43 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:53:43 user nova-compute[73091]:       <nova:owner>
Aug 09 16:53:43 user nova-compute[73091]:         <nova:user uuid="77d81649b61a40ee87e4fc3c7cc56c7d">tempest-VolumesSnapshotTestJSON-472009357-project-member</nova:user>
Aug 09 16:53:43 user nova-compute[73091]:         <nova:project uuid="6982c498eeb94d8381a610cb59694191">tempest-VolumesSnapshotTestJSON-472009357</nova:project>
Aug 09 16:53:43 user nova-compute[73091]:       </nova:owner>
Aug 09 16:53:43 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:53:43 user nova-compute[73091]:       <nova:ports>
Aug 09 16:53:43 user nova-compute[73091]:         <nova:port uuid="46015a6f-b90c-43c0-877f-ed3c2b64a1ae">
Aug 09 16:53:43 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 16:53:43 user nova-compute[73091]:         </nova:port>
Aug 09 16:53:43 user nova-compute[73091]:       </nova:ports>
Aug 09 16:53:43 user nova-compute[73091]:     </nova:instance>
Aug 09 16:53:43 user nova-compute[73091]:   </metadata>
Aug 09 16:53:43 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:53:43 user nova-compute[73091]:     <system>
Aug 09 16:53:43 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:53:43 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:53:43 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:53:43 user nova-compute[73091]:       <entry name="serial">2c34fc68-d3d4-4924-b522-eb6817d8f9d7</entry>
Aug 09 16:53:43 user nova-compute[73091]:       <entry name="uuid">2c34fc68-d3d4-4924-b522-eb6817d8f9d7</entry>
Aug 09 16:53:43 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:53:43 user nova-compute[73091]:     </system>
Aug 09 16:53:43 user nova-compute[73091]:   </sysinfo>
Aug 09 16:53:43 user nova-compute[73091]:   <os>
Aug 09 16:53:43 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:53:43 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:53:43 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:53:43 user nova-compute[73091]:   </os>
Aug 09 16:53:43 user nova-compute[73091]:   <features>
Aug 09 16:53:43 user nova-compute[73091]:     <acpi/>
Aug 09 16:53:43 user nova-compute[73091]:     <apic/>
Aug 09 16:53:43 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:53:43 user nova-compute[73091]:   </features>
Aug 09 16:53:43 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:53:43 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:53:43 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:53:43 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:53:43 user nova-compute[73091]:   </clock>
Aug 09 16:53:43 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:53:43 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:53:43 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:53:43 user nova-compute[73091]:   </cpu>
Aug 09 16:53:43 user nova-compute[73091]:   <devices>
Aug 09 16:53:43 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:53:43 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:53:43 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7/disk"/>
Aug 09 16:53:43 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:53:43 user nova-compute[73091]:     </disk>
Aug 09 16:53:43 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:53:43 user nova-compute[73091]:       <mac address="fa:16:3e:98:90:b0"/>
Aug 09 16:53:43 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:53:43 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:53:43 user nova-compute[73091]:       <target dev="tap46015a6f-b9"/>
Aug 09 16:53:43 user nova-compute[73091]:     </interface>
Aug 09 16:53:43 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:53:43 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7/console.log" append="off"/>
Aug 09 16:53:43 user nova-compute[73091]:     </serial>
Aug 09 16:53:43 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:53:43 user nova-compute[73091]:     <video>
Aug 09 16:53:43 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:53:43 user nova-compute[73091]:     </video>
Aug 09 16:53:43 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:53:43 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:53:43 user nova-compute[73091]:     </rng>
Aug 09 16:53:43 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:53:43 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:53:43 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:53:43 user nova-compute[73091]:     </memballoon>
Aug 09 16:53:43 user nova-compute[73091]:   </devices>
Aug 09 16:53:43 user nova-compute[73091]: </domain>
Aug 09 16:53:43 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1368039725',display_name='tempest-VolumesSnapshotTestJSON-instance-1368039725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1368039725',id=44,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtevzp2w+iSaGZxrO+lZJ1tYskOgeM72gTDIGlJOFhfdb9rgtn+c1VXfWp2YVK3EBFjTZY6S6h9vQ371VsX5c48HPMBCNXPvnOimYurq7wRpGnvm5vnna9vLXorrg+tUw==',key_name='tempest-keypair-1107695877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6982c498eeb94d8381a610cb59694191',ramdisk_id='',reservation_id='r-v370coc9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-472009357',owner_user_name='tempest-VolumesSnapshotTestJSON-472009357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:53:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77d81649b61a40ee87e4fc3c7cc56c7d',uuid=2c34fc68-d3d4-4924-b522-eb6817d8f9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "address": "fa:16:3e:98:90:b0", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46015a6f-b9", "ovs_interfaceid": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Converting VIF {"id": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "address": "fa:16:3e:98:90:b0", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46015a6f-b9", "ovs_interfaceid": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:90:b0,bridge_name='br-int',has_traffic_filtering=True,id=46015a6f-b90c-43c0-877f-ed3c2b64a1ae,network=Network(8b1a154d-9ae1-4829-a3f1-001cf4ae3658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46015a6f-b9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG os_vif [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:90:b0,bridge_name='br-int',has_traffic_filtering=True,id=46015a6f-b90c-43c0-877f-ed3c2b64a1ae,network=Network(8b1a154d-9ae1-4829-a3f1-001cf4ae3658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46015a6f-b9') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46015a6f-b9, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap46015a6f-b9, col_values=(('external_ids', {'iface-id': '46015a6f-b90c-43c0-877f-ed3c2b64a1ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:90:b0', 'vm-uuid': '2c34fc68-d3d4-4924-b522-eb6817d8f9d7'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:43 user nova-compute[73091]: INFO os_vif [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:90:b0,bridge_name='br-int',has_traffic_filtering=True,id=46015a6f-b90c-43c0-877f-ed3c2b64a1ae,network=Network(8b1a154d-9ae1-4829-a3f1-001cf4ae3658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46015a6f-b9')
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] No VIF found with MAC fa:16:3e:98:90:b0, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-9a34fb17-599a-461a-b584-f9bb10a508f6 req-07041e55-a925-4c0c-8c7c-75fc08ef49a6 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Updated VIF entry in instance network info cache for port 46015a6f-b90c-43c0-877f-ed3c2b64a1ae. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-9a34fb17-599a-461a-b584-f9bb10a508f6 req-07041e55-a925-4c0c-8c7c-75fc08ef49a6 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Updating instance_info_cache with network_info: [{"id": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "address": "fa:16:3e:98:90:b0", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46015a6f-b9", "ovs_interfaceid": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:53:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9a34fb17-599a-461a-b584-f9bb10a508f6 req-07041e55-a925-4c0c-8c7c-75fc08ef49a6 service nova] Releasing lock "refresh_cache-2c34fc68-d3d4-4924-b522-eb6817d8f9d7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:53:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-30330485-fd92-4d2d-97e3-ec229f208d51 req-89fb5119-dfcd-48e3-a9c2-8a77f698916d service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Received event network-vif-plugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-30330485-fd92-4d2d-97e3-ec229f208d51 req-89fb5119-dfcd-48e3-a9c2-8a77f698916d service nova] Acquiring lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-30330485-fd92-4d2d-97e3-ec229f208d51 req-89fb5119-dfcd-48e3-a9c2-8a77f698916d service nova] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-30330485-fd92-4d2d-97e3-ec229f208d51 req-89fb5119-dfcd-48e3-a9c2-8a77f698916d service nova] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-30330485-fd92-4d2d-97e3-ec229f208d51 req-89fb5119-dfcd-48e3-a9c2-8a77f698916d service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] No waiting events found dispatching network-vif-plugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:53:45 user nova-compute[73091]: WARNING nova.compute.manager [req-30330485-fd92-4d2d-97e3-ec229f208d51 req-89fb5119-dfcd-48e3-a9c2-8a77f698916d service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Received unexpected event network-vif-plugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae for instance with vm_state building and task_state spawning.
Aug 09 16:53:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:47 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600027.0729542, 2c34fc68-d3d4-4924-b522-eb6817d8f9d7 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:53:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] VM Resumed (Lifecycle Event)
Aug 09 16:53:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:53:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:53:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Instance spawned successfully.
Aug 09 16:53:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:53:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:53:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:53:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:53:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:53:47 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600027.0799031, 2c34fc68-d3d4-4924-b522-eb6817d8f9d7 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:53:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] VM Started (Lifecycle Event)
Aug 09 16:53:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:53:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:53:47 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:53:47 user nova-compute[73091]: INFO nova.compute.manager [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Took 6.12 seconds to spawn the instance on the hypervisor.
Aug 09 16:53:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:53:47 user nova-compute[73091]: INFO nova.compute.manager [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Took 7.23 seconds to build instance.
Aug 09 16:53:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-155eb7da-d37a-4647-8507-ead62b6f989b req-c77e42b1-b1cf-4f75-93a5-bc5e891cdc94 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Received event network-vif-plugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:53:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-155eb7da-d37a-4647-8507-ead62b6f989b req-c77e42b1-b1cf-4f75-93a5-bc5e891cdc94 service nova] Acquiring lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:53:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-155eb7da-d37a-4647-8507-ead62b6f989b req-c77e42b1-b1cf-4f75-93a5-bc5e891cdc94 service nova] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:53:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-155eb7da-d37a-4647-8507-ead62b6f989b req-c77e42b1-b1cf-4f75-93a5-bc5e891cdc94 service nova] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-155eb7da-d37a-4647-8507-ead62b6f989b req-c77e42b1-b1cf-4f75-93a5-bc5e891cdc94 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] No waiting events found dispatching network-vif-plugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:53:47 user nova-compute[73091]: WARNING nova.compute.manager [req-155eb7da-d37a-4647-8507-ead62b6f989b req-c77e42b1-b1cf-4f75-93a5-bc5e891cdc94 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Received unexpected event network-vif-plugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae for instance with vm_state active and task_state None.
Aug 09 16:53:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a2dd30ae-cf45-4d5d-883d-26d028cef8e8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.374s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:53:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:53:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:54:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:54:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:54:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:54:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:54:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 16:54:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 16:54:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:54:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 16:54:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:54:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:54:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-c3871ef4-45e7-4118-8227-e48cc857d481" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:54:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-c3871ef4-45e7-4118-8227-e48cc857d481" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:54:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:54:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:54:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:54:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:54:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:54:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:54:19 user nova-compute[73091]: INFO nova.compute.manager [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Terminating instance
Aug 09 16:54:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:54:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Updating instance_info_cache with network_info: [{"id": "1d3f6a45-6b36-4603-b510-442d6ba16232", "address": "fa:16:3e:78:8d:86", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3f6a45-6b", "ovs_interfaceid": "1d3f6a45-6b36-4603-b510-442d6ba16232", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:54:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-1f11eedb-568e-4eee-9b73-0a58a0bd9dce req-a114817b-b1c0-4024-9c20-bc007151ba7c service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received event network-vif-unplugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:54:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1f11eedb-568e-4eee-9b73-0a58a0bd9dce req-a114817b-b1c0-4024-9c20-bc007151ba7c service nova] Acquiring lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:54:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1f11eedb-568e-4eee-9b73-0a58a0bd9dce req-a114817b-b1c0-4024-9c20-bc007151ba7c service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:54:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1f11eedb-568e-4eee-9b73-0a58a0bd9dce req-a114817b-b1c0-4024-9c20-bc007151ba7c service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:54:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-1f11eedb-568e-4eee-9b73-0a58a0bd9dce req-a114817b-b1c0-4024-9c20-bc007151ba7c service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] No waiting events found dispatching network-vif-unplugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:54:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-1f11eedb-568e-4eee-9b73-0a58a0bd9dce req-a114817b-b1c0-4024-9c20-bc007151ba7c service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received event network-vif-unplugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:54:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-c3871ef4-45e7-4118-8227-e48cc857d481" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:54:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:54:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Instance destroyed successfully.
Aug 09 16:54:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'resources' on Instance uuid 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:54:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1022344144',display_name='tempest-ServerRescueNegativeTestJSON-server-1022344144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1022344144',id=33,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJeBceutq8beCoz7o5tRRL6nOu5QPrjWN+s6rvp9Fvssl1/IzP36PGvY7B+nY9X7lGk8okKCsSnHSaKD5G55lUhqdGH+XIHRSNC2lzJa8k3fRIhiL23Yb1SGPcolqezVw==',key_name='tempest-keypair-1565128997',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:49:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a03dd6b23c840c7b4a07f0235c1051b',ramdisk_id='',reservation_id='r-77ymisa2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-596687024',owner_user_name='tempest-ServerRescueNegativeTestJSON-596687024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:51:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef7727ab5d1b46d383bfc02750d29ec7',uuid=3ef6c7f1-c8c4-49e1-819a-e8196eae70e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "address": "fa:16:3e:6e:98:76", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb647b7d-fa", "ovs_interfaceid": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:54:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converting VIF {"id": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "address": "fa:16:3e:6e:98:76", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb647b7d-fa", "ovs_interfaceid": "eb647b7d-fa5b-4876-99da-b3c3ef59c0e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:54:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:98:76,bridge_name='br-int',has_traffic_filtering=True,id=eb647b7d-fa5b-4876-99da-b3c3ef59c0e7,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb647b7d-fa') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:54:20 user nova-compute[73091]: DEBUG os_vif [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:98:76,bridge_name='br-int',has_traffic_filtering=True,id=eb647b7d-fa5b-4876-99da-b3c3ef59c0e7,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb647b7d-fa') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:54:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb647b7d-fa, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:54:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:54:20 user nova-compute[73091]: INFO os_vif [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:98:76,bridge_name='br-int',has_traffic_filtering=True,id=eb647b7d-fa5b-4876-99da-b3c3ef59c0e7,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb647b7d-fa')
Aug 09 16:54:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Deleting instance files /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2_del
Aug 09 16:54:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Deletion of /opt/stack/data/nova/instances/3ef6c7f1-c8c4-49e1-819a-e8196eae70e2_del complete
Aug 09 16:54:20 user nova-compute[73091]: INFO nova.compute.manager [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 09 16:54:20 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:54:20 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:54:20 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:54:21 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:54:21 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Took 1.10 seconds to deallocate network for instance.
Aug 09 16:54:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:54:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:54:21 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Refreshing inventories for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 16:54:21 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Updating ProviderTree inventory for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 16:54:21 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Updating inventory in ProviderTree for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 16:54:21 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Refreshing aggregate associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 16:54:21 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Refreshing trait associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, traits: HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 16:54:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-727c4cc9-e8f1-4404-8ae5-614dd1a9d849 req-ee5a00c3-c324-4807-8af9-abef12fb772a service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received event network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:54:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-727c4cc9-e8f1-4404-8ae5-614dd1a9d849 req-ee5a00c3-c324-4807-8af9-abef12fb772a service nova] Acquiring lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:54:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-727c4cc9-e8f1-4404-8ae5-614dd1a9d849 req-ee5a00c3-c324-4807-8af9-abef12fb772a service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:54:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-727c4cc9-e8f1-4404-8ae5-614dd1a9d849 req-ee5a00c3-c324-4807-8af9-abef12fb772a service nova] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:54:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-727c4cc9-e8f1-4404-8ae5-614dd1a9d849 req-ee5a00c3-c324-4807-8af9-abef12fb772a service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] No waiting events found dispatching network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:54:21 user nova-compute[73091]: WARNING nova.compute.manager [req-727c4cc9-e8f1-4404-8ae5-614dd1a9d849 req-ee5a00c3-c324-4807-8af9-abef12fb772a service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received unexpected event network-vif-plugged-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 for instance with vm_state deleted and task_state None.
Aug 09 16:54:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-727c4cc9-e8f1-4404-8ae5-614dd1a9d849 req-ee5a00c3-c324-4807-8af9-abef12fb772a service nova] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Received event network-vif-deleted-eb647b7d-fa5b-4876-99da-b3c3ef59c0e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:54:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:54:22 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:54:22 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:54:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.755s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:54:22 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Deleted allocations for instance 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2
Aug 09 16:54:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-802fddf9-d1fc-4379-a3a8-c09fab35fede tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "3ef6c7f1-c8c4-49e1-819a-e8196eae70e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.992s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:54:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:54:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:54:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:54:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:54:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:54:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:54:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:54:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:54:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76055017-05ff-4ea7-ae9c-66d2e502e090/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76055017-05ff-4ea7-ae9c-66d2e502e090/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:54:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76055017-05ff-4ea7-ae9c-66d2e502e090/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76055017-05ff-4ea7-ae9c-66d2e502e090/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:54:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:54:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:54:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:54:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:54:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:54:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:54:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:54:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:54:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:54:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:54:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:54:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:54:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:54:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:54:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:54:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:54:27 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:54:27 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:54:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7446MB free_disk=25.029869079589844GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:54:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:54:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:54:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f939fe27-017a-481e-babc-147bf98e0132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:54:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8fc884a8-24bb-488a-baeb-ef2b1faf239d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:54:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c3871ef4-45e7-4118-8227-e48cc857d481 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:54:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance bfb5340a-2329-4bd2-9f94-52ef24967a9b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:54:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 76055017-05ff-4ea7-ae9c-66d2e502e090 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:54:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance fd3ac804-7b4d-43a0-9837-20a98ea7615d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:54:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:54:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:54:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 2c34fc68-d3d4-4924-b522-eb6817d8f9d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:54:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:54:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:54:27 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:54:27 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:54:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:54:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:54:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:54:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:54:35 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691600060.0575051, 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:54:35 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] VM Stopped (Lifecycle Event)
Aug 09 16:54:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-310788fd-ae27-4b2c-93d3-f7db96b92a33 None None] [instance: 3ef6c7f1-c8c4-49e1-819a-e8196eae70e2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:54:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:54:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 16:54:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:54:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:54:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:54:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:54:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:54:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 16:54:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:54:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:54:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-f03e3841-eea2-4489-a1a7-f02ef9664c63 req-6f10549d-4c0c-457a-ab57-724ab21a7543 service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Received event network-changed-0acd9658-83ff-499d-8a65-12cb09854bce {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:54:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-f03e3841-eea2-4489-a1a7-f02ef9664c63 req-6f10549d-4c0c-457a-ab57-724ab21a7543 service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Refreshing instance network info cache due to event network-changed-0acd9658-83ff-499d-8a65-12cb09854bce. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:54:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f03e3841-eea2-4489-a1a7-f02ef9664c63 req-6f10549d-4c0c-457a-ab57-724ab21a7543 service nova] Acquiring lock "refresh_cache-fd3ac804-7b4d-43a0-9837-20a98ea7615d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:54:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f03e3841-eea2-4489-a1a7-f02ef9664c63 req-6f10549d-4c0c-457a-ab57-724ab21a7543 service nova] Acquired lock "refresh_cache-fd3ac804-7b4d-43a0-9837-20a98ea7615d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:54:52 user nova-compute[73091]: DEBUG nova.network.neutron [req-f03e3841-eea2-4489-a1a7-f02ef9664c63 req-6f10549d-4c0c-457a-ab57-724ab21a7543 service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Refreshing network info cache for port 0acd9658-83ff-499d-8a65-12cb09854bce {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:54:52 user nova-compute[73091]: DEBUG nova.network.neutron [req-f03e3841-eea2-4489-a1a7-f02ef9664c63 req-6f10549d-4c0c-457a-ab57-724ab21a7543 service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Updated VIF entry in instance network info cache for port 0acd9658-83ff-499d-8a65-12cb09854bce. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:54:52 user nova-compute[73091]: DEBUG nova.network.neutron [req-f03e3841-eea2-4489-a1a7-f02ef9664c63 req-6f10549d-4c0c-457a-ab57-724ab21a7543 service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Updating instance_info_cache with network_info: [{"id": "0acd9658-83ff-499d-8a65-12cb09854bce", "address": "fa:16:3e:5a:e0:5a", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acd9658-83", "ovs_interfaceid": "0acd9658-83ff-499d-8a65-12cb09854bce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:54:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f03e3841-eea2-4489-a1a7-f02ef9664c63 req-6f10549d-4c0c-457a-ab57-724ab21a7543 service nova] Releasing lock "refresh_cache-fd3ac804-7b4d-43a0-9837-20a98ea7615d" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:54:53 user nova-compute[73091]: INFO nova.compute.manager [None req-a413401c-407e-42b4-ac20-ae0eeee6beb9 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Unrescuing
Aug 09 16:54:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a413401c-407e-42b4-ac20-ae0eeee6beb9 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:54:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a413401c-407e-42b4-ac20-ae0eeee6beb9 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquired lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:54:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a413401c-407e-42b4-ac20-ae0eeee6beb9 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:54:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a413401c-407e-42b4-ac20-ae0eeee6beb9 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Updating instance_info_cache with network_info: [{"id": "58bf6094-42a8-4567-abea-27c63a57cf8a", "address": "fa:16:3e:f3:dd:72", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf6094-42", "ovs_interfaceid": "58bf6094-42a8-4567-abea-27c63a57cf8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:54:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a413401c-407e-42b4-ac20-ae0eeee6beb9 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Releasing lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:54:54 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a413401c-407e-42b4-ac20-ae0eeee6beb9 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'flavor' on Instance uuid 76055017-05ff-4ea7-ae9c-66d2e502e090 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:54:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-1ea9a303-25f8-4f47-b9db-21150fde3965 req-9f3ce483-8036-4827-94bb-790fe311083e service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received event network-vif-unplugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:54:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1ea9a303-25f8-4f47-b9db-21150fde3965 req-9f3ce483-8036-4827-94bb-790fe311083e service nova] Acquiring lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:54:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1ea9a303-25f8-4f47-b9db-21150fde3965 req-9f3ce483-8036-4827-94bb-790fe311083e service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:54:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1ea9a303-25f8-4f47-b9db-21150fde3965 req-9f3ce483-8036-4827-94bb-790fe311083e service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:54:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-1ea9a303-25f8-4f47-b9db-21150fde3965 req-9f3ce483-8036-4827-94bb-790fe311083e service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] No waiting events found dispatching network-vif-unplugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:54:54 user nova-compute[73091]: WARNING nova.compute.manager [req-1ea9a303-25f8-4f47-b9db-21150fde3965 req-9f3ce483-8036-4827-94bb-790fe311083e service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received unexpected event network-vif-unplugged-58bf6094-42a8-4567-abea-27c63a57cf8a for instance with vm_state rescued and task_state unrescuing.
Aug 09 16:54:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:54 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Instance destroyed successfully.
Aug 09 16:54:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:54:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:54:55 user nova-compute[73091]: DEBUG nova.objects.instance [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'flavor' on Instance uuid fd3ac804-7b4d-43a0-9837-20a98ea7615d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:54:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:54:56 user nova-compute[73091]: INFO nova.compute.manager [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Attaching volume dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 to /dev/vdb
Aug 09 16:54:56 user nova-compute[73091]: DEBUG os_brick.utils [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2df0d35-6dec-47dd-a4f3-2e5f2ce5c835]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2b1a7b-664e-41c2-8d4e-72dbae13488e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec0c10a-3c75-41f1-9f70-075b445a6310]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95ccc17-9c46-4605-8e89-251d547c60fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:54:56 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d947a2-6c4f-419a-ae31-791852512842]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG os_brick.utils [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Updating existing volume attachment record: b0cd3c9e-5be1-4b23-b56b-e868a1bdf095 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-5c210b08-d9e1-47a9-a75a-91d562882061 req-d24cad97-c799-4c29-ada4-f5b608d67f7a service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received event network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5c210b08-d9e1-47a9-a75a-91d562882061 req-d24cad97-c799-4c29-ada4-f5b608d67f7a service nova] Acquiring lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5c210b08-d9e1-47a9-a75a-91d562882061 req-d24cad97-c799-4c29-ada4-f5b608d67f7a service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5c210b08-d9e1-47a9-a75a-91d562882061 req-d24cad97-c799-4c29-ada4-f5b608d67f7a service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-5c210b08-d9e1-47a9-a75a-91d562882061 req-d24cad97-c799-4c29-ada4-f5b608d67f7a service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] No waiting events found dispatching network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:54:56 user nova-compute[73091]: WARNING nova.compute.manager [req-5c210b08-d9e1-47a9-a75a-91d562882061 req-d24cad97-c799-4c29-ada4-f5b608d67f7a service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received unexpected event network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a for instance with vm_state rescued and task_state unrescuing.
Aug 09 16:54:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-5c210b08-d9e1-47a9-a75a-91d562882061 req-d24cad97-c799-4c29-ada4-f5b608d67f7a service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received event network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5c210b08-d9e1-47a9-a75a-91d562882061 req-d24cad97-c799-4c29-ada4-f5b608d67f7a service nova] Acquiring lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5c210b08-d9e1-47a9-a75a-91d562882061 req-d24cad97-c799-4c29-ada4-f5b608d67f7a service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5c210b08-d9e1-47a9-a75a-91d562882061 req-d24cad97-c799-4c29-ada4-f5b608d67f7a service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:54:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-5c210b08-d9e1-47a9-a75a-91d562882061 req-d24cad97-c799-4c29-ada4-f5b608d67f7a service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] No waiting events found dispatching network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:54:56 user nova-compute[73091]: WARNING nova.compute.manager [req-5c210b08-d9e1-47a9-a75a-91d562882061 req-d24cad97-c799-4c29-ada4-f5b608d67f7a service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received unexpected event network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a for instance with vm_state rescued and task_state unrescuing.
Aug 09 16:54:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Removed pending event for 76055017-05ff-4ea7-ae9c-66d2e502e090 due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 16:54:58 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600098.2062223, 76055017-05ff-4ea7-ae9c-66d2e502e090 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:54:58 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] VM Resumed (Lifecycle Event)
Aug 09 16:54:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a413401c-407e-42b4-ac20-ae0eeee6beb9 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:54:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:54:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:54:58 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 16:54:58 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600098.206746, 76055017-05ff-4ea7-ae9c-66d2e502e090 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:54:58 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] VM Started (Lifecycle Event)
Aug 09 16:54:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:54:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:54:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-d1b939f0-8910-4939-ba36-2c53c6ee019e req-2edc5d95-ad6e-40a3-b85a-1dc020ca974b service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received event network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:54:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d1b939f0-8910-4939-ba36-2c53c6ee019e req-2edc5d95-ad6e-40a3-b85a-1dc020ca974b service nova] Acquiring lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:54:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d1b939f0-8910-4939-ba36-2c53c6ee019e req-2edc5d95-ad6e-40a3-b85a-1dc020ca974b service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:54:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d1b939f0-8910-4939-ba36-2c53c6ee019e req-2edc5d95-ad6e-40a3-b85a-1dc020ca974b service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:54:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-d1b939f0-8910-4939-ba36-2c53c6ee019e req-2edc5d95-ad6e-40a3-b85a-1dc020ca974b service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] No waiting events found dispatching network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:54:58 user nova-compute[73091]: WARNING nova.compute.manager [req-d1b939f0-8910-4939-ba36-2c53c6ee019e req-2edc5d95-ad6e-40a3-b85a-1dc020ca974b service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received unexpected event network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a for instance with vm_state active and task_state None.
Aug 09 16:55:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YauLFMrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:55:04 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:55:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:55:04 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:55:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:55:04 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[74391f9b-1a23-4ba7-8cbd-67a60d440482]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:55:04 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[565b51ef-966e-4fd0-b4ac-3ae9cb9a3210]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8] added
Aug 09 16:55:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7550f820-df3d-46c7-81e6-fc6d1b4aef68]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faf140e-dfb5-4203-93b2-5ec5288ea974]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YauLFMrB {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YauLFMrB" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c166f47-7f17-4ac8-aca6-a7eebccfd7b0]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YauLFMrB'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[96619b09-41c5-44d0-b17f-2ec2b732f16e]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[90677a48-cad1-4e04-971d-0596fd9fd441]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:04 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:04 user nova-compute[73091]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 (non-flash)
Aug 09 16:55:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:04 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:04 user nova-compute[73091]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 (non-flash)
Aug 09 16:55:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:55:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb55055b-f7d7-40cd-8734-908c2787b329]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8, portal: 172.16.0.220,3260]
Aug 09 16:55:05 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8, portal: 172.16.0.220,3260] successful.
Aug 09 16:55:05 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd07d00-2a13-4120-b8ff-f2bc27c64066]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1921f7e9-86e0-43dd-9ee4-a05a7e828628]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:05 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:05 user nova-compute[73091]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 (non-flash)
Aug 09 16:55:05 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 (non-flash)
Aug 09 16:55:05 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:05 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:05 user nova-compute[73091]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 (non-flash)
Aug 09 16:55:05 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 (non-flash)
Aug 09 16:55:05 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f3b850-6853-479d-90fe-9ba44a2fe723]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YauLFMrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-e0f1b9bc-61c6-4cf6-9e90-add9034a46be req-e3a5f63b-1c68-44fc-bcc0-f9b0da753346 service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Received event network-changed-cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-e0f1b9bc-61c6-4cf6-9e90-add9034a46be req-e3a5f63b-1c68-44fc-bcc0-f9b0da753346 service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Refreshing instance network info cache due to event network-changed-cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e0f1b9bc-61c6-4cf6-9e90-add9034a46be req-e3a5f63b-1c68-44fc-bcc0-f9b0da753346 service nova] Acquiring lock "refresh_cache-bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e0f1b9bc-61c6-4cf6-9e90-add9034a46be req-e3a5f63b-1c68-44fc-bcc0-f9b0da753346 service nova] Acquired lock "refresh_cache-bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:55:05 user nova-compute[73091]: DEBUG nova.network.neutron [req-e0f1b9bc-61c6-4cf6-9e90-add9034a46be req-e3a5f63b-1c68-44fc-bcc0-f9b0da753346 service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Refreshing network info cache for port cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:55:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:55:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26639663466313834', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:55:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639663466313834', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:55:06 user nova-compute[73091]: DEBUG nova.objects.instance [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'flavor' on Instance uuid fd3ac804-7b4d-43a0-9837-20a98ea7615d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:55:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:55:06 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:55:06 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 09 16:55:06 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:55:06 user nova-compute[73091]:   <serial>dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8</serial>
Aug 09 16:55:06 user nova-compute[73091]: </disk>
Aug 09 16:55:06 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:55:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:55:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:55:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] No VIF found with MAC fa:16:3e:5a:e0:5a, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:55:06 user nova-compute[73091]: DEBUG nova.network.neutron [req-e0f1b9bc-61c6-4cf6-9e90-add9034a46be req-e3a5f63b-1c68-44fc-bcc0-f9b0da753346 service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Updated VIF entry in instance network info cache for port cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:55:06 user nova-compute[73091]: DEBUG nova.network.neutron [req-e0f1b9bc-61c6-4cf6-9e90-add9034a46be req-e3a5f63b-1c68-44fc-bcc0-f9b0da753346 service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Updating instance_info_cache with network_info: [{"id": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "address": "fa:16:3e:28:90:8c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd30f6db-9d", "ovs_interfaceid": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:55:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e0f1b9bc-61c6-4cf6-9e90-add9034a46be req-e3a5f63b-1c68-44fc-bcc0-f9b0da753346 service nova] Releasing lock "refresh_cache-bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:55:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-348f2ef5-42ab-4400-8739-15a572c5a1bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.658s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-df5bc7a9-89e2-40cd-94ff-a7e4ff76f558 req-3abf5322-8511-4c1e-bc6d-9326eed60f6b service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Received event network-changed-cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-df5bc7a9-89e2-40cd-94ff-a7e4ff76f558 req-3abf5322-8511-4c1e-bc6d-9326eed60f6b service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Refreshing instance network info cache due to event network-changed-cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-df5bc7a9-89e2-40cd-94ff-a7e4ff76f558 req-3abf5322-8511-4c1e-bc6d-9326eed60f6b service nova] Acquiring lock "refresh_cache-bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-df5bc7a9-89e2-40cd-94ff-a7e4ff76f558 req-3abf5322-8511-4c1e-bc6d-9326eed60f6b service nova] Acquired lock "refresh_cache-bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG nova.network.neutron [req-df5bc7a9-89e2-40cd-94ff-a7e4ff76f558 req-3abf5322-8511-4c1e-bc6d-9326eed60f6b service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Refreshing network info cache for port cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:07 user nova-compute[73091]: INFO nova.compute.manager [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Terminating instance
Aug 09 16:55:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:07 user nova-compute[73091]: INFO nova.compute.manager [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Detaching volume dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8
Aug 09 16:55:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:07 user nova-compute[73091]: INFO nova.virt.block_device [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Attempting to driver detach volume dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 from mountpoint /dev/vdb
Aug 09 16:55:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Attempting to detach device vdb from instance fd3ac804-7b4d-43a0-9837-20a98ea7615d from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:55:07 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:55:07 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 09 16:55:07 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:55:07 user nova-compute[73091]:   <serial>dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8</serial>
Aug 09 16:55:07 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:55:07 user nova-compute[73091]: </disk>
Aug 09 16:55:07 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:55:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Successfully detached device vdb from instance fd3ac804-7b4d-43a0-9837-20a98ea7615d from the persistent domain config.
Aug 09 16:55:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fd3ac804-7b4d-43a0-9837-20a98ea7615d from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:55:07 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:55:07 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 09 16:55:07 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:55:07 user nova-compute[73091]:   <serial>dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8</serial>
Aug 09 16:55:07 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:55:07 user nova-compute[73091]: </disk>
Aug 09 16:55:07 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-18cb190b-8d12-4f3c-893c-70275ddae357 req-876b506b-f4a8-49e4-8fbb-34ce4b49fe1c service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Received event network-vif-unplugged-cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-18cb190b-8d12-4f3c-893c-70275ddae357 req-876b506b-f4a8-49e4-8fbb-34ce4b49fe1c service nova] Acquiring lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-18cb190b-8d12-4f3c-893c-70275ddae357 req-876b506b-f4a8-49e4-8fbb-34ce4b49fe1c service nova] Lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-18cb190b-8d12-4f3c-893c-70275ddae357 req-876b506b-f4a8-49e4-8fbb-34ce4b49fe1c service nova] Lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-18cb190b-8d12-4f3c-893c-70275ddae357 req-876b506b-f4a8-49e4-8fbb-34ce4b49fe1c service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] No waiting events found dispatching network-vif-unplugged-cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-18cb190b-8d12-4f3c-893c-70275ddae357 req-876b506b-f4a8-49e4-8fbb-34ce4b49fe1c service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Received event network-vif-unplugged-cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG nova.network.neutron [req-df5bc7a9-89e2-40cd-94ff-a7e4ff76f558 req-3abf5322-8511-4c1e-bc6d-9326eed60f6b service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Updated VIF entry in instance network info cache for port cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG nova.network.neutron [req-df5bc7a9-89e2-40cd-94ff-a7e4ff76f558 req-3abf5322-8511-4c1e-bc6d-9326eed60f6b service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Updating instance_info_cache with network_info: [{"id": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "address": "fa:16:3e:28:90:8c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd30f6db-9d", "ovs_interfaceid": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-df5bc7a9-89e2-40cd-94ff-a7e4ff76f558 req-3abf5322-8511-4c1e-bc6d-9326eed60f6b service nova] Releasing lock "refresh_cache-bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691600107.813288, fd3ac804-7b4d-43a0-9837-20a98ea7615d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fd3ac804-7b4d-43a0-9837-20a98ea7615d {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:55:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Successfully detached device vdb from instance fd3ac804-7b4d-43a0-9837-20a98ea7615d from the live domain config.
Aug 09 16:55:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YauLFMrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:55:07 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:55:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf9560e-e5d9-49dc-84a5-55842d4677f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bc13f7-9c73-46e2-b8ba-db5d6b78e59b]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:07 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:07 user nova-compute[73091]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 (non-flash)
Aug 09 16:55:07 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 (non-flash)
Aug 09 16:55:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:07 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:07 user nova-compute[73091]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 (non-flash)
Aug 09 16:55:07 user nova-compute[73091]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 (non-flash)
Aug 09 16:55:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff03cf2aef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Removing single pathed devices sde {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d857940-8785-4d5b-9baa-6830bf8f3b70]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e482965d-433b-484f-9edf-fc08de364524]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b900be-2cea-413e-8931-406c9d98cfa5]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b7e98c-7f3b-4bc5-87a9-5798d640266f]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:55:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4f232a-91b8-42e7-aff4-4e44d92e8a7d]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2f4aa5-b326-4d56-bc82-c60300acea3a]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8, portal: 172.16.0.220,3260]
Aug 09 16:55:08 user nova-compute[73091]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8, portal: 172.16.0.220,3260] successful.
Aug 09 16:55:08 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd30c1bb-eb0a-48d4-9d47-1f86aad03ef8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[807eb224-99fb-412d-9035-b2a93c27f046]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] <== disconnect_volume: return (289ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:55:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Instance destroyed successfully.
Aug 09 16:55:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lazy-loading 'resources' on Instance uuid bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:53:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1998680365',display_name='tempest-TestVolumeBootPattern-server-1998680365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1998680365',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSSzWQUVuDlac0eUgyT2z4iM1Y0qg2BfVrMrtynGR00pxQ570GYD8As3UZF1alKpRXt3lDEuXxBRenfT0VFniILv2ftKfjpM7Z1J3bJewWzw1Fr2JnxHpTfKfQmiSEWpw==',key_name='tempest-TestVolumeBootPattern-2063534983',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:53:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64d3dfd232d54594808dad271baa5192',ramdisk_id='',reservation_id='r-2gctoq20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1605875873',owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:53:31Z,user_data=None,user_id='69ccebf0e9d54502a2318c809ce11369',uuid=bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "address": "fa:16:3e:28:90:8c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd30f6db-9d", "ovs_interfaceid": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converting VIF {"id": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "address": "fa:16:3e:28:90:8c", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd30f6db-9d", "ovs_interfaceid": "cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:90:8c,bridge_name='br-int',has_traffic_filtering=True,id=cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd30f6db-9d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_vif [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:90:8c,bridge_name='br-int',has_traffic_filtering=True,id=cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd30f6db-9d') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd30f6db-9d, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:55:08 user nova-compute[73091]: INFO os_vif [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:90:8c,bridge_name='br-int',has_traffic_filtering=True,id=cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd30f6db-9d')
Aug 09 16:55:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrRMmbtK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:55:08 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f9d4a4-9c8e-43bc-8841-049af42aa3e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d72088-e085-4f15-98a5-f1db81e9809f]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:08 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:08 user nova-compute[73091]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 (non-flash)
Aug 09 16:55:08 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:08 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:08 user nova-compute[73091]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 (non-flash)
Aug 09 16:55:08 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0601fcca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[778ffbc7-87ab-4f78-af99-ad3704fbd6f5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3d8e8e-a6d7-49f6-a33b-e1128f370623]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be38ccc-a492-4568-a16b-447dafd469eb]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e851e48-3327-4b4f-b7d8-aeab2887791d]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23832326566616437', '/dev/disk/by-id/scsi-1SCST_BIOa60789b0-822efad7c5a3b991', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a60789b0') {{(pid=83925) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b0ac67-4a16-4096-bf02-fff50fa308df]: (4, None) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e72f882-36c8-4106-bbbc-a6bb690b6ddb]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac07e16-156d-4852-9500-6c64f78f0451]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715, portal: 172.16.0.220,3260]
Aug 09 16:55:08 user nova-compute[73091]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715, portal: 172.16.0.220,3260] successful.
Aug 09 16:55:08 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0301516-83e4-4c1b-8bfa-e2ed70ac2715 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c91106-27b6-435f-8523-12a69c8f867d]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] <== disconnect_volume: return (290ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:55:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Deleting instance files /opt/stack/data/nova/instances/bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1_del
Aug 09 16:55:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Deletion of /opt/stack/data/nova/instances/bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1_del complete
Aug 09 16:55:08 user nova-compute[73091]: INFO nova.compute.manager [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Took 1.40 seconds to destroy the instance on the hypervisor.
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'flavor' on Instance uuid fd3ac804-7b4d-43a0-9837-20a98ea7615d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:55:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bbf01fce-8464-4660-9b84-ae9624cd5118 tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.774s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:09 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:55:09 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Took 0.48 seconds to deallocate network for instance.
Aug 09 16:55:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-cee0b3e4-41d5-43f5-acc1-b76641d1af0c req-33567b71-503b-4f07-a73c-e65eb1cd681b service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Received event network-vif-deleted-cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:55:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-5a0d336e-32e1-4546-84f6-754dcb8ed3e7 req-59d73191-2b96-42fd-8971-ba2270f1aac9 service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Received event network-vif-plugged-cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:55:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5a0d336e-32e1-4546-84f6-754dcb8ed3e7 req-59d73191-2b96-42fd-8971-ba2270f1aac9 service nova] Acquiring lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5a0d336e-32e1-4546-84f6-754dcb8ed3e7 req-59d73191-2b96-42fd-8971-ba2270f1aac9 service nova] Lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5a0d336e-32e1-4546-84f6-754dcb8ed3e7 req-59d73191-2b96-42fd-8971-ba2270f1aac9 service nova] Lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-5a0d336e-32e1-4546-84f6-754dcb8ed3e7 req-59d73191-2b96-42fd-8971-ba2270f1aac9 service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] No waiting events found dispatching network-vif-plugged-cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:55:09 user nova-compute[73091]: WARNING nova.compute.manager [req-5a0d336e-32e1-4546-84f6-754dcb8ed3e7 req-59d73191-2b96-42fd-8971-ba2270f1aac9 service nova] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Received unexpected event network-vif-plugged-cd30f6db-9dc0-4ab3-9c17-5e485fa3d50a for instance with vm_state active and task_state deleting.
Aug 09 16:55:09 user nova-compute[73091]: INFO nova.compute.manager [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Took 0.71 seconds to detach 1 volumes for instance.
Aug 09 16:55:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:10 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:55:10 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:55:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:10 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Deleted allocations for instance bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1
Aug 09 16:55:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6e62a119-7a01-4c71-8bfe-1cc3d3de27bc tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.115s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:13 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:55:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:55:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:55:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:55:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:55:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:55:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:55:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 16:55:23 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691600108.1402874, bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:55:23 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] VM Stopped (Lifecycle Event)
Aug 09 16:55:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d46c6da8-6f0c-419c-b91f-be201661c2f4 None None] [instance: bef6cfbf-ebc7-4ea2-a67d-1747d31ec7e1] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:55:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:23 user nova-compute[73091]: INFO nova.compute.manager [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Terminating instance
Aug 09 16:55:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:55:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:55:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:55:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:55:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-0604cdec-12eb-43ce-bd21-5ca97b76a386 req-5e8c6546-5450-4d56-ba8a-2be5ca84c093 service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Received event network-vif-unplugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:55:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0604cdec-12eb-43ce-bd21-5ca97b76a386 req-5e8c6546-5450-4d56-ba8a-2be5ca84c093 service nova] Acquiring lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0604cdec-12eb-43ce-bd21-5ca97b76a386 req-5e8c6546-5450-4d56-ba8a-2be5ca84c093 service nova] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0604cdec-12eb-43ce-bd21-5ca97b76a386 req-5e8c6546-5450-4d56-ba8a-2be5ca84c093 service nova] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-0604cdec-12eb-43ce-bd21-5ca97b76a386 req-5e8c6546-5450-4d56-ba8a-2be5ca84c093 service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] No waiting events found dispatching network-vif-unplugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:55:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-0604cdec-12eb-43ce-bd21-5ca97b76a386 req-5e8c6546-5450-4d56-ba8a-2be5ca84c093 service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Received event network-vif-unplugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:55:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:24 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Instance destroyed successfully.
Aug 09 16:55:24 user nova-compute[73091]: DEBUG nova.objects.instance [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'resources' on Instance uuid 8fc884a8-24bb-488a-baeb-ef2b1faf239d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:55:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1973705747',display_name='tempest-ServerRescueNegativeTestJSON-server-1973705747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1973705747',id=20,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a03dd6b23c840c7b4a07f0235c1051b',ramdisk_id='',reservation_id='r-hw9kblzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-596687024',owner_user_name='tempest-ServerRescueNegativeTestJSON-596687024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:40:53Z,user_data=None,user_id='ef7727ab5d1b46d383bfc02750d29ec7',uuid=8fc884a8-24bb-488a-baeb-ef2b1faf239d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "address": "fa:16:3e:b3:de:fe", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ffdd03-c8", "ovs_interfaceid": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:55:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converting VIF {"id": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "address": "fa:16:3e:b3:de:fe", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38ffdd03-c8", "ovs_interfaceid": "38ffdd03-c883-43bd-9607-036e5f5bd8e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:55:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:de:fe,bridge_name='br-int',has_traffic_filtering=True,id=38ffdd03-c883-43bd-9607-036e5f5bd8e7,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38ffdd03-c8') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:55:24 user nova-compute[73091]: DEBUG os_vif [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:de:fe,bridge_name='br-int',has_traffic_filtering=True,id=38ffdd03-c883-43bd-9607-036e5f5bd8e7,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38ffdd03-c8') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:55:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38ffdd03-c8, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:55:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:55:24 user nova-compute[73091]: INFO os_vif [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:de:fe,bridge_name='br-int',has_traffic_filtering=True,id=38ffdd03-c883-43bd-9607-036e5f5bd8e7,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38ffdd03-c8')
Aug 09 16:55:24 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Deleting instance files /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d_del
Aug 09 16:55:24 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Deletion of /opt/stack/data/nova/instances/8fc884a8-24bb-488a-baeb-ef2b1faf239d_del complete
Aug 09 16:55:24 user nova-compute[73091]: INFO nova.compute.manager [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 16:55:24 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:55:24 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:55:24 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:55:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:25 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:55:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-ae71bcf3-c9dc-403a-82de-eb3c9336c33d req-ba950e67-3f1f-4f3b-a393-00449419c2d7 service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Received event network-vif-deleted-38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:55:25 user nova-compute[73091]: INFO nova.compute.manager [req-ae71bcf3-c9dc-403a-82de-eb3c9336c33d req-ba950e67-3f1f-4f3b-a393-00449419c2d7 service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Neutron deleted interface 38ffdd03-c883-43bd-9607-036e5f5bd8e7; detaching it from the instance and deleting it from the info cache
Aug 09 16:55:25 user nova-compute[73091]: DEBUG nova.network.neutron [req-ae71bcf3-c9dc-403a-82de-eb3c9336c33d req-ba950e67-3f1f-4f3b-a393-00449419c2d7 service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:55:25 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Took 0.81 seconds to deallocate network for instance.
Aug 09 16:55:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-ae71bcf3-c9dc-403a-82de-eb3c9336c33d req-ba950e67-3f1f-4f3b-a393-00449419c2d7 service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Detach interface failed, port_id=38ffdd03-c883-43bd-9607-036e5f5bd8e7, reason: Instance 8fc884a8-24bb-488a-baeb-ef2b1faf239d could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 16:55:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:25 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:55:25 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:55:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:25 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Deleted allocations for instance 8fc884a8-24bb-488a-baeb-ef2b1faf239d
Aug 09 16:55:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd258ab4-03a2-42bd-a4bc-b7d207073dfa tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.177s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:55:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:55:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-e555ff8c-5526-4316-a60c-62cc4c2cfb00 req-e28e4f78-2580-4da8-862f-95b7d7188e32 service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Received event network-vif-plugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e555ff8c-5526-4316-a60c-62cc4c2cfb00 req-e28e4f78-2580-4da8-862f-95b7d7188e32 service nova] Acquiring lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e555ff8c-5526-4316-a60c-62cc4c2cfb00 req-e28e4f78-2580-4da8-862f-95b7d7188e32 service nova] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e555ff8c-5526-4316-a60c-62cc4c2cfb00 req-e28e4f78-2580-4da8-862f-95b7d7188e32 service nova] Lock "8fc884a8-24bb-488a-baeb-ef2b1faf239d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-e555ff8c-5526-4316-a60c-62cc4c2cfb00 req-e28e4f78-2580-4da8-862f-95b7d7188e32 service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] No waiting events found dispatching network-vif-plugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:55:26 user nova-compute[73091]: WARNING nova.compute.manager [req-e555ff8c-5526-4316-a60c-62cc4c2cfb00 req-e28e4f78-2580-4da8-862f-95b7d7188e32 service nova] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Received unexpected event network-vif-plugged-38ffdd03-c883-43bd-9607-036e5f5bd8e7 for instance with vm_state deleted and task_state None.
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.006s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lazy-loading 'flavor' on Instance uuid bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:26 user nova-compute[73091]: INFO nova.compute.manager [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Attaching volume b8a4502b-87c0-4df3-8359-c2a9e3716090 to /dev/vdb
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG os_brick.utils [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c6aefa-1c46-460e-8829-b69248b14981]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90e4eb7-c639-4a9b-8f2a-6394fdde2669]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9e461d-382d-4d8d-b2b3-7c2f575157c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdc8ce0-b3b4-4825-a3e2-738ba8e0a063]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:55:26 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[deda5080-d472-4c86-8392-1c84eeafa669]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG os_brick.utils [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Updating existing volume attachment record: 938d5f2a-b552-4cbd-a163-4c0b53d153e1 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:55:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-9a4ae033-683f-4df3-90dd-046335e06961 req-351ab86b-8237-4f77-b68a-c345f694c4b4 service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Received event network-changed-236391c4-e172-433a-bb75-b3324f92ec1d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:55:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-9a4ae033-683f-4df3-90dd-046335e06961 req-351ab86b-8237-4f77-b68a-c345f694c4b4 service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Refreshing instance network info cache due to event network-changed-236391c4-e172-433a-bb75-b3324f92ec1d. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:55:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9a4ae033-683f-4df3-90dd-046335e06961 req-351ab86b-8237-4f77-b68a-c345f694c4b4 service nova] Acquiring lock "refresh_cache-bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:55:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9a4ae033-683f-4df3-90dd-046335e06961 req-351ab86b-8237-4f77-b68a-c345f694c4b4 service nova] Acquired lock "refresh_cache-bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:55:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-9a4ae033-683f-4df3-90dd-046335e06961 req-351ab86b-8237-4f77-b68a-c345f694c4b4 service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Refreshing network info cache for port 236391c4-e172-433a-bb75-b3324f92ec1d {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:55:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:28 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:55:28 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:55:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=7912MB free_disk=25.055843353271484GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:55:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance f939fe27-017a-481e-babc-147bf98e0132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:55:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c3871ef4-45e7-4118-8227-e48cc857d481 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:55:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance bfb5340a-2329-4bd2-9f94-52ef24967a9b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:55:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 76055017-05ff-4ea7-ae9c-66d2e502e090 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:55:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance fd3ac804-7b4d-43a0-9837-20a98ea7615d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:55:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:55:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 2c34fc68-d3d4-4924-b522-eb6817d8f9d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:55:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:55:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:55:28 user nova-compute[73091]: DEBUG nova.network.neutron [req-9a4ae033-683f-4df3-90dd-046335e06961 req-351ab86b-8237-4f77-b68a-c345f694c4b4 service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Updated VIF entry in instance network info cache for port 236391c4-e172-433a-bb75-b3324f92ec1d. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:55:28 user nova-compute[73091]: DEBUG nova.network.neutron [req-9a4ae033-683f-4df3-90dd-046335e06961 req-351ab86b-8237-4f77-b68a-c345f694c4b4 service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Updating instance_info_cache with network_info: [{"id": "236391c4-e172-433a-bb75-b3324f92ec1d", "address": "fa:16:3e:20:bc:16", "network": {"id": "b81dfad5-9bb3-4c52-ae30-27b42f42bda0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-349073738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e26fc699254693b43c6d3a097b56ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236391c4-e1", "ovs_interfaceid": "236391c4-e172-433a-bb75-b3324f92ec1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:55:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9a4ae033-683f-4df3-90dd-046335e06961 req-351ab86b-8237-4f77-b68a-c345f694c4b4 service nova] Releasing lock "refresh_cache-bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:55:28 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:55:28 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:55:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:55:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:55:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-33009ffd-1291-4a48-93a5-bb8cd30ad09d req-a1832c31-f467-42b6-8e96-a5cab296f3df service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Received event network-changed-46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-33009ffd-1291-4a48-93a5-bb8cd30ad09d req-a1832c31-f467-42b6-8e96-a5cab296f3df service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Refreshing instance network info cache due to event network-changed-46015a6f-b90c-43c0-877f-ed3c2b64a1ae. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-33009ffd-1291-4a48-93a5-bb8cd30ad09d req-a1832c31-f467-42b6-8e96-a5cab296f3df service nova] Acquiring lock "refresh_cache-2c34fc68-d3d4-4924-b522-eb6817d8f9d7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-33009ffd-1291-4a48-93a5-bb8cd30ad09d req-a1832c31-f467-42b6-8e96-a5cab296f3df service nova] Acquired lock "refresh_cache-2c34fc68-d3d4-4924-b522-eb6817d8f9d7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-33009ffd-1291-4a48-93a5-bb8cd30ad09d req-a1832c31-f467-42b6-8e96-a5cab296f3df service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Refreshing network info cache for port 46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lazy-loading 'flavor' on Instance uuid 2c34fc68-d3d4-4924-b522-eb6817d8f9d7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:55:31 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Ignoring supplied device name: /dev/vdb
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:31 user nova-compute[73091]: INFO nova.compute.manager [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Attaching volume 77e1b462-5502-402a-bab8-9972bc0ddfe9 to /dev/vdb
Aug 09 16:55:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-33009ffd-1291-4a48-93a5-bb8cd30ad09d req-a1832c31-f467-42b6-8e96-a5cab296f3df service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Updated VIF entry in instance network info cache for port 46015a6f-b90c-43c0-877f-ed3c2b64a1ae. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-33009ffd-1291-4a48-93a5-bb8cd30ad09d req-a1832c31-f467-42b6-8e96-a5cab296f3df service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Updating instance_info_cache with network_info: [{"id": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "address": "fa:16:3e:98:90:b0", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46015a6f-b9", "ovs_interfaceid": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-33009ffd-1291-4a48-93a5-bb8cd30ad09d req-a1832c31-f467-42b6-8e96-a5cab296f3df service nova] Releasing lock "refresh_cache-2c34fc68-d3d4-4924-b522-eb6817d8f9d7" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG os_brick.utils [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc3bca2-650a-4748-a7a4-edfb7cbf9f0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e5d320-df2e-4bd2-b576-e1c25cfd0acf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d6db5e-f191-4487-bc1c-14c18ef20b2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec2b60f-727b-4917-89c1-75539dfcbd25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:55:31 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:55:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3dc374-d7ee-4999-996c-5de66706bd3d]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG os_brick.utils [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:55:31 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Updating existing volume attachment record: c9db8e53-477e-4b22-9ed7-ae11ecf9eeb8 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:55:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:55:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbPeytCw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:55:34 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:55:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:55:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:55:34 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:55:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:55:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:55:34 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:55:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdce988-b6b0-4526-8670-3054170dfc10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:55:35 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cfb249-ceca-4347-a94c-6950a8ae0f56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090] added
Aug 09 16:55:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ba97db-e126-4543-86ae-d970117eecd1]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d490b5-6352-4f6f-99ed-5698bbbdea80]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EbPeytCw {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EbPeytCw" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d74fe2e-9122-494c-9cdf-8dc7ddec0958]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EbPeytCw'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3217e0c-a905-494f-9727-2767acb4ec3e]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca37ae6-68f4-4df6-bc22-b618c1c8a5f5]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:35 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:35 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f232f73f-9a36-493f-9e31-57a29e5a5d65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090, portal: 172.16.0.220,3260]
Aug 09 16:55:35 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090, portal: 172.16.0.220,3260] successful.
Aug 09 16:55:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[969cbac4-c192-4cfa-99a7-b75cf46b5249]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[29387a84-459b-4dcc-b7c7-99027090b90d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:35 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:35 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)
Aug 09 16:55:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:35 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:35 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)
Aug 09 16:55:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[38df7095-e24d-4533-b6b9-b4e94205c5fd]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbPeytCw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:55:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:55:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26133613333376636', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:55:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133613333376636', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:55:36 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lazy-loading 'flavor' on Instance uuid bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:55:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:55:36 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:55:36 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 16:55:36 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:55:36 user nova-compute[73091]:   <serial>b8a4502b-87c0-4df3-8359-c2a9e3716090</serial>
Aug 09 16:55:36 user nova-compute[73091]: </disk>
Aug 09 16:55:36 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:55:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:55:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:55:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] No VIF found with MAC fa:16:3e:20:bc:16, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:55:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d6b6d810-d2b4-4f77-b7d3-fb672bef2b9a tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.380s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:39 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691600124.4843116, 8fc884a8-24bb-488a-baeb-ef2b1faf239d => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:55:39 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] VM Stopped (Lifecycle Event)
Aug 09 16:55:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e6f369d6-8545-49a5-9739-34338263adcc None None] [instance: 8fc884a8-24bb-488a-baeb-ef2b1faf239d] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:55:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lazy-loading 'flavor' on Instance uuid bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWaIdkqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:55:40 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:55:40 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:55:40 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1c7724-d1f8-4968-8e5e-472fddfd9cd1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:55:40 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f262fa-7a60-495a-afd6-e7fcbd498d97]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9] added
Aug 09 16:55:40 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7f4b1a-6bf4-451c-bc0c-f69f9994f8d4]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[458aa9c3-986d-4f48-8991-8c88dea52987]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pWaIdkqU {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pWaIdkqU" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebf3da1-a3e0-4067-bc0e-2e34d47db807]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pWaIdkqU'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[86582494-b3bb-4a2c-90e5-c86f43e90f74]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a0731a-f9a3-4400-ae74-635baf48b995]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:40 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:40 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)
Aug 09 16:55:40 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:40 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:40 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)
Aug 09 16:55:40 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:40 user nova-compute[73091]: INFO nova.compute.manager [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Attaching volume 74649218-a26c-446e-9f23-a7953b8ea1ae to /dev/vdc
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece8b6c3-d456-4a9b-8eb0-71f9ceb652db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9, portal: 172.16.0.220,3260]
Aug 09 16:55:40 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9, portal: 172.16.0.220,3260] successful.
Aug 09 16:55:40 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e838d040-4fb3-4969-9b75-8329108fba16]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.utils [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[99be1bcf-7ff5-4450-8780-cb55f518d6ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23621f5-a875-43ee-8211-688f05d1c104]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:40 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:40 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)
Aug 09 16:55:40 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 (non-flash)
Aug 09 16:55:40 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:40 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:40 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)
Aug 09 16:55:40 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 (non-flash)
Aug 09 16:55:40 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9a860c-8f6f-4953-a802-a82c433ee130]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[737796a7-befb-4181-a33e-dc29b1276775]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWaIdkqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[41299823-2fa0-4e99-a33f-df8819539d77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c2d468-aae7-402c-81d8-3b31a712038e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:55:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:55:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:55:41 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:55:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[932a2b7e-7e53-4725-82c6-c2faa9bc75fc]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:55:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:55:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:55:41 user nova-compute[73091]: DEBUG os_brick.utils [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:55:41 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Updating existing volume attachment record: e8dfb219-2a1f-478a-b9b7-995764338a0d {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:55:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:55:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23733383535343963', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:55:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733383535343963', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:55:41 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lazy-loading 'flavor' on Instance uuid 2c34fc68-d3d4-4924-b522-eb6817d8f9d7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:55:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:55:41 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:55:41 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 09 16:55:41 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:55:41 user nova-compute[73091]:   <serial>77e1b462-5502-402a-bab8-9972bc0ddfe9</serial>
Aug 09 16:55:41 user nova-compute[73091]: </disk>
Aug 09 16:55:41 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:55:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:55:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:55:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] No VIF found with MAC fa:16:3e:98:90:b0, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:55:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d48ab911-6a5a-4e8a-bd3c-a7eeeffb91d8 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.997s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcSCKWrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:55:49 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:55:49 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:55:49 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[407e2660-728f-4669-bb65-bcd2dd7c3c85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:55:49 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f6650a-0bd1-4405-9a7f-1611584f09f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae] added
Aug 09 16:55:49 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b118bf-59c6-44c0-b313-a2446fc17fe9]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e518ae3-5caa-4323-8edc-77f64cad1c31]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DcSCKWrE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DcSCKWrE" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf94979-7142-48aa-988a-db5c58a5bdad]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DcSCKWrE'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bf8a11-9acb-44e5-b19e-454730a31bad]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40b7327-ab89-45d0-ba6d-0815a0242063]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:49 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:49 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)
Aug 09 16:55:49 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 (non-flash)
Aug 09 16:55:49 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:49 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:49 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)
Aug 09 16:55:49 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 (non-flash)
Aug 09 16:55:49 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c287b58-d46a-4928-8da5-6d1cad482a80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae, portal: 172.16.0.220,3260]
Aug 09 16:55:49 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae, portal: 172.16.0.220,3260] successful.
Aug 09 16:55:49 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f345cc-c0cc-4d68-ae96-dce11a6003bc]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b277be-d1d5-491a-9a26-92d2c76efa10]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:49 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:49 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)
Aug 09 16:55:49 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 (non-flash)
Aug 09 16:55:49 user nova-compute[73091]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae (non-flash)
Aug 09 16:55:49 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:49 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:49 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)
Aug 09 16:55:49 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 (non-flash)
Aug 09 16:55:49 user nova-compute[73091]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae (non-flash)
Aug 09 16:55:49 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] HCTL ('37', '-', '-', 0) found on session 49 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[567dc219-7ccb-4b71-a5eb-2402ff53b043]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Searching for a device in session 49 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:55:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcSCKWrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:55:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:55:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23437343533636166', 'path': '/dev/sdf'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:55:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437343533636166', 'path': '/dev/sdf'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:55:50 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lazy-loading 'flavor' on Instance uuid bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:55:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:55:50 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:55:50 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 09 16:55:50 user nova-compute[73091]:   <target dev="vdc" bus="virtio"/>
Aug 09 16:55:50 user nova-compute[73091]:   <serial>74649218-a26c-446e-9f23-a7953b8ea1ae</serial>
Aug 09 16:55:50 user nova-compute[73091]: </disk>
Aug 09 16:55:50 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:55:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:55:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:55:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:55:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] No VIF found with MAC fa:16:3e:20:bc:16, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:55:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4657d006-155b-476c-bdab-a3a485bcc318 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.790s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:52 user nova-compute[73091]: INFO nova.compute.manager [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Detaching volume 74649218-a26c-446e-9f23-a7953b8ea1ae
Aug 09 16:55:52 user nova-compute[73091]: INFO nova.virt.block_device [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Attempting to driver detach volume 74649218-a26c-446e-9f23-a7953b8ea1ae from mountpoint /dev/vdc
Aug 09 16:55:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Attempting to detach device vdc from instance bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:55:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:55:52 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:55:52 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 09 16:55:52 user nova-compute[73091]:   <target dev="vdc" bus="virtio"/>
Aug 09 16:55:52 user nova-compute[73091]:   <serial>74649218-a26c-446e-9f23-a7953b8ea1ae</serial>
Aug 09 16:55:52 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 16:55:52 user nova-compute[73091]: </disk>
Aug 09 16:55:52 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:55:52 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Successfully detached device vdc from instance bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 from the persistent domain config.
Aug 09 16:55:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:55:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:55:52 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:55:52 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 09 16:55:52 user nova-compute[73091]:   <target dev="vdc" bus="virtio"/>
Aug 09 16:55:52 user nova-compute[73091]:   <serial>74649218-a26c-446e-9f23-a7953b8ea1ae</serial>
Aug 09 16:55:52 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 16:55:52 user nova-compute[73091]: </disk>
Aug 09 16:55:52 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691600153.333761, bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:55:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Successfully detached device vdc from instance bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 from the live domain config.
Aug 09 16:55:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcSCKWrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:55:53 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:55:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e10c6e-8eb1-4446-b89f-0c8cf7e44126]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9808f8-2dfb-4e28-b330-16d2e24842df]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:53 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:53 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)
Aug 09 16:55:53 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 (non-flash)
Aug 09 16:55:53 user nova-compute[73091]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae (non-flash)
Aug 09 16:55:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:55:53 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:55:53 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)
Aug 09 16:55:53 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 (non-flash)
Aug 09 16:55:53 user nova-compute[73091]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae (non-flash)
Aug 09 16:55:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff060255120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae'): ({'sdf'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Removing single pathed devices sdf {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3c993c-02cd-4224-a97d-59fea3b79074]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca651cc-bd1c-4368-99c9-251aab274306]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Flushing IO for device /dev/sdf {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df2f83b-6a27-48a8-8409-1f0f03d01046]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6676ece-5d1e-4439-be89-6c9a7e12b0c7]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2afb5ea-11d3-40fe-91a7-2ce27eba0ec4]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f28a5f-6ae1-4473-a9c7-5e2a62a72ea3]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae, portal: 172.16.0.220,3260]
Aug 09 16:55:53 user nova-compute[73091]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae, portal: 172.16.0.220,3260] successful.
Aug 09 16:55:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74649218-a26c-446e-9f23-a7953b8ea1ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd04cb33-4587-4b0e-a627-582e0472cb46]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] <== disconnect_volume: return (307ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:55:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:55:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:57 user nova-compute[73091]: INFO nova.compute.manager [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Terminating instance
Aug 09 16:55:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:55:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-e39a35e1-8979-4210-b0f5-d2bc4cb3d545 req-dd112489-7ccc-4e69-947d-66c7eab59f3e service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Received event network-vif-unplugged-0acd9658-83ff-499d-8a65-12cb09854bce {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:55:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e39a35e1-8979-4210-b0f5-d2bc4cb3d545 req-dd112489-7ccc-4e69-947d-66c7eab59f3e service nova] Acquiring lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e39a35e1-8979-4210-b0f5-d2bc4cb3d545 req-dd112489-7ccc-4e69-947d-66c7eab59f3e service nova] Lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e39a35e1-8979-4210-b0f5-d2bc4cb3d545 req-dd112489-7ccc-4e69-947d-66c7eab59f3e service nova] Lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-e39a35e1-8979-4210-b0f5-d2bc4cb3d545 req-dd112489-7ccc-4e69-947d-66c7eab59f3e service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] No waiting events found dispatching network-vif-unplugged-0acd9658-83ff-499d-8a65-12cb09854bce {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:55:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-e39a35e1-8979-4210-b0f5-d2bc4cb3d545 req-dd112489-7ccc-4e69-947d-66c7eab59f3e service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Received event network-vif-unplugged-0acd9658-83ff-499d-8a65-12cb09854bce for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:55:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Instance destroyed successfully.
Aug 09 16:55:58 user nova-compute[73091]: DEBUG nova.objects.instance [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lazy-loading 'resources' on Instance uuid fd3ac804-7b4d-43a0-9837-20a98ea7615d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:55:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-58046610',display_name='tempest-AttachVolumeNegativeTest-server-58046610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-58046610',id=41,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdAs15mqWwWBbPw5gJ8JGWIMLow80uN+Dwt0s16I5QiQyetMRrTMVBCP/rMPAoMI2IEcsFdfbJS9IUUNwwkd0byKG4abUBY1803wqwqoypqD4AgVcfmPNPEBsA+/FhsXw==',key_name='tempest-keypair-256076905',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:53:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27f2275630ce4d55bf02851df830b6bd',ramdisk_id='',reservation_id='r-ghol9mvh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-604747333',owner_user_name='tempest-AttachVolumeNegativeTest-604747333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:53:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a5c393d644c4c3f8e9cbb0805ba7c08',uuid=fd3ac804-7b4d-43a0-9837-20a98ea7615d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0acd9658-83ff-499d-8a65-12cb09854bce", "address": "fa:16:3e:5a:e0:5a", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acd9658-83", "ovs_interfaceid": "0acd9658-83ff-499d-8a65-12cb09854bce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:55:58 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converting VIF {"id": "0acd9658-83ff-499d-8a65-12cb09854bce", "address": "fa:16:3e:5a:e0:5a", "network": {"id": "dad236a2-0fc4-40ba-9dd9-f3d07d7c506b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-845919254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27f2275630ce4d55bf02851df830b6bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0acd9658-83", "ovs_interfaceid": "0acd9658-83ff-499d-8a65-12cb09854bce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:55:58 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:e0:5a,bridge_name='br-int',has_traffic_filtering=True,id=0acd9658-83ff-499d-8a65-12cb09854bce,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0acd9658-83') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:55:58 user nova-compute[73091]: DEBUG os_vif [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:e0:5a,bridge_name='br-int',has_traffic_filtering=True,id=0acd9658-83ff-499d-8a65-12cb09854bce,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0acd9658-83') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:55:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0acd9658-83, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:55:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:55:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:55:58 user nova-compute[73091]: INFO os_vif [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:e0:5a,bridge_name='br-int',has_traffic_filtering=True,id=0acd9658-83ff-499d-8a65-12cb09854bce,network=Network(dad236a2-0fc4-40ba-9dd9-f3d07d7c506b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0acd9658-83')
Aug 09 16:55:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Deleting instance files /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d_del
Aug 09 16:55:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Deletion of /opt/stack/data/nova/instances/fd3ac804-7b4d-43a0-9837-20a98ea7615d_del complete
Aug 09 16:55:58 user nova-compute[73091]: INFO nova.compute.manager [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 09 16:55:58 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:55:58 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:55:58 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:55:59 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:55:59 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Took 0.85 seconds to deallocate network for instance.
Aug 09 16:55:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-a5f53a79-b021-4fc1-94e0-916292d4b4b8 req-2d624b18-d534-4477-9aff-7ddcbcc7060a service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Received event network-vif-deleted-0acd9658-83ff-499d-8a65-12cb09854bce {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:55:59 user nova-compute[73091]: INFO nova.compute.manager [req-a5f53a79-b021-4fc1-94e0-916292d4b4b8 req-2d624b18-d534-4477-9aff-7ddcbcc7060a service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Neutron deleted interface 0acd9658-83ff-499d-8a65-12cb09854bce; detaching it from the instance and deleting it from the info cache
Aug 09 16:55:59 user nova-compute[73091]: DEBUG nova.network.neutron [req-a5f53a79-b021-4fc1-94e0-916292d4b4b8 req-2d624b18-d534-4477-9aff-7ddcbcc7060a service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:55:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-a5f53a79-b021-4fc1-94e0-916292d4b4b8 req-2d624b18-d534-4477-9aff-7ddcbcc7060a service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Detach interface failed, port_id=0acd9658-83ff-499d-8a65-12cb09854bce, reason: Instance fd3ac804-7b4d-43a0-9837-20a98ea7615d could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 16:55:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:55:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:55:59 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:55:59 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:55:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:59 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Deleted allocations for instance fd3ac804-7b4d-43a0-9837-20a98ea7615d
Aug 09 16:55:59 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lazy-loading 'flavor' on Instance uuid bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:55:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ffc484fe-c245-490b-99cf-0e3ca3f10228 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.972s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:55:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-17793169-7ee2-492d-8eac-b48af7d730bc tempest-AttachVolumeNegativeTest-604747333 tempest-AttachVolumeNegativeTest-604747333-project-member] Lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.236s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-05f41a87-0227-4182-9c4e-e8299ef8f32f req-df7e62c7-dc99-47e9-9115-045d3e89b4b0 service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Received event network-vif-plugged-0acd9658-83ff-499d-8a65-12cb09854bce {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:56:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-05f41a87-0227-4182-9c4e-e8299ef8f32f req-df7e62c7-dc99-47e9-9115-045d3e89b4b0 service nova] Acquiring lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-05f41a87-0227-4182-9c4e-e8299ef8f32f req-df7e62c7-dc99-47e9-9115-045d3e89b4b0 service nova] Lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-05f41a87-0227-4182-9c4e-e8299ef8f32f req-df7e62c7-dc99-47e9-9115-045d3e89b4b0 service nova] Lock "fd3ac804-7b4d-43a0-9837-20a98ea7615d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-05f41a87-0227-4182-9c4e-e8299ef8f32f req-df7e62c7-dc99-47e9-9115-045d3e89b4b0 service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] No waiting events found dispatching network-vif-plugged-0acd9658-83ff-499d-8a65-12cb09854bce {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:56:00 user nova-compute[73091]: WARNING nova.compute.manager [req-05f41a87-0227-4182-9c4e-e8299ef8f32f req-df7e62c7-dc99-47e9-9115-045d3e89b4b0 service nova] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Received unexpected event network-vif-plugged-0acd9658-83ff-499d-8a65-12cb09854bce for instance with vm_state deleted and task_state None.
Aug 09 16:56:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-f65d553f-bad0-448f-b3ac-125400339f63 req-856df813-7caa-4d9c-b823-c1913af58112 service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Received event network-changed-b71c68c4-ac11-4419-8933-e51e7606370c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:56:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-f65d553f-bad0-448f-b3ac-125400339f63 req-856df813-7caa-4d9c-b823-c1913af58112 service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Refreshing instance network info cache due to event network-changed-b71c68c4-ac11-4419-8933-e51e7606370c. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:56:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f65d553f-bad0-448f-b3ac-125400339f63 req-856df813-7caa-4d9c-b823-c1913af58112 service nova] Acquiring lock "refresh_cache-bfb5340a-2329-4bd2-9f94-52ef24967a9b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:56:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f65d553f-bad0-448f-b3ac-125400339f63 req-856df813-7caa-4d9c-b823-c1913af58112 service nova] Acquired lock "refresh_cache-bfb5340a-2329-4bd2-9f94-52ef24967a9b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:56:07 user nova-compute[73091]: DEBUG nova.network.neutron [req-f65d553f-bad0-448f-b3ac-125400339f63 req-856df813-7caa-4d9c-b823-c1913af58112 service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Refreshing network info cache for port b71c68c4-ac11-4419-8933-e51e7606370c {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:08 user nova-compute[73091]: INFO nova.compute.manager [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Terminating instance
Aug 09 16:56:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-3838ca9f-3091-412f-be0e-b874c3e3c16d req-3e053403-c15c-4050-bb0b-85e8e2f9be80 service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Received event network-vif-unplugged-b71c68c4-ac11-4419-8933-e51e7606370c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3838ca9f-3091-412f-be0e-b874c3e3c16d req-3e053403-c15c-4050-bb0b-85e8e2f9be80 service nova] Acquiring lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3838ca9f-3091-412f-be0e-b874c3e3c16d req-3e053403-c15c-4050-bb0b-85e8e2f9be80 service nova] Lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3838ca9f-3091-412f-be0e-b874c3e3c16d req-3e053403-c15c-4050-bb0b-85e8e2f9be80 service nova] Lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-3838ca9f-3091-412f-be0e-b874c3e3c16d req-3e053403-c15c-4050-bb0b-85e8e2f9be80 service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] No waiting events found dispatching network-vif-unplugged-b71c68c4-ac11-4419-8933-e51e7606370c {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-3838ca9f-3091-412f-be0e-b874c3e3c16d req-3e053403-c15c-4050-bb0b-85e8e2f9be80 service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Received event network-vif-unplugged-b71c68c4-ac11-4419-8933-e51e7606370c for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG nova.network.neutron [req-f65d553f-bad0-448f-b3ac-125400339f63 req-856df813-7caa-4d9c-b823-c1913af58112 service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Updated VIF entry in instance network info cache for port b71c68c4-ac11-4419-8933-e51e7606370c. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG nova.network.neutron [req-f65d553f-bad0-448f-b3ac-125400339f63 req-856df813-7caa-4d9c-b823-c1913af58112 service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Updating instance_info_cache with network_info: [{"id": "b71c68c4-ac11-4419-8933-e51e7606370c", "address": "fa:16:3e:67:84:8e", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71c68c4-ac", "ovs_interfaceid": "b71c68c4-ac11-4419-8933-e51e7606370c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f65d553f-bad0-448f-b3ac-125400339f63 req-856df813-7caa-4d9c-b823-c1913af58112 service nova] Releasing lock "refresh_cache-bfb5340a-2329-4bd2-9f94-52ef24967a9b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:56:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Instance destroyed successfully.
Aug 09 16:56:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lazy-loading 'resources' on Instance uuid bfb5340a-2329-4bd2-9f94-52ef24967a9b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:51:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1750284173',display_name='tempest-TestVolumeBootPattern-server-1750284173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1750284173',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSSzWQUVuDlac0eUgyT2z4iM1Y0qg2BfVrMrtynGR00pxQ570GYD8As3UZF1alKpRXt3lDEuXxBRenfT0VFniILv2ftKfjpM7Z1J3bJewWzw1Fr2JnxHpTfKfQmiSEWpw==',key_name='tempest-TestVolumeBootPattern-2063534983',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:51:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64d3dfd232d54594808dad271baa5192',ramdisk_id='',reservation_id='r-u9d387s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1605875873',owner_user_name='tempest-TestVolumeBootPattern-1605875873-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:51:25Z,user_data=None,user_id='69ccebf0e9d54502a2318c809ce11369',uuid=bfb5340a-2329-4bd2-9f94-52ef24967a9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b71c68c4-ac11-4419-8933-e51e7606370c", "address": "fa:16:3e:67:84:8e", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71c68c4-ac", "ovs_interfaceid": "b71c68c4-ac11-4419-8933-e51e7606370c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converting VIF {"id": "b71c68c4-ac11-4419-8933-e51e7606370c", "address": "fa:16:3e:67:84:8e", "network": {"id": "62ec0272-5ef4-4c6e-b51b-928d8bdb17ff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2134208502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d3dfd232d54594808dad271baa5192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71c68c4-ac", "ovs_interfaceid": "b71c68c4-ac11-4419-8933-e51e7606370c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:84:8e,bridge_name='br-int',has_traffic_filtering=True,id=b71c68c4-ac11-4419-8933-e51e7606370c,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71c68c4-ac') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG os_vif [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:84:8e,bridge_name='br-int',has_traffic_filtering=True,id=b71c68c4-ac11-4419-8933-e51e7606370c,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71c68c4-ac') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb71c68c4-ac, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:56:08 user nova-compute[73091]: INFO os_vif [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:84:8e,bridge_name='br-int',has_traffic_filtering=True,id=b71c68c4-ac11-4419-8933-e51e7606370c,network=Network(62ec0272-5ef4-4c6e-b51b-928d8bdb17ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71c68c4-ac')
Aug 09 16:56:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XypTsJzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:56:08 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:56:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e3948a-f6b6-459d-97cc-13ad7e8a0f20]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[083b9b6a-9a25-4fa1-90b2-355d7c0e7552]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:56:08 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:56:08 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)
Aug 09 16:56:08 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 (non-flash)
Aug 09 16:56:08 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c (non-flash)
Aug 09 16:56:08 user nova-compute[73091]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:56:08 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)
Aug 09 16:56:08 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 (non-flash)
Aug 09 16:56:08 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff06074a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8a6077-c808-414e-8399-0435a7c583a0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fbfab9-aa59-413b-b8ac-e5983245c1fb]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d9c478-1cbe-4fb0-84b5-dfda7871155c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:56:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88a06c9-f8fc-4266-9126-d5bcf80ce2d0]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_673d03de', '/dev/disk/by-id/scsi-1SCST_BIO673d03de-3b81793fcf8646db', '/dev/disk/by-id/scsi-23362383137393366') {{(pid=83925) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[50105548-a299-4e1a-a43f-3d30576e4077]: (4, None) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[24903002-2a5e-41f1-b524-19fbc13ac47f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f3123a-b7dc-4207-99c6-d21759acf736]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c, portal: 172.16.0.220,3260]
Aug 09 16:56:09 user nova-compute[73091]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c, portal: 172.16.0.220,3260] successful.
Aug 09 16:56:09 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c363878-100f-4807-8700-e096df141b1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59f632d-aba7-40d6-adae-d52ece5551ad]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] <== disconnect_volume: return (332ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:56:09 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Deleting instance files /opt/stack/data/nova/instances/bfb5340a-2329-4bd2-9f94-52ef24967a9b_del
Aug 09 16:56:09 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Deletion of /opt/stack/data/nova/instances/bfb5340a-2329-4bd2-9f94-52ef24967a9b_del complete
Aug 09 16:56:09 user nova-compute[73091]: INFO nova.compute.manager [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 09 16:56:09 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:56:09 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:56:09 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Took 0.49 seconds to deallocate network for instance.
Aug 09 16:56:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-66c6c2b5-59a8-4644-bba2-fd84a23885e5 req-1fa58ed1-f02a-407e-85c6-21f15c069af4 service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Received event network-vif-deleted-b71c68c4-ac11-4419-8933-e51e7606370c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:56:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-bd8c9a79-a6c3-4ec3-8a47-0949c5c60498 req-ea0b4734-af01-419b-95d8-c0e011c3f163 service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Received event network-vif-plugged-b71c68c4-ac11-4419-8933-e51e7606370c {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:56:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bd8c9a79-a6c3-4ec3-8a47-0949c5c60498 req-ea0b4734-af01-419b-95d8-c0e011c3f163 service nova] Acquiring lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bd8c9a79-a6c3-4ec3-8a47-0949c5c60498 req-ea0b4734-af01-419b-95d8-c0e011c3f163 service nova] Lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bd8c9a79-a6c3-4ec3-8a47-0949c5c60498 req-ea0b4734-af01-419b-95d8-c0e011c3f163 service nova] Lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-bd8c9a79-a6c3-4ec3-8a47-0949c5c60498 req-ea0b4734-af01-419b-95d8-c0e011c3f163 service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] No waiting events found dispatching network-vif-plugged-b71c68c4-ac11-4419-8933-e51e7606370c {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:56:10 user nova-compute[73091]: WARNING nova.compute.manager [req-bd8c9a79-a6c3-4ec3-8a47-0949c5c60498 req-ea0b4734-af01-419b-95d8-c0e011c3f163 service nova] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Received unexpected event network-vif-plugged-b71c68c4-ac11-4419-8933-e51e7606370c for instance with vm_state active and task_state deleting.
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:11 user nova-compute[73091]: INFO nova.compute.manager [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Detaching volume 77e1b462-5502-402a-bab8-9972bc0ddfe9
Aug 09 16:56:11 user nova-compute[73091]: INFO nova.virt.block_device [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Attempting to driver detach volume 77e1b462-5502-402a-bab8-9972bc0ddfe9 from mountpoint /dev/vdb
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Attempting to detach device vdb from instance 2c34fc68-d3d4-4924-b522-eb6817d8f9d7 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:56:11 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:56:11 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 09 16:56:11 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:56:11 user nova-compute[73091]:   <serial>77e1b462-5502-402a-bab8-9972bc0ddfe9</serial>
Aug 09 16:56:11 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:56:11 user nova-compute[73091]: </disk>
Aug 09 16:56:11 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:56:11 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Successfully detached device vdb from instance 2c34fc68-d3d4-4924-b522-eb6817d8f9d7 from the persistent domain config.
Aug 09 16:56:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c34fc68-d3d4-4924-b522-eb6817d8f9d7 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:56:11 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:56:11 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 09 16:56:11 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:56:11 user nova-compute[73091]:   <serial>77e1b462-5502-402a-bab8-9972bc0ddfe9</serial>
Aug 09 16:56:11 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:56:11 user nova-compute[73091]: </disk>
Aug 09 16:56:11 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691600171.8006139, 2c34fc68-d3d4-4924-b522-eb6817d8f9d7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c34fc68-d3d4-4924-b522-eb6817d8f9d7 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:56:11 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Successfully detached device vdb from instance 2c34fc68-d3d4-4924-b522-eb6817d8f9d7 from the live domain config.
Aug 09 16:56:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWaIdkqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:56:11 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:56:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ce2475-0eac-4502-9a34-09d5ffda2d8d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6b0a0a-c444-4df8-8906-68dbfb6cc3ea]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:56:11 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)
Aug 09 16:56:11 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 (non-flash)
Aug 09 16:56:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:56:11 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)
Aug 09 16:56:11 user nova-compute[73091]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 (non-flash)
Aug 09 16:56:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0801c1990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Removing single pathed devices sde {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6033af-765b-46ba-a54e-e9488f3312cd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[67199050-e67c-4289-ba99-b890f5784ec8]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c834fc92-ff68-4cfb-9430-4447056de8ab]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c7ac25-1303-445e-9a23-c190f3d68eea]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7f3897-a1a7-43fa-b2dd-8c84e8e3dad3]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:56:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[633bd5cd-a838-4a67-904c-60db341c6c28]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9, portal: 172.16.0.220,3260]
Aug 09 16:56:12 user nova-compute[73091]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9, portal: 172.16.0.220,3260] successful.
Aug 09 16:56:12 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:56:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d41a573-2d89-4aa4-8f5c-cf4cd56fcc62]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:56:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:56:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] <== disconnect_volume: return (268ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:56:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:56:12 user nova-compute[73091]: DEBUG nova.objects.instance [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lazy-loading 'flavor' on Instance uuid 2c34fc68-d3d4-4924-b522-eb6817d8f9d7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:56:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-91897fd4-e245-4b59-9041-bc110ffb42ae tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.684s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.582s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:12 user nova-compute[73091]: INFO nova.compute.manager [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Terminating instance
Aug 09 16:56:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-d88173a5-2c35-4879-8a15-a434fe331892 req-c74808ca-2f64-4434-8a56-b9052f86107f service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Received event network-vif-unplugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d88173a5-2c35-4879-8a15-a434fe331892 req-c74808ca-2f64-4434-8a56-b9052f86107f service nova] Acquiring lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d88173a5-2c35-4879-8a15-a434fe331892 req-c74808ca-2f64-4434-8a56-b9052f86107f service nova] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d88173a5-2c35-4879-8a15-a434fe331892 req-c74808ca-2f64-4434-8a56-b9052f86107f service nova] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-d88173a5-2c35-4879-8a15-a434fe331892 req-c74808ca-2f64-4434-8a56-b9052f86107f service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] No waiting events found dispatching network-vif-unplugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-d88173a5-2c35-4879-8a15-a434fe331892 req-c74808ca-2f64-4434-8a56-b9052f86107f service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Received event network-vif-unplugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691600158.3750422, fd3ac804-7b4d-43a0-9837-20a98ea7615d => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:56:13 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] VM Stopped (Lifecycle Event)
Aug 09 16:56:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d3ec5953-c3a8-4fc6-b735-2c74b9e75979 None None] [instance: fd3ac804-7b4d-43a0-9837-20a98ea7615d] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:56:13 user nova-compute[73091]: INFO nova.compute.manager [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Took 3.89 seconds to detach 1 volumes for instance.
Aug 09 16:56:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Instance destroyed successfully.
Aug 09 16:56:13 user nova-compute[73091]: DEBUG nova.objects.instance [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lazy-loading 'resources' on Instance uuid 2c34fc68-d3d4-4924-b522-eb6817d8f9d7 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1368039725',display_name='tempest-VolumesSnapshotTestJSON-instance-1368039725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1368039725',id=44,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtevzp2w+iSaGZxrO+lZJ1tYskOgeM72gTDIGlJOFhfdb9rgtn+c1VXfWp2YVK3EBFjTZY6S6h9vQ371VsX5c48HPMBCNXPvnOimYurq7wRpGnvm5vnna9vLXorrg+tUw==',key_name='tempest-keypair-1107695877',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:53:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6982c498eeb94d8381a610cb59694191',ramdisk_id='',reservation_id='r-v370coc9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-472009357',owner_user_name='tempest-VolumesSnapshotTestJSON-472009357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:53:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77d81649b61a40ee87e4fc3c7cc56c7d',uuid=2c34fc68-d3d4-4924-b522-eb6817d8f9d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "address": "fa:16:3e:98:90:b0", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46015a6f-b9", "ovs_interfaceid": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Converting VIF {"id": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "address": "fa:16:3e:98:90:b0", "network": {"id": "8b1a154d-9ae1-4829-a3f1-001cf4ae3658", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588806302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6982c498eeb94d8381a610cb59694191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46015a6f-b9", "ovs_interfaceid": "46015a6f-b90c-43c0-877f-ed3c2b64a1ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:90:b0,bridge_name='br-int',has_traffic_filtering=True,id=46015a6f-b90c-43c0-877f-ed3c2b64a1ae,network=Network(8b1a154d-9ae1-4829-a3f1-001cf4ae3658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46015a6f-b9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG os_vif [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:90:b0,bridge_name='br-int',has_traffic_filtering=True,id=46015a6f-b90c-43c0-877f-ed3c2b64a1ae,network=Network(8b1a154d-9ae1-4829-a3f1-001cf4ae3658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46015a6f-b9') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46015a6f-b9, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:56:13 user nova-compute[73091]: INFO os_vif [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:90:b0,bridge_name='br-int',has_traffic_filtering=True,id=46015a6f-b90c-43c0-877f-ed3c2b64a1ae,network=Network(8b1a154d-9ae1-4829-a3f1-001cf4ae3658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46015a6f-b9')
Aug 09 16:56:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWaIdkqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:56:13 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:56:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77e1b462-5502-402a-bab8-9972bc0ddfe9', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2fdf42-17a7-4373-9c88-ed5fc865befa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abc315f-dd3b-4724-a8cb-586d81cf566e]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:56:13 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)
Aug 09 16:56:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:56:13 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)
Aug 09 16:56:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0802831c0>, {}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Disconnecting from: [] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] <== disconnect_volume: return (75ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:56:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Deleting instance files /opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7_del
Aug 09 16:56:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Deletion of /opt/stack/data/nova/instances/2c34fc68-d3d4-4924-b522-eb6817d8f9d7_del complete
Aug 09 16:56:13 user nova-compute[73091]: INFO nova.compute.manager [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 09 16:56:13 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:56:13 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:14 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Deleted allocations for instance bfb5340a-2329-4bd2-9f94-52ef24967a9b
Aug 09 16:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2b77c1a1-eb21-4503-a0e8-d9d2ca02f2c8 tempest-TestVolumeBootPattern-1605875873 tempest-TestVolumeBootPattern-1605875873-project-member] Lock "bfb5340a-2329-4bd2-9f94-52ef24967a9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.099s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "f939fe27-017a-481e-babc-147bf98e0132" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "f939fe27-017a-481e-babc-147bf98e0132" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "f939fe27-017a-481e-babc-147bf98e0132-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:14 user nova-compute[73091]: INFO nova.compute.manager [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Terminating instance
Aug 09 16:56:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-12382e73-7b01-429d-9991-aaa607f2da34 req-40d12bd1-529f-4cfc-ab56-5b2e187fc337 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received event network-vif-unplugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-12382e73-7b01-429d-9991-aaa607f2da34 req-40d12bd1-529f-4cfc-ab56-5b2e187fc337 service nova] Acquiring lock "f939fe27-017a-481e-babc-147bf98e0132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-12382e73-7b01-429d-9991-aaa607f2da34 req-40d12bd1-529f-4cfc-ab56-5b2e187fc337 service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-12382e73-7b01-429d-9991-aaa607f2da34 req-40d12bd1-529f-4cfc-ab56-5b2e187fc337 service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-12382e73-7b01-429d-9991-aaa607f2da34 req-40d12bd1-529f-4cfc-ab56-5b2e187fc337 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] No waiting events found dispatching network-vif-unplugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:56:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-12382e73-7b01-429d-9991-aaa607f2da34 req-40d12bd1-529f-4cfc-ab56-5b2e187fc337 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received event network-vif-unplugged-c830ef2e-da54-4321-905f-845e0440a759 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:56:15 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: f939fe27-017a-481e-babc-147bf98e0132] Instance destroyed successfully.
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.objects.instance [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lazy-loading 'resources' on Instance uuid f939fe27-017a-481e-babc-147bf98e0132 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:38:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1580969082',display_name='tempest-ServerRescueNegativeTestJSON-server-1580969082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1580969082',id=19,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:43:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a03dd6b23c840c7b4a07f0235c1051b',ramdisk_id='',reservation_id='r-5cttsoe9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-596687024',owner_user_name='tempest-ServerRescueNegativeTestJSON-596687024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:45:40Z,user_data=None,user_id='ef7727ab5d1b46d383bfc02750d29ec7',uuid=f939fe27-017a-481e-babc-147bf98e0132,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c830ef2e-da54-4321-905f-845e0440a759", "address": "fa:16:3e:b5:68:3c", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc830ef2e-da", "ovs_interfaceid": "c830ef2e-da54-4321-905f-845e0440a759", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converting VIF {"id": "c830ef2e-da54-4321-905f-845e0440a759", "address": "fa:16:3e:b5:68:3c", "network": {"id": "ae32c4c2-fc4c-40be-aa12-27140ce6c5dd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-647509366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a03dd6b23c840c7b4a07f0235c1051b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc830ef2e-da", "ovs_interfaceid": "c830ef2e-da54-4321-905f-845e0440a759", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:68:3c,bridge_name='br-int',has_traffic_filtering=True,id=c830ef2e-da54-4321-905f-845e0440a759,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc830ef2e-da') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG os_vif [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:68:3c,bridge_name='br-int',has_traffic_filtering=True,id=c830ef2e-da54-4321-905f-845e0440a759,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc830ef2e-da') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc830ef2e-da, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:56:15 user nova-compute[73091]: INFO os_vif [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:68:3c,bridge_name='br-int',has_traffic_filtering=True,id=c830ef2e-da54-4321-905f-845e0440a759,network=Network(ae32c4c2-fc4c-40be-aa12-27140ce6c5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc830ef2e-da')
Aug 09 16:56:15 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Deleting instance files /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132_del
Aug 09 16:56:15 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Deletion of /opt/stack/data/nova/instances/f939fe27-017a-481e-babc-147bf98e0132_del complete
Aug 09 16:56:15 user nova-compute[73091]: INFO nova.compute.manager [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] [instance: f939fe27-017a-481e-babc-147bf98e0132] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: f939fe27-017a-481e-babc-147bf98e0132] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: f939fe27-017a-481e-babc-147bf98e0132] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:56:15 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Took 1.31 seconds to deallocate network for instance.
Aug 09 16:56:15 user nova-compute[73091]: WARNING nova.volume.cinder [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Attachment c9db8e53-477e-4b22-9ed7-ae11ecf9eeb8 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c9db8e53-477e-4b22-9ed7-ae11ecf9eeb8. (HTTP 404) (Request-ID: req-96916a2c-3d22-4f5c-997c-74caa38cf4d8)
Aug 09 16:56:15 user nova-compute[73091]: INFO nova.compute.manager [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Took 0.03 seconds to detach 1 volumes for instance.
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Received event network-vif-plugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] Acquiring lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] No waiting events found dispatching network-vif-plugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:56:15 user nova-compute[73091]: WARNING nova.compute.manager [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Received unexpected event network-vif-plugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae for instance with vm_state active and task_state deleting.
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Received event network-vif-plugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] Acquiring lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] No waiting events found dispatching network-vif-plugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:56:15 user nova-compute[73091]: WARNING nova.compute.manager [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Received unexpected event network-vif-plugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae for instance with vm_state active and task_state deleting.
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Received event network-vif-plugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] Acquiring lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] No waiting events found dispatching network-vif-plugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:56:15 user nova-compute[73091]: WARNING nova.compute.manager [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Received unexpected event network-vif-plugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae for instance with vm_state active and task_state deleting.
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Received event network-vif-unplugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] Acquiring lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] No waiting events found dispatching network-vif-unplugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Received event network-vif-unplugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Received event network-vif-plugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] Acquiring lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] No waiting events found dispatching network-vif-plugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:56:15 user nova-compute[73091]: WARNING nova.compute.manager [req-1c5855b3-e0a7-49a5-9be2-ae1caba3eb24 req-495e6cc4-56cc-4b81-9a0a-c587b5305c43 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Received unexpected event network-vif-plugged-46015a6f-b90c-43c0-877f-ed3c2b64a1ae for instance with vm_state active and task_state deleting.
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:15 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Deleted allocations for instance 2c34fc68-d3d4-4924-b522-eb6817d8f9d7
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-892168a5-626e-4684-acd6-b7e4a77225a2 tempest-VolumesSnapshotTestJSON-472009357 tempest-VolumesSnapshotTestJSON-472009357-project-member] Lock "2c34fc68-d3d4-4924-b522-eb6817d8f9d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.771s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: f939fe27-017a-481e-babc-147bf98e0132] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:56:15 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: f939fe27-017a-481e-babc-147bf98e0132] Took 0.69 seconds to deallocate network for instance.
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-46ac44a0-32a5-42ff-b0f4-130a15dc6de7 req-1deb618e-fe0d-4c31-a1b8-66cba0315107 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received event network-vif-deleted-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:56:15 user nova-compute[73091]: INFO nova.compute.manager [req-46ac44a0-32a5-42ff-b0f4-130a15dc6de7 req-1deb618e-fe0d-4c31-a1b8-66cba0315107 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Neutron deleted interface c830ef2e-da54-4321-905f-845e0440a759; detaching it from the instance and deleting it from the info cache
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.network.neutron [req-46ac44a0-32a5-42ff-b0f4-130a15dc6de7 req-1deb618e-fe0d-4c31-a1b8-66cba0315107 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-46ac44a0-32a5-42ff-b0f4-130a15dc6de7 req-1deb618e-fe0d-4c31-a1b8-66cba0315107 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Detach interface failed, port_id=c830ef2e-da54-4321-905f-845e0440a759, reason: Instance f939fe27-017a-481e-babc-147bf98e0132 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:15 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:56:16 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:56:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:16 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Deleted allocations for instance f939fe27-017a-481e-babc-147bf98e0132
Aug 09 16:56:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af5a9be-aa10-4985-a565-5f534deed1d9 tempest-ServerRescueNegativeTestJSON-596687024 tempest-ServerRescueNegativeTestJSON-596687024-project-member] Lock "f939fe27-017a-481e-babc-147bf98e0132" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.886s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-107deaa5-f41a-42c2-85ac-f046023e4910 req-83467134-1215-4f27-aee7-0ac190c37d50 service nova] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Received event network-vif-deleted-46015a6f-b90c-43c0-877f-ed3c2b64a1ae {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:56:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-107deaa5-f41a-42c2-85ac-f046023e4910 req-83467134-1215-4f27-aee7-0ac190c37d50 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received event network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:56:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-107deaa5-f41a-42c2-85ac-f046023e4910 req-83467134-1215-4f27-aee7-0ac190c37d50 service nova] Acquiring lock "f939fe27-017a-481e-babc-147bf98e0132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-107deaa5-f41a-42c2-85ac-f046023e4910 req-83467134-1215-4f27-aee7-0ac190c37d50 service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-107deaa5-f41a-42c2-85ac-f046023e4910 req-83467134-1215-4f27-aee7-0ac190c37d50 service nova] Lock "f939fe27-017a-481e-babc-147bf98e0132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-107deaa5-f41a-42c2-85ac-f046023e4910 req-83467134-1215-4f27-aee7-0ac190c37d50 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] No waiting events found dispatching network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:56:16 user nova-compute[73091]: WARNING nova.compute.manager [req-107deaa5-f41a-42c2-85ac-f046023e4910 req-83467134-1215-4f27-aee7-0ac190c37d50 service nova] [instance: f939fe27-017a-481e-babc-147bf98e0132] Received unexpected event network-vif-plugged-c830ef2e-da54-4321-905f-845e0440a759 for instance with vm_state deleted and task_state None.
Aug 09 16:56:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:56:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:56:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:56:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:56:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:56:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 16:56:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-c3871ef4-45e7-4118-8227-e48cc857d481" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:56:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-c3871ef4-45e7-4118-8227-e48cc857d481" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:56:21 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:56:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid c3871ef4-45e7-4118-8227-e48cc857d481 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:56:22 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Updating instance_info_cache with network_info: [{"id": "1d3f6a45-6b36-4603-b510-442d6ba16232", "address": "fa:16:3e:78:8d:86", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3f6a45-6b", "ovs_interfaceid": "1d3f6a45-6b36-4603-b510-442d6ba16232", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:56:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-c3871ef4-45e7-4118-8227-e48cc857d481" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:56:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:56:23 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691600168.775969, bfb5340a-2329-4bd2-9f94-52ef24967a9b => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:56:23 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] VM Stopped (Lifecycle Event)
Aug 09 16:56:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-32205956-ea7d-4c67-a52a-0d16a24b0661 None None] [instance: bfb5340a-2329-4bd2-9f94-52ef24967a9b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:56:24 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:56:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:56:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:56:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:56:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:56:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:56:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:56:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:56:29 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691600173.7064786, 2c34fc68-d3d4-4924-b522-eb6817d8f9d7 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:56:29 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] VM Stopped (Lifecycle Event)
Aug 09 16:56:29 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:56:29 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:56:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8372MB free_disk=25.12811279296875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-83c195a3-db3b-4a03-805b-9950bcf669cb None None] [instance: 2c34fc68-d3d4-4924-b522-eb6817d8f9d7] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:56:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c3871ef4-45e7-4118-8227-e48cc857d481 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:56:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 76055017-05ff-4ea7-ae9c-66d2e502e090 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:56:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:56:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:56:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:56:29 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:56:29 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:56:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:56:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:30 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691600175.0129097, f939fe27-017a-481e-babc-147bf98e0132 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:56:30 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: f939fe27-017a-481e-babc-147bf98e0132] VM Stopped (Lifecycle Event)
Aug 09 16:56:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2beebb06-c55d-4762-8f19-cff6b21c965d None None] [instance: f939fe27-017a-481e-babc-147bf98e0132] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:56:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:56:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:56:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:43 user nova-compute[73091]: INFO nova.compute.manager [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Detaching volume b8a4502b-87c0-4df3-8359-c2a9e3716090
Aug 09 16:56:43 user nova-compute[73091]: INFO nova.virt.block_device [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Attempting to driver detach volume b8a4502b-87c0-4df3-8359-c2a9e3716090 from mountpoint /dev/vdb
Aug 09 16:56:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Attempting to detach device vdb from instance bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:56:43 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:56:43 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 16:56:43 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:56:43 user nova-compute[73091]:   <serial>b8a4502b-87c0-4df3-8359-c2a9e3716090</serial>
Aug 09 16:56:43 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:56:43 user nova-compute[73091]: </disk>
Aug 09 16:56:43 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:56:43 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Successfully detached device vdb from instance bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 from the persistent domain config.
Aug 09 16:56:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 16:56:43 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:56:43 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 16:56:43 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:56:43 user nova-compute[73091]:   <serial>b8a4502b-87c0-4df3-8359-c2a9e3716090</serial>
Aug 09 16:56:43 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 16:56:43 user nova-compute[73091]: </disk>
Aug 09 16:56:43 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691600203.8978362, bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 16:56:43 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Successfully detached device vdb from instance bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 from the live domain config.
Aug 09 16:56:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbPeytCw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:56:43 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:56:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a7b5df-3b27-4656-875a-1dba4767b2bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d91b0b0-851f-4085-b39b-e84ec55d7ccb]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:56:43 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)
Aug 09 16:56:43 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:56:43 user nova-compute[73091]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 (non-flash)
Aug 09 16:56:43 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0602556c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d959aa-5123-4df4-961a-61398cf9f33e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7034454b-6f2b-47ac-ac8d-42f68f1a6bea]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2f7381-5e26-46bd-8bae-fda50da608dd]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaf9cd7-a587-4101-a468-35fab1b1cc45]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cd04f8-dc83-4fa7-8cb1-5c5b4fa6ead3]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e501471d-6469-4caf-8cc3-ec2a64af3854]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090, portal: 172.16.0.220,3260]
Aug 09 16:56:44 user nova-compute[73091]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090, portal: 172.16.0.220,3260] successful.
Aug 09 16:56:44 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a4502b-87c0-4df3-8359-c2a9e3716090 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3231b4-05aa-42c3-8ec1-c3ba59fa929d]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] <== disconnect_volume: return (290ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lazy-loading 'flavor' on Instance uuid bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:56:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c86dc4aa-c6c1-4202-b600-080ed5d27bcc tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.675s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:56:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:56:46 user nova-compute[73091]: INFO nova.compute.claims [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Claim successful on node user
Aug 09 16:56:46 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.234s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:56:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:56:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG nova.policy [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b831573c2594072890b548abda013e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39308f2160f14a1cb5ee136458054726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:56:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Creating image(s)
Aug 09 16:56:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "/opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "/opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "/opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk 1073741824" returned: 0 in 0.054s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:56:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:56:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Successfully created port: e1b7f229-903b-4665-bc7c-04cb578e7140 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:56:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:56:47 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Cannot resize image /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:56:47 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'migration_context' on Instance uuid be5d7299-6eb0-4ba4-a2a3-f4c513168d68 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:56:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:56:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Ensure instance console log exists: /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:56:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Successfully updated port: e1b7f229-903b-4665-bc7c-04cb578e7140 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:56:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "refresh_cache-be5d7299-6eb0-4ba4-a2a3-f4c513168d68" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:56:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquired lock "refresh_cache-be5d7299-6eb0-4ba4-a2a3-f4c513168d68" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:56:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:56:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-71742ed2-a72a-4e98-84cf-333195d38c0c req-6c800071-ad8f-4355-ae95-a2150671b6ba service nova] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Received event network-changed-e1b7f229-903b-4665-bc7c-04cb578e7140 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:56:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-71742ed2-a72a-4e98-84cf-333195d38c0c req-6c800071-ad8f-4355-ae95-a2150671b6ba service nova] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Refreshing instance network info cache due to event network-changed-e1b7f229-903b-4665-bc7c-04cb578e7140. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:56:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-71742ed2-a72a-4e98-84cf-333195d38c0c req-6c800071-ad8f-4355-ae95-a2150671b6ba service nova] Acquiring lock "refresh_cache-be5d7299-6eb0-4ba4-a2a3-f4c513168d68" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:56:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Updating instance_info_cache with network_info: [{"id": "e1b7f229-903b-4665-bc7c-04cb578e7140", "address": "fa:16:3e:08:85:51", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b7f229-90", "ovs_interfaceid": "e1b7f229-903b-4665-bc7c-04cb578e7140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Releasing lock "refresh_cache-be5d7299-6eb0-4ba4-a2a3-f4c513168d68" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Instance network_info: |[{"id": "e1b7f229-903b-4665-bc7c-04cb578e7140", "address": "fa:16:3e:08:85:51", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b7f229-90", "ovs_interfaceid": "e1b7f229-903b-4665-bc7c-04cb578e7140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-71742ed2-a72a-4e98-84cf-333195d38c0c req-6c800071-ad8f-4355-ae95-a2150671b6ba service nova] Acquired lock "refresh_cache-be5d7299-6eb0-4ba4-a2a3-f4c513168d68" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-71742ed2-a72a-4e98-84cf-333195d38c0c req-6c800071-ad8f-4355-ae95-a2150671b6ba service nova] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Refreshing network info cache for port e1b7f229-903b-4665-bc7c-04cb578e7140 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Start _get_guest_xml network_info=[{"id": "e1b7f229-903b-4665-bc7c-04cb578e7140", "address": "fa:16:3e:08:85:51", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b7f229-90", "ovs_interfaceid": "e1b7f229-903b-4665-bc7c-04cb578e7140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:56:48 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:56:48 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:56:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-50644406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-50644406',id=45,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39308f2160f14a1cb5ee136458054726',ramdisk_id='',reservation_id='r-jtiqe8fu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:56:46Z,user_data=None,user_id='1b831573c2594072890b548abda013e3',uuid=be5d7299-6eb0-4ba4-a2a3-f4c513168d68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1b7f229-903b-4665-bc7c-04cb578e7140", "address": "fa:16:3e:08:85:51", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b7f229-90", "ovs_interfaceid": "e1b7f229-903b-4665-bc7c-04cb578e7140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converting VIF {"id": "e1b7f229-903b-4665-bc7c-04cb578e7140", "address": "fa:16:3e:08:85:51", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b7f229-90", "ovs_interfaceid": "e1b7f229-903b-4665-bc7c-04cb578e7140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:85:51,bridge_name='br-int',has_traffic_filtering=True,id=e1b7f229-903b-4665-bc7c-04cb578e7140,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b7f229-90') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'pci_devices' on Instance uuid be5d7299-6eb0-4ba4-a2a3-f4c513168d68 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:56:48 user nova-compute[73091]:   <uuid>be5d7299-6eb0-4ba4-a2a3-f4c513168d68</uuid>
Aug 09 16:56:48 user nova-compute[73091]:   <name>instance-0000002d</name>
Aug 09 16:56:48 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:56:48 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:56:48 user nova-compute[73091]:   <metadata>
Aug 09 16:56:48 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:56:48 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:56:48 user nova-compute[73091]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-50644406</nova:name>
Aug 09 16:56:48 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:56:48</nova:creationTime>
Aug 09 16:56:48 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:56:48 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:56:48 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:56:48 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:56:48 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:56:48 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:56:48 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:56:48 user nova-compute[73091]:       <nova:owner>
Aug 09 16:56:48 user nova-compute[73091]:         <nova:user uuid="1b831573c2594072890b548abda013e3">tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member</nova:user>
Aug 09 16:56:48 user nova-compute[73091]:         <nova:project uuid="39308f2160f14a1cb5ee136458054726">tempest-ServerBootFromVolumeStableRescueTest-1999746022</nova:project>
Aug 09 16:56:48 user nova-compute[73091]:       </nova:owner>
Aug 09 16:56:48 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:56:48 user nova-compute[73091]:       <nova:ports>
Aug 09 16:56:48 user nova-compute[73091]:         <nova:port uuid="e1b7f229-903b-4665-bc7c-04cb578e7140">
Aug 09 16:56:48 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 16:56:48 user nova-compute[73091]:         </nova:port>
Aug 09 16:56:48 user nova-compute[73091]:       </nova:ports>
Aug 09 16:56:48 user nova-compute[73091]:     </nova:instance>
Aug 09 16:56:48 user nova-compute[73091]:   </metadata>
Aug 09 16:56:48 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:56:48 user nova-compute[73091]:     <system>
Aug 09 16:56:48 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:56:48 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:56:48 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:56:48 user nova-compute[73091]:       <entry name="serial">be5d7299-6eb0-4ba4-a2a3-f4c513168d68</entry>
Aug 09 16:56:48 user nova-compute[73091]:       <entry name="uuid">be5d7299-6eb0-4ba4-a2a3-f4c513168d68</entry>
Aug 09 16:56:48 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:56:48 user nova-compute[73091]:     </system>
Aug 09 16:56:48 user nova-compute[73091]:   </sysinfo>
Aug 09 16:56:48 user nova-compute[73091]:   <os>
Aug 09 16:56:48 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:56:48 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:56:48 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:56:48 user nova-compute[73091]:   </os>
Aug 09 16:56:48 user nova-compute[73091]:   <features>
Aug 09 16:56:48 user nova-compute[73091]:     <acpi/>
Aug 09 16:56:48 user nova-compute[73091]:     <apic/>
Aug 09 16:56:48 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:56:48 user nova-compute[73091]:   </features>
Aug 09 16:56:48 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:56:48 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:56:48 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:56:48 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:56:48 user nova-compute[73091]:   </clock>
Aug 09 16:56:48 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:56:48 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:56:48 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:56:48 user nova-compute[73091]:   </cpu>
Aug 09 16:56:48 user nova-compute[73091]:   <devices>
Aug 09 16:56:48 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:56:48 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:56:48 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk"/>
Aug 09 16:56:48 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:56:48 user nova-compute[73091]:     </disk>
Aug 09 16:56:48 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:56:48 user nova-compute[73091]:       <mac address="fa:16:3e:08:85:51"/>
Aug 09 16:56:48 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:56:48 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:56:48 user nova-compute[73091]:       <target dev="tape1b7f229-90"/>
Aug 09 16:56:48 user nova-compute[73091]:     </interface>
Aug 09 16:56:48 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:56:48 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/console.log" append="off"/>
Aug 09 16:56:48 user nova-compute[73091]:     </serial>
Aug 09 16:56:48 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:56:48 user nova-compute[73091]:     <video>
Aug 09 16:56:48 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:56:48 user nova-compute[73091]:     </video>
Aug 09 16:56:48 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:56:48 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:56:48 user nova-compute[73091]:     </rng>
Aug 09 16:56:48 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:56:48 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:56:48 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:56:48 user nova-compute[73091]:     </memballoon>
Aug 09 16:56:48 user nova-compute[73091]:   </devices>
Aug 09 16:56:48 user nova-compute[73091]: </domain>
Aug 09 16:56:48 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:56:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-50644406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-50644406',id=45,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39308f2160f14a1cb5ee136458054726',ramdisk_id='',reservation_id='r-jtiqe8fu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:56:46Z,user_data=None,user_id='1b831573c2594072890b548abda013e3',uuid=be5d7299-6eb0-4ba4-a2a3-f4c513168d68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1b7f229-903b-4665-bc7c-04cb578e7140", "address": "fa:16:3e:08:85:51", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b7f229-90", "ovs_interfaceid": "e1b7f229-903b-4665-bc7c-04cb578e7140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converting VIF {"id": "e1b7f229-903b-4665-bc7c-04cb578e7140", "address": "fa:16:3e:08:85:51", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b7f229-90", "ovs_interfaceid": "e1b7f229-903b-4665-bc7c-04cb578e7140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:85:51,bridge_name='br-int',has_traffic_filtering=True,id=e1b7f229-903b-4665-bc7c-04cb578e7140,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b7f229-90') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG os_vif [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:85:51,bridge_name='br-int',has_traffic_filtering=True,id=e1b7f229-903b-4665-bc7c-04cb578e7140,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b7f229-90') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1b7f229-90, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape1b7f229-90, col_values=(('external_ids', {'iface-id': 'e1b7f229-903b-4665-bc7c-04cb578e7140', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:85:51', 'vm-uuid': 'be5d7299-6eb0-4ba4-a2a3-f4c513168d68'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:48 user nova-compute[73091]: INFO os_vif [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:85:51,bridge_name='br-int',has_traffic_filtering=True,id=e1b7f229-903b-4665-bc7c-04cb578e7140,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b7f229-90')
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] No VIF found with MAC fa:16:3e:08:85:51, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-71742ed2-a72a-4e98-84cf-333195d38c0c req-6c800071-ad8f-4355-ae95-a2150671b6ba service nova] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Updated VIF entry in instance network info cache for port e1b7f229-903b-4665-bc7c-04cb578e7140. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-71742ed2-a72a-4e98-84cf-333195d38c0c req-6c800071-ad8f-4355-ae95-a2150671b6ba service nova] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Updating instance_info_cache with network_info: [{"id": "e1b7f229-903b-4665-bc7c-04cb578e7140", "address": "fa:16:3e:08:85:51", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b7f229-90", "ovs_interfaceid": "e1b7f229-903b-4665-bc7c-04cb578e7140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:56:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-71742ed2-a72a-4e98-84cf-333195d38c0c req-6c800071-ad8f-4355-ae95-a2150671b6ba service nova] Releasing lock "refresh_cache-be5d7299-6eb0-4ba4-a2a3-f4c513168d68" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:56:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-c4741531-40f0-4dc4-b3b1-2c5c698c7eda req-98361ae4-f882-4321-a97d-af190c0d5988 service nova] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Received event network-vif-plugged-e1b7f229-903b-4665-bc7c-04cb578e7140 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:56:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c4741531-40f0-4dc4-b3b1-2c5c698c7eda req-98361ae4-f882-4321-a97d-af190c0d5988 service nova] Acquiring lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c4741531-40f0-4dc4-b3b1-2c5c698c7eda req-98361ae4-f882-4321-a97d-af190c0d5988 service nova] Lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c4741531-40f0-4dc4-b3b1-2c5c698c7eda req-98361ae4-f882-4321-a97d-af190c0d5988 service nova] Lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-c4741531-40f0-4dc4-b3b1-2c5c698c7eda req-98361ae4-f882-4321-a97d-af190c0d5988 service nova] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] No waiting events found dispatching network-vif-plugged-e1b7f229-903b-4665-bc7c-04cb578e7140 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:56:49 user nova-compute[73091]: WARNING nova.compute.manager [req-c4741531-40f0-4dc4-b3b1-2c5c698c7eda req-98361ae4-f882-4321-a97d-af190c0d5988 service nova] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Received unexpected event network-vif-plugged-e1b7f229-903b-4665-bc7c-04cb578e7140 for instance with vm_state building and task_state spawning.
Aug 09 16:56:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:51 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600211.8687744, be5d7299-6eb0-4ba4-a2a3-f4c513168d68 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:56:51 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] VM Resumed (Lifecycle Event)
Aug 09 16:56:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:56:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:56:51 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Instance spawned successfully.
Aug 09 16:56:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:56:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:56:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:56:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:56:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:56:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:56:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:56:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:56:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:56:51 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:56:51 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600211.8701787, be5d7299-6eb0-4ba4-a2a3-f4c513168d68 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:56:51 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] VM Started (Lifecycle Event)
Aug 09 16:56:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:56:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:56:51 user nova-compute[73091]: INFO nova.compute.manager [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Took 5.55 seconds to spawn the instance on the hypervisor.
Aug 09 16:56:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:56:51 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:56:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-0a12bbe6-d272-46c7-9624-9993a352f6f0 req-00c7327d-1d3d-4491-9284-50f747241c3c service nova] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Received event network-vif-plugged-e1b7f229-903b-4665-bc7c-04cb578e7140 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:56:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0a12bbe6-d272-46c7-9624-9993a352f6f0 req-00c7327d-1d3d-4491-9284-50f747241c3c service nova] Acquiring lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:56:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0a12bbe6-d272-46c7-9624-9993a352f6f0 req-00c7327d-1d3d-4491-9284-50f747241c3c service nova] Lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:56:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0a12bbe6-d272-46c7-9624-9993a352f6f0 req-00c7327d-1d3d-4491-9284-50f747241c3c service nova] Lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-0a12bbe6-d272-46c7-9624-9993a352f6f0 req-00c7327d-1d3d-4491-9284-50f747241c3c service nova] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] No waiting events found dispatching network-vif-plugged-e1b7f229-903b-4665-bc7c-04cb578e7140 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:56:52 user nova-compute[73091]: WARNING nova.compute.manager [req-0a12bbe6-d272-46c7-9624-9993a352f6f0 req-00c7327d-1d3d-4491-9284-50f747241c3c service nova] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Received unexpected event network-vif-plugged-e1b7f229-903b-4665-bc7c-04cb578e7140 for instance with vm_state building and task_state spawning.
Aug 09 16:56:52 user nova-compute[73091]: INFO nova.compute.manager [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Took 6.09 seconds to build instance.
Aug 09 16:56:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2e4e8bb4-834d-469f-ae18-09d23f551653 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.199s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:56:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:56:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:56:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:56:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 16:56:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:56:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:56:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:57:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:57:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:57:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:57:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:57:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:57:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:57:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:57:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:57:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:57:22 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:57:22 user nova-compute[73091]: INFO nova.compute.claims [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Claim successful on node user
Aug 09 16:57:22 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:57:22 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:57:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:57:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:57:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:57:22 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:57:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:57:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:57:22 user nova-compute[73091]: DEBUG nova.policy [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e945ea4724446e5a6ee92a6b4d24ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfa5b9d92df40d6bdfef6e8dfd3fad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:57:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:57:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:57:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Creating image(s)
Aug 09 16:57:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "/opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:57:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "/opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:57:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "/opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:57:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:57:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:57:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:57:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:57:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.177s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk 1073741824" returned: 0 in 0.080s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.151s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Checking if we can resize image /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Cannot resize image /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'migration_context' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Ensure instance console log exists: /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Successfully created port: 8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:57:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:57:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Updating instance_info_cache with network_info: [{"id": "58bf6094-42a8-4567-abea-27c63a57cf8a", "address": "fa:16:3e:f3:dd:72", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf6094-42", "ovs_interfaceid": "58bf6094-42a8-4567-abea-27c63a57cf8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:57:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:57:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:57:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Successfully updated port: 8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:57:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:57:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquired lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:57:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:57:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-0b3de3ff-855f-44bc-b8e0-a350be682701 req-0f003f31-7499-4690-bd31-9623161ecec9 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received event network-changed-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:57:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-0b3de3ff-855f-44bc-b8e0-a350be682701 req-0f003f31-7499-4690-bd31-9623161ecec9 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Refreshing instance network info cache due to event network-changed-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:57:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0b3de3ff-855f-44bc-b8e0-a350be682701 req-0f003f31-7499-4690-bd31-9623161ecec9 service nova] Acquiring lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:57:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Updating instance_info_cache with network_info: [{"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Releasing lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Instance network_info: |[{"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0b3de3ff-855f-44bc-b8e0-a350be682701 req-0f003f31-7499-4690-bd31-9623161ecec9 service nova] Acquired lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.network.neutron [req-0b3de3ff-855f-44bc-b8e0-a350be682701 req-0f003f31-7499-4690-bd31-9623161ecec9 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Refreshing network info cache for port 8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Start _get_guest_xml network_info=[{"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:57:25 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:57:25 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1683471410',display_name='tempest-AttachVolumeTestJSON-server-1683471410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1683471410',id=46,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSqU7018x0ZKxU/TnR68mmpQfJ3/iIdN4gO2b9qKuQMylnJbXqCJVU8sCvfuom/2tN1tKX2DuUHbuYDqL1PZuoNGYX3mudz2G438ekxd/krtTvJFcZJCDSXUYHm9JgRDQ==',key_name='tempest-keypair-1988166130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cfa5b9d92df40d6bdfef6e8dfd3fad8',ramdisk_id='',reservation_id='r-nye9wi1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-99081524',owner_user_name='tempest-AttachVolumeTestJSON-99081524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:57:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e945ea4724446e5a6ee92a6b4d24ff0',uuid=980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converting VIF {"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'pci_devices' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:57:25 user nova-compute[73091]:   <uuid>980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2</uuid>
Aug 09 16:57:25 user nova-compute[73091]:   <name>instance-0000002e</name>
Aug 09 16:57:25 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:57:25 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:57:25 user nova-compute[73091]:   <metadata>
Aug 09 16:57:25 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:57:25 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:57:25 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeTestJSON-server-1683471410</nova:name>
Aug 09 16:57:25 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:57:25</nova:creationTime>
Aug 09 16:57:25 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:57:25 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:57:25 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:57:25 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:57:25 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:57:25 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:57:25 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:57:25 user nova-compute[73091]:       <nova:owner>
Aug 09 16:57:25 user nova-compute[73091]:         <nova:user uuid="2e945ea4724446e5a6ee92a6b4d24ff0">tempest-AttachVolumeTestJSON-99081524-project-member</nova:user>
Aug 09 16:57:25 user nova-compute[73091]:         <nova:project uuid="0cfa5b9d92df40d6bdfef6e8dfd3fad8">tempest-AttachVolumeTestJSON-99081524</nova:project>
Aug 09 16:57:25 user nova-compute[73091]:       </nova:owner>
Aug 09 16:57:25 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 16:57:25 user nova-compute[73091]:       <nova:ports>
Aug 09 16:57:25 user nova-compute[73091]:         <nova:port uuid="8c3038f5-c9cf-44e0-a2d5-5dee6e719d90">
Aug 09 16:57:25 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 16:57:25 user nova-compute[73091]:         </nova:port>
Aug 09 16:57:25 user nova-compute[73091]:       </nova:ports>
Aug 09 16:57:25 user nova-compute[73091]:     </nova:instance>
Aug 09 16:57:25 user nova-compute[73091]:   </metadata>
Aug 09 16:57:25 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:57:25 user nova-compute[73091]:     <system>
Aug 09 16:57:25 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:57:25 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:57:25 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:57:25 user nova-compute[73091]:       <entry name="serial">980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2</entry>
Aug 09 16:57:25 user nova-compute[73091]:       <entry name="uuid">980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2</entry>
Aug 09 16:57:25 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:57:25 user nova-compute[73091]:     </system>
Aug 09 16:57:25 user nova-compute[73091]:   </sysinfo>
Aug 09 16:57:25 user nova-compute[73091]:   <os>
Aug 09 16:57:25 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:57:25 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:57:25 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:57:25 user nova-compute[73091]:   </os>
Aug 09 16:57:25 user nova-compute[73091]:   <features>
Aug 09 16:57:25 user nova-compute[73091]:     <acpi/>
Aug 09 16:57:25 user nova-compute[73091]:     <apic/>
Aug 09 16:57:25 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:57:25 user nova-compute[73091]:   </features>
Aug 09 16:57:25 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:57:25 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:57:25 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:57:25 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:57:25 user nova-compute[73091]:   </clock>
Aug 09 16:57:25 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:57:25 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:57:25 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:57:25 user nova-compute[73091]:   </cpu>
Aug 09 16:57:25 user nova-compute[73091]:   <devices>
Aug 09 16:57:25 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 16:57:25 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 16:57:25 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk"/>
Aug 09 16:57:25 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:57:25 user nova-compute[73091]:     </disk>
Aug 09 16:57:25 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:57:25 user nova-compute[73091]:       <mac address="fa:16:3e:47:35:8e"/>
Aug 09 16:57:25 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:57:25 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:57:25 user nova-compute[73091]:       <target dev="tap8c3038f5-c9"/>
Aug 09 16:57:25 user nova-compute[73091]:     </interface>
Aug 09 16:57:25 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:57:25 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/console.log" append="off"/>
Aug 09 16:57:25 user nova-compute[73091]:     </serial>
Aug 09 16:57:25 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:57:25 user nova-compute[73091]:     <video>
Aug 09 16:57:25 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:57:25 user nova-compute[73091]:     </video>
Aug 09 16:57:25 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:57:25 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:57:25 user nova-compute[73091]:     </rng>
Aug 09 16:57:25 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:57:25 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:57:25 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:57:25 user nova-compute[73091]:     </memballoon>
Aug 09 16:57:25 user nova-compute[73091]:   </devices>
Aug 09 16:57:25 user nova-compute[73091]: </domain>
Aug 09 16:57:25 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1683471410',display_name='tempest-AttachVolumeTestJSON-server-1683471410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1683471410',id=46,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSqU7018x0ZKxU/TnR68mmpQfJ3/iIdN4gO2b9qKuQMylnJbXqCJVU8sCvfuom/2tN1tKX2DuUHbuYDqL1PZuoNGYX3mudz2G438ekxd/krtTvJFcZJCDSXUYHm9JgRDQ==',key_name='tempest-keypair-1988166130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cfa5b9d92df40d6bdfef6e8dfd3fad8',ramdisk_id='',reservation_id='r-nye9wi1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-99081524',owner_user_name='tempest-AttachVolumeTestJSON-99081524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:57:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e945ea4724446e5a6ee92a6b4d24ff0',uuid=980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converting VIF {"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG os_vif [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c3038f5-c9, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c3038f5-c9, col_values=(('external_ids', {'iface-id': '8c3038f5-c9cf-44e0-a2d5-5dee6e719d90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:35:8e', 'vm-uuid': '980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:25 user nova-compute[73091]: INFO os_vif [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9')
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] No VIF found with MAC fa:16:3e:47:35:8e, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.network.neutron [req-0b3de3ff-855f-44bc-b8e0-a350be682701 req-0f003f31-7499-4690-bd31-9623161ecec9 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Updated VIF entry in instance network info cache for port 8c3038f5-c9cf-44e0-a2d5-5dee6e719d90. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG nova.network.neutron [req-0b3de3ff-855f-44bc-b8e0-a350be682701 req-0f003f31-7499-4690-bd31-9623161ecec9 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Updating instance_info_cache with network_info: [{"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:57:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0b3de3ff-855f-44bc-b8e0-a350be682701 req-0f003f31-7499-4690-bd31-9623161ecec9 service nova] Releasing lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:57:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:57:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-3e2f5591-94a9-4ee7-a1f8-65bb4214d75e req-63faed7d-cfa5-4de2-a905-cf66b8659c9e service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received event network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:57:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3e2f5591-94a9-4ee7-a1f8-65bb4214d75e req-63faed7d-cfa5-4de2-a905-cf66b8659c9e service nova] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:57:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3e2f5591-94a9-4ee7-a1f8-65bb4214d75e req-63faed7d-cfa5-4de2-a905-cf66b8659c9e service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:57:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3e2f5591-94a9-4ee7-a1f8-65bb4214d75e req-63faed7d-cfa5-4de2-a905-cf66b8659c9e service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:57:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-3e2f5591-94a9-4ee7-a1f8-65bb4214d75e req-63faed7d-cfa5-4de2-a905-cf66b8659c9e service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] No waiting events found dispatching network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:57:27 user nova-compute[73091]: WARNING nova.compute.manager [req-3e2f5591-94a9-4ee7-a1f8-65bb4214d75e req-63faed7d-cfa5-4de2-a905-cf66b8659c9e service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received unexpected event network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 for instance with vm_state building and task_state spawning.
Aug 09 16:57:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:57:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:57:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:57:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:57:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:57:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:57:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:57:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:57:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:57:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:57:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:57:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:57:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:57:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:57:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:57:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:57:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:57:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:57:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-e382189c-df67-4c36-ab86-4de0bef4ae52 req-a1d906cb-446f-4075-b1cb-32591167d691 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received event network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e382189c-df67-4c36-ab86-4de0bef4ae52 req-a1d906cb-446f-4075-b1cb-32591167d691 service nova] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e382189c-df67-4c36-ab86-4de0bef4ae52 req-a1d906cb-446f-4075-b1cb-32591167d691 service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e382189c-df67-4c36-ab86-4de0bef4ae52 req-a1d906cb-446f-4075-b1cb-32591167d691 service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-e382189c-df67-4c36-ab86-4de0bef4ae52 req-a1d906cb-446f-4075-b1cb-32591167d691 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] No waiting events found dispatching network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:57:29 user nova-compute[73091]: WARNING nova.compute.manager [req-e382189c-df67-4c36-ab86-4de0bef4ae52 req-a1d906cb-446f-4075-b1cb-32591167d691 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received unexpected event network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 for instance with vm_state building and task_state spawning.
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600249.27077, 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:57:29 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] VM Resumed (Lifecycle Event)
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:57:29 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Instance spawned successfully.
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:57:29 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600249.2730393, 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:57:29 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] VM Started (Lifecycle Event)
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:57:29 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:57:29 user nova-compute[73091]: INFO nova.compute.manager [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Took 7.09 seconds to spawn the instance on the hypervisor.
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:57:29 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:57:29 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8272MB free_disk=25.078670501708984GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:57:29 user nova-compute[73091]: INFO nova.compute.manager [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Took 7.81 seconds to build instance.
Aug 09 16:57:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1397bbc5-6010-4382-afa6-ceb443d696f5 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.906s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c3871ef4-45e7-4118-8227-e48cc857d481 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 76055017-05ff-4ea7-ae9c-66d2e502e090 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance be5d7299-6eb0-4ba4-a2a3-f4c513168d68 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:57:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:57:30 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:57:30 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:57:30 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:57:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:57:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:57:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:57:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:57:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:57:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:57:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:57:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:57:33 user nova-compute[73091]: INFO nova.compute.manager [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Terminating instance
Aug 09 16:57:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 16:57:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-e2702d1b-ae62-41bf-b646-535df9fa3a07 req-70b90f0f-06ac-4000-a04f-8ceef73556d6 service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Received event network-vif-unplugged-236391c4-e172-433a-bb75-b3324f92ec1d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:57:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e2702d1b-ae62-41bf-b646-535df9fa3a07 req-70b90f0f-06ac-4000-a04f-8ceef73556d6 service nova] Acquiring lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:57:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e2702d1b-ae62-41bf-b646-535df9fa3a07 req-70b90f0f-06ac-4000-a04f-8ceef73556d6 service nova] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:57:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e2702d1b-ae62-41bf-b646-535df9fa3a07 req-70b90f0f-06ac-4000-a04f-8ceef73556d6 service nova] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:57:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-e2702d1b-ae62-41bf-b646-535df9fa3a07 req-70b90f0f-06ac-4000-a04f-8ceef73556d6 service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] No waiting events found dispatching network-vif-unplugged-236391c4-e172-433a-bb75-b3324f92ec1d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:57:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-e2702d1b-ae62-41bf-b646-535df9fa3a07 req-70b90f0f-06ac-4000-a04f-8ceef73556d6 service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Received event network-vif-unplugged-236391c4-e172-433a-bb75-b3324f92ec1d for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 16:57:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Instance destroyed successfully.
Aug 09 16:57:34 user nova-compute[73091]: DEBUG nova.objects.instance [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lazy-loading 'resources' on Instance uuid bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:57:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:53:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1525806518',display_name='tempest-TestServerVolumeAttachmentScenario-server-1525806518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1525806518',id=43,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0ut9lNmoEV0hgtWduhzJd+NiW35iXYnFeydNtKTvE9+gIQHY8OlujRzFeU6RoZMuvFu95HaVrnoRpPILolxxGwQ1OHYyrZDup9HSgWglSC28LJ9db1JNUOcIPUXiNW2w==',key_name='tempest-keypair-2050407441',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:53:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4e26fc699254693b43c6d3a097b56ff',ramdisk_id='',reservation_id='r-4q21ykav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-206736863',owner_user_name='tempest-TestServerVolumeAttachmentScenario-206736863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:53:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cab8def6097d414daf1d2b5a4b2a56c9',uuid=bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "236391c4-e172-433a-bb75-b3324f92ec1d", "address": "fa:16:3e:20:bc:16", "network": {"id": "b81dfad5-9bb3-4c52-ae30-27b42f42bda0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-349073738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e26fc699254693b43c6d3a097b56ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236391c4-e1", "ovs_interfaceid": "236391c4-e172-433a-bb75-b3324f92ec1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 16:57:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Converting VIF {"id": "236391c4-e172-433a-bb75-b3324f92ec1d", "address": "fa:16:3e:20:bc:16", "network": {"id": "b81dfad5-9bb3-4c52-ae30-27b42f42bda0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-349073738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e26fc699254693b43c6d3a097b56ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236391c4-e1", "ovs_interfaceid": "236391c4-e172-433a-bb75-b3324f92ec1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:57:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:bc:16,bridge_name='br-int',has_traffic_filtering=True,id=236391c4-e172-433a-bb75-b3324f92ec1d,network=Network(b81dfad5-9bb3-4c52-ae30-27b42f42bda0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236391c4-e1') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:57:34 user nova-compute[73091]: DEBUG os_vif [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:bc:16,bridge_name='br-int',has_traffic_filtering=True,id=236391c4-e172-433a-bb75-b3324f92ec1d,network=Network(b81dfad5-9bb3-4c52-ae30-27b42f42bda0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236391c4-e1') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 16:57:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap236391c4-e1, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:57:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:57:34 user nova-compute[73091]: INFO os_vif [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:bc:16,bridge_name='br-int',has_traffic_filtering=True,id=236391c4-e172-433a-bb75-b3324f92ec1d,network=Network(b81dfad5-9bb3-4c52-ae30-27b42f42bda0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236391c4-e1')
Aug 09 16:57:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Deleting instance files /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76_del
Aug 09 16:57:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Deletion of /opt/stack/data/nova/instances/bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76_del complete
Aug 09 16:57:34 user nova-compute[73091]: INFO nova.compute.manager [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 09 16:57:34 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 16:57:34 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 16:57:34 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 16:57:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:35 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:57:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-4583e830-70ad-4ab8-a352-64d09d96b0ff req-d0f0795f-17c3-46c4-804c-301d106be9e4 service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Received event network-vif-deleted-236391c4-e172-433a-bb75-b3324f92ec1d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:57:35 user nova-compute[73091]: INFO nova.compute.manager [req-4583e830-70ad-4ab8-a352-64d09d96b0ff req-d0f0795f-17c3-46c4-804c-301d106be9e4 service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Neutron deleted interface 236391c4-e172-433a-bb75-b3324f92ec1d; detaching it from the instance and deleting it from the info cache
Aug 09 16:57:35 user nova-compute[73091]: DEBUG nova.network.neutron [req-4583e830-70ad-4ab8-a352-64d09d96b0ff req-d0f0795f-17c3-46c4-804c-301d106be9e4 service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:57:35 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Took 1.01 seconds to deallocate network for instance.
Aug 09 16:57:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-4583e830-70ad-4ab8-a352-64d09d96b0ff req-d0f0795f-17c3-46c4-804c-301d106be9e4 service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Detach interface failed, port_id=236391c4-e172-433a-bb75-b3324f92ec1d, reason: Instance bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 16:57:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:57:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:57:36 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:57:36 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:57:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-987bed54-ceed-4c58-8ee4-df5f56e4b47e req-4131ef20-0a24-4c1c-aee9-c77f01d48b0a service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Received event network-vif-plugged-236391c4-e172-433a-bb75-b3324f92ec1d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:57:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-987bed54-ceed-4c58-8ee4-df5f56e4b47e req-4131ef20-0a24-4c1c-aee9-c77f01d48b0a service nova] Acquiring lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:57:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-987bed54-ceed-4c58-8ee4-df5f56e4b47e req-4131ef20-0a24-4c1c-aee9-c77f01d48b0a service nova] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:57:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-987bed54-ceed-4c58-8ee4-df5f56e4b47e req-4131ef20-0a24-4c1c-aee9-c77f01d48b0a service nova] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:57:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-987bed54-ceed-4c58-8ee4-df5f56e4b47e req-4131ef20-0a24-4c1c-aee9-c77f01d48b0a service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] No waiting events found dispatching network-vif-plugged-236391c4-e172-433a-bb75-b3324f92ec1d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:57:36 user nova-compute[73091]: WARNING nova.compute.manager [req-987bed54-ceed-4c58-8ee4-df5f56e4b47e req-4131ef20-0a24-4c1c-aee9-c77f01d48b0a service nova] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Received unexpected event network-vif-plugged-236391c4-e172-433a-bb75-b3324f92ec1d for instance with vm_state deleted and task_state None.
Aug 09 16:57:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.562s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:57:36 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Deleted allocations for instance bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76
Aug 09 16:57:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-904ac976-f06b-4abd-91b3-17b64729f871 tempest-TestServerVolumeAttachmentScenario-206736863 tempest-TestServerVolumeAttachmentScenario-206736863-project-member] Lock "bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.734s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:57:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:49 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691600254.5670545, bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:57:49 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] VM Stopped (Lifecycle Event)
Aug 09 16:57:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-590f2962-afff-40bb-8f23-494b5ddb41b8 None None] [instance: bb32d63b-1e9e-4ef0-b2a9-f18bbd475a76] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:57:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:57:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:58:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:58:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:58:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:58:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:58:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:58:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:58:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 16:58:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:58:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:58:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:58:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:58:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:58:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:58:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:58:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:58:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:30 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:58:30 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:58:30 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8341MB free_disk=25.065929412841797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:58:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:58:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:58:30 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c3871ef4-45e7-4118-8227-e48cc857d481 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:58:30 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 76055017-05ff-4ea7-ae9c-66d2e502e090 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:58:30 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance be5d7299-6eb0-4ba4-a2a3-f4c513168d68 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:58:30 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:58:30 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:58:30 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:58:30 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:58:30 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:58:30 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:58:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:58:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:58:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:58:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:58:37 user nova-compute[73091]: INFO nova.compute.manager [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] instance snapshotting
Aug 09 16:58:37 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Beginning live snapshot process
Aug 09 16:58:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json -f qcow2" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json -f qcow2" returned: 0 in 0.161s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbiwkaezr/7a1d411aa20e4a299996cca6bc36618f.delta 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbiwkaezr/7a1d411aa20e4a299996cca6bc36618f.delta 1073741824" returned: 0 in 0.053s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:38 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 16:58:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:58:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 16:58:39 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 16:58:39 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 16:58:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbiwkaezr/7a1d411aa20e4a299996cca6bc36618f.delta /opt/stack/data/nova/instances/snapshots/tmpbiwkaezr/7a1d411aa20e4a299996cca6bc36618f {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbiwkaezr/7a1d411aa20e4a299996cca6bc36618f.delta /opt/stack/data/nova/instances/snapshots/tmpbiwkaezr/7a1d411aa20e4a299996cca6bc36618f" returned: 0 in 0.648s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:40 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Snapshot extracted, beginning image upload
Aug 09 16:58:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquiring lock "7b305674-a656-44f5-9d67-cf927acf62f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:58:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "7b305674-a656-44f5-9d67-cf927acf62f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:58:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:58:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:58:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:58:42 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:58:42 user nova-compute[73091]: INFO nova.compute.claims [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Claim successful on node user
Aug 09 16:58:42 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:58:42 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:58:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:58:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:58:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:58:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:58:42 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:58:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:58:42 user nova-compute[73091]: INFO nova.virt.block_device [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Booting with volume 7d410516-eabf-450f-b315-9b31d3909db2 at /dev/vda
Aug 09 16:58:43 user nova-compute[73091]: DEBUG nova.policy [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00eda119bf8041d59b4cf94b02b4b1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05969405da7a47968fe16aabc3724131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG os_brick.utils [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[af87e036-25fa-4a27-bb4f-a00d928f71ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ee1731-15ca-4606-9188-752887038155]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ead75a-7205-4657-987a-8b8934404212]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbb4ea7-8754-4a8f-acda-bc4e8499a437]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:58:43 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:58:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a26da1d-41e1-4e48-8919-65a3403d6a4f]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG os_brick.utils [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:58:43 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Updating existing volume attachment record: ff271444-b127-42a1-a932-93ef38c743fe {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:58:43 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Snapshot image upload complete
Aug 09 16:58:43 user nova-compute[73091]: INFO nova.compute.manager [None req-22384506-70e5-4811-9d54-6c0473918920 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Took 5.81 seconds to snapshot the instance on the hypervisor.
Aug 09 16:58:43 user nova-compute[73091]: DEBUG nova.network.neutron [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Successfully created port: 969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:58:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:44 user nova-compute[73091]: DEBUG nova.network.neutron [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Successfully updated port: 969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:58:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquiring lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:58:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquired lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:58:44 user nova-compute[73091]: DEBUG nova.network.neutron [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:58:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-9893b59d-3398-4aa1-bca0-859ae49b0661 req-8c0af4e6-c0eb-499b-888c-84413ce4f0a4 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received event network-changed-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:58:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-9893b59d-3398-4aa1-bca0-859ae49b0661 req-8c0af4e6-c0eb-499b-888c-84413ce4f0a4 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Refreshing instance network info cache due to event network-changed-969bce7a-0683-42cd-bae1-12ae87f2cf3b. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:58:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9893b59d-3398-4aa1-bca0-859ae49b0661 req-8c0af4e6-c0eb-499b-888c-84413ce4f0a4 service nova] Acquiring lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:58:44 user nova-compute[73091]: DEBUG nova.network.neutron [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:58:45 user nova-compute[73091]: DEBUG nova.network.neutron [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Updating instance_info_cache with network_info: [{"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:58:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Releasing lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:58:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Instance network_info: |[{"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:58:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9893b59d-3398-4aa1-bca0-859ae49b0661 req-8c0af4e6-c0eb-499b-888c-84413ce4f0a4 service nova] Acquired lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:58:45 user nova-compute[73091]: DEBUG nova.network.neutron [req-9893b59d-3398-4aa1-bca0-859ae49b0661 req-8c0af4e6-c0eb-499b-888c-84413ce4f0a4 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Refreshing network info cache for port 969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:58:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:45 user nova-compute[73091]: DEBUG nova.network.neutron [req-9893b59d-3398-4aa1-bca0-859ae49b0661 req-8c0af4e6-c0eb-499b-888c-84413ce4f0a4 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Updated VIF entry in instance network info cache for port 969bce7a-0683-42cd-bae1-12ae87f2cf3b. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:58:45 user nova-compute[73091]: DEBUG nova.network.neutron [req-9893b59d-3398-4aa1-bca0-859ae49b0661 req-8c0af4e6-c0eb-499b-888c-84413ce4f0a4 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Updating instance_info_cache with network_info: [{"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:58:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9893b59d-3398-4aa1-bca0-859ae49b0661 req-8c0af4e6-c0eb-499b-888c-84413ce4f0a4 service nova] Releasing lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:58:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 16:58:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 16:58:51 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Creating image(s)
Aug 09 16:58:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 16:58:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Ensure instance console log exists: /opt/stack/data/nova/instances/7b305674-a656-44f5-9d67-cf927acf62f8/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 16:58:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:58:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:58:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:58:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Start _get_guest_xml network_info=[{"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'ff271444-b127-42a1-a932-93ef38c743fe', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byzNJqnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7b305674-a656-44f5-9d67-cf927acf62f8', 'attached_at': '', 'detached_at': '', 'volume_id': '7d410516-eabf-450f-b315-9b31d3909db2', 'serial': '7d410516-eabf-450f-b315-9b31d3909db2'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 16:58:51 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:58:51 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:58:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 16:58:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 16:58:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 16:58:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 16:58:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 16:58:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 16:58:51 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byzNJqnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:58:52 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:58:52 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:58:52 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[78abf53f-ff8d-4f0c-8c41-0660a6748d8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:58:52 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4abb4b-c164-4333-a5a5-99c7c847e6a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2] added
Aug 09 16:58:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bfa807-bb39-4392-867a-17efdb677ad6]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1778bc35-db0b-4d66-bcb0-2fb90c8b8fbc]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v byzNJqnZ {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v byzNJqnZ" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81a44dc-ca98-4279-9a10-e992886a7f39]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'byzNJqnZ'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[645376e9-0a14-4c85-be37-5690d132a766]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f3ffba-c093-4295-a1dc-cfd38cc29b21]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:58:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:58:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[10247396-80b9-46c7-90f0-d079a1c66d69]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2, portal: 172.16.0.220,3260]
Aug 09 16:58:52 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2, portal: 172.16.0.220,3260] successful.
Aug 09 16:58:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[52537b6c-1ee5-45e9-aa5f-8d409c5097ea]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[41162b9f-4fd3-4e72-943a-9cc9881bf816]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:58:52 user nova-compute[73091]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)
Aug 09 16:58:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:58:52 user nova-compute[73091]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)
Aug 09 16:58:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fbccff-0ff1-45f5-87bb-1f5a073af8cf]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:58:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byzNJqnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23835663331326433', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835663331326433', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1712628175',display_name='tempest-TestShelveInstance-server-1712628175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1712628175',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOW9jV/hfeCpzsdHs7XFFab0aEiC4shK8n6mgWb67Xb6Nt74n6LbvjQ/6+PuuON3YH7tiHMWI9JqXUl0nbKyfsqdZj68N9HhRnUC/2LcKon0+DH15Pk3wLXB52HK/NZ4Q==',key_name='tempest-TestShelveInstance-622552020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05969405da7a47968fe16aabc3724131',ramdisk_id='',reservation_id='r-ctyu5xzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2078233597',owner_user_name='tempest-TestShelveInstance-2078233597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:58:43Z,user_data=None,user_id='00eda119bf8041d59b4cf94b02b4b1a0',uuid=7b305674-a656-44f5-9d67-cf927acf62f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Converting VIF {"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=969bce7a-0683-42cd-bae1-12ae87f2cf3b,network=Network(d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bce7a-06') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG nova.objects.instance [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b305674-a656-44f5-9d67-cf927acf62f8 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] End _get_guest_xml xml=<domain type="kvm">
Aug 09 16:58:53 user nova-compute[73091]:   <uuid>7b305674-a656-44f5-9d67-cf927acf62f8</uuid>
Aug 09 16:58:53 user nova-compute[73091]:   <name>instance-0000002f</name>
Aug 09 16:58:53 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 16:58:53 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 16:58:53 user nova-compute[73091]:   <metadata>
Aug 09 16:58:53 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 16:58:53 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 16:58:53 user nova-compute[73091]:       <nova:name>tempest-TestShelveInstance-server-1712628175</nova:name>
Aug 09 16:58:53 user nova-compute[73091]:       <nova:creationTime>2023-08-09 16:58:51</nova:creationTime>
Aug 09 16:58:53 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 16:58:53 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 16:58:53 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 16:58:53 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 16:58:53 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 16:58:53 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 16:58:53 user nova-compute[73091]:       </nova:flavor>
Aug 09 16:58:53 user nova-compute[73091]:       <nova:owner>
Aug 09 16:58:53 user nova-compute[73091]:         <nova:user uuid="00eda119bf8041d59b4cf94b02b4b1a0">tempest-TestShelveInstance-2078233597-project-member</nova:user>
Aug 09 16:58:53 user nova-compute[73091]:         <nova:project uuid="05969405da7a47968fe16aabc3724131">tempest-TestShelveInstance-2078233597</nova:project>
Aug 09 16:58:53 user nova-compute[73091]:       </nova:owner>
Aug 09 16:58:53 user nova-compute[73091]:       <nova:ports>
Aug 09 16:58:53 user nova-compute[73091]:         <nova:port uuid="969bce7a-0683-42cd-bae1-12ae87f2cf3b">
Aug 09 16:58:53 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 16:58:53 user nova-compute[73091]:         </nova:port>
Aug 09 16:58:53 user nova-compute[73091]:       </nova:ports>
Aug 09 16:58:53 user nova-compute[73091]:     </nova:instance>
Aug 09 16:58:53 user nova-compute[73091]:   </metadata>
Aug 09 16:58:53 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 16:58:53 user nova-compute[73091]:     <system>
Aug 09 16:58:53 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 16:58:53 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 16:58:53 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 16:58:53 user nova-compute[73091]:       <entry name="serial">7b305674-a656-44f5-9d67-cf927acf62f8</entry>
Aug 09 16:58:53 user nova-compute[73091]:       <entry name="uuid">7b305674-a656-44f5-9d67-cf927acf62f8</entry>
Aug 09 16:58:53 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 16:58:53 user nova-compute[73091]:     </system>
Aug 09 16:58:53 user nova-compute[73091]:   </sysinfo>
Aug 09 16:58:53 user nova-compute[73091]:   <os>
Aug 09 16:58:53 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 16:58:53 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 16:58:53 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 16:58:53 user nova-compute[73091]:   </os>
Aug 09 16:58:53 user nova-compute[73091]:   <features>
Aug 09 16:58:53 user nova-compute[73091]:     <acpi/>
Aug 09 16:58:53 user nova-compute[73091]:     <apic/>
Aug 09 16:58:53 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 16:58:53 user nova-compute[73091]:   </features>
Aug 09 16:58:53 user nova-compute[73091]:   <clock offset="utc">
Aug 09 16:58:53 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 16:58:53 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 16:58:53 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 16:58:53 user nova-compute[73091]:   </clock>
Aug 09 16:58:53 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 16:58:53 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 16:58:53 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 16:58:53 user nova-compute[73091]:   </cpu>
Aug 09 16:58:53 user nova-compute[73091]:   <devices>
Aug 09 16:58:53 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 16:58:53 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:58:53 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 09 16:58:53 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 16:58:53 user nova-compute[73091]:       <serial>7d410516-eabf-450f-b315-9b31d3909db2</serial>
Aug 09 16:58:53 user nova-compute[73091]:     </disk>
Aug 09 16:58:53 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 16:58:53 user nova-compute[73091]:       <mac address="fa:16:3e:e3:fa:65"/>
Aug 09 16:58:53 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:58:53 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 16:58:53 user nova-compute[73091]:       <target dev="tap969bce7a-06"/>
Aug 09 16:58:53 user nova-compute[73091]:     </interface>
Aug 09 16:58:53 user nova-compute[73091]:     <serial type="pty">
Aug 09 16:58:53 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/7b305674-a656-44f5-9d67-cf927acf62f8/console.log" append="off"/>
Aug 09 16:58:53 user nova-compute[73091]:     </serial>
Aug 09 16:58:53 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 16:58:53 user nova-compute[73091]:     <video>
Aug 09 16:58:53 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 16:58:53 user nova-compute[73091]:     </video>
Aug 09 16:58:53 user nova-compute[73091]:     <rng model="virtio">
Aug 09 16:58:53 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 16:58:53 user nova-compute[73091]:     </rng>
Aug 09 16:58:53 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 16:58:53 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 16:58:53 user nova-compute[73091]:       <stats period="10"/>
Aug 09 16:58:53 user nova-compute[73091]:     </memballoon>
Aug 09 16:58:53 user nova-compute[73091]:   </devices>
Aug 09 16:58:53 user nova-compute[73091]: </domain>
Aug 09 16:58:53 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1712628175',display_name='tempest-TestShelveInstance-server-1712628175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1712628175',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOW9jV/hfeCpzsdHs7XFFab0aEiC4shK8n6mgWb67Xb6Nt74n6LbvjQ/6+PuuON3YH7tiHMWI9JqXUl0nbKyfsqdZj68N9HhRnUC/2LcKon0+DH15Pk3wLXB52HK/NZ4Q==',key_name='tempest-TestShelveInstance-622552020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05969405da7a47968fe16aabc3724131',ramdisk_id='',reservation_id='r-ctyu5xzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2078233597',owner_user_name='tempest-TestShelveInstance-2078233597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:58:43Z,user_data=None,user_id='00eda119bf8041d59b4cf94b02b4b1a0',uuid=7b305674-a656-44f5-9d67-cf927acf62f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Converting VIF {"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=969bce7a-0683-42cd-bae1-12ae87f2cf3b,network=Network(d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bce7a-06') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG os_vif [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=969bce7a-0683-42cd-bae1-12ae87f2cf3b,network=Network(d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bce7a-06') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap969bce7a-06, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap969bce7a-06, col_values=(('external_ids', {'iface-id': '969bce7a-0683-42cd-bae1-12ae87f2cf3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:fa:65', 'vm-uuid': '7b305674-a656-44f5-9d67-cf927acf62f8'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:53 user nova-compute[73091]: INFO os_vif [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=969bce7a-0683-42cd-bae1-12ae87f2cf3b,network=Network(d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bce7a-06')
Aug 09 16:58:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:58:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] No VIF found with MAC fa:16:3e:e3:fa:65, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:58:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-35c56ada-7a9d-4f5a-be7c-981c3b8563c5 req-7c9e38ea-43ac-40e8-9dac-8e260d28a4bc service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received event network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:58:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-35c56ada-7a9d-4f5a-be7c-981c3b8563c5 req-7c9e38ea-43ac-40e8-9dac-8e260d28a4bc service nova] Acquiring lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:58:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-35c56ada-7a9d-4f5a-be7c-981c3b8563c5 req-7c9e38ea-43ac-40e8-9dac-8e260d28a4bc service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:58:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-35c56ada-7a9d-4f5a-be7c-981c3b8563c5 req-7c9e38ea-43ac-40e8-9dac-8e260d28a4bc service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:58:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-35c56ada-7a9d-4f5a-be7c-981c3b8563c5 req-7c9e38ea-43ac-40e8-9dac-8e260d28a4bc service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] No waiting events found dispatching network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:58:55 user nova-compute[73091]: WARNING nova.compute.manager [req-35c56ada-7a9d-4f5a-be7c-981c3b8563c5 req-7c9e38ea-43ac-40e8-9dac-8e260d28a4bc service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received unexpected event network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b for instance with vm_state building and task_state spawning.
Aug 09 16:58:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:58:56 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600336.9012861, 7b305674-a656-44f5-9d67-cf927acf62f8 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:58:56 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] VM Resumed (Lifecycle Event)
Aug 09 16:58:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 16:58:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 16:58:56 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Instance spawned successfully.
Aug 09 16:58:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 16:58:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:58:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:58:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:58:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:58:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:58:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:58:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:58:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 16:58:56 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:58:56 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600336.905454, 7b305674-a656-44f5-9d67-cf927acf62f8 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:58:56 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] VM Started (Lifecycle Event)
Aug 09 16:58:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:58:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:58:57 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 16:58:57 user nova-compute[73091]: INFO nova.compute.manager [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Took 5.06 seconds to spawn the instance on the hypervisor.
Aug 09 16:58:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:58:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-94a010c4-3f03-4c22-b55f-4a4b56c86d00 req-816f9c47-3b30-48ff-83e5-280e126314c2 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received event network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:58:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-94a010c4-3f03-4c22-b55f-4a4b56c86d00 req-816f9c47-3b30-48ff-83e5-280e126314c2 service nova] Acquiring lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:58:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-94a010c4-3f03-4c22-b55f-4a4b56c86d00 req-816f9c47-3b30-48ff-83e5-280e126314c2 service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:58:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-94a010c4-3f03-4c22-b55f-4a4b56c86d00 req-816f9c47-3b30-48ff-83e5-280e126314c2 service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:58:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-94a010c4-3f03-4c22-b55f-4a4b56c86d00 req-816f9c47-3b30-48ff-83e5-280e126314c2 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] No waiting events found dispatching network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:58:57 user nova-compute[73091]: WARNING nova.compute.manager [req-94a010c4-3f03-4c22-b55f-4a4b56c86d00 req-816f9c47-3b30-48ff-83e5-280e126314c2 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received unexpected event network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b for instance with vm_state building and task_state spawning.
Aug 09 16:58:57 user nova-compute[73091]: INFO nova.compute.manager [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Took 14.64 seconds to build instance.
Aug 09 16:58:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3f21b0b8-217f-4a71-b76b-969be2fe7c56 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "7b305674-a656-44f5-9d67-cf927acf62f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.756s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:58:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:10 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:59:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-989c2120-a85b-41bc-86a9-51093cac69e0 req-4a192040-28c5-4669-a79f-53d0f7c2885b service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received event network-changed-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:59:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-989c2120-a85b-41bc-86a9-51093cac69e0 req-4a192040-28c5-4669-a79f-53d0f7c2885b service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Refreshing instance network info cache due to event network-changed-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:59:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-989c2120-a85b-41bc-86a9-51093cac69e0 req-4a192040-28c5-4669-a79f-53d0f7c2885b service nova] Acquiring lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:59:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-989c2120-a85b-41bc-86a9-51093cac69e0 req-4a192040-28c5-4669-a79f-53d0f7c2885b service nova] Acquired lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:59:13 user nova-compute[73091]: DEBUG nova.network.neutron [req-989c2120-a85b-41bc-86a9-51093cac69e0 req-4a192040-28c5-4669-a79f-53d0f7c2885b service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Refreshing network info cache for port 8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:59:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:59:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 16:59:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:59:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:59:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:13 user nova-compute[73091]: DEBUG nova.network.neutron [req-989c2120-a85b-41bc-86a9-51093cac69e0 req-4a192040-28c5-4669-a79f-53d0f7c2885b service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Updated VIF entry in instance network info cache for port 8c3038f5-c9cf-44e0-a2d5-5dee6e719d90. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:59:13 user nova-compute[73091]: DEBUG nova.network.neutron [req-989c2120-a85b-41bc-86a9-51093cac69e0 req-4a192040-28c5-4669-a79f-53d0f7c2885b service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Updating instance_info_cache with network_info: [{"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:59:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-989c2120-a85b-41bc-86a9-51093cac69e0 req-4a192040-28c5-4669-a79f-53d0f7c2885b service nova] Releasing lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:59:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:59:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 16:59:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:59:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:59:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'flavor' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:59:19 user nova-compute[73091]: INFO nova.compute.manager [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Attaching volume 692152b7-2423-44c0-9adc-8a8066652c33 to /dev/vdb
Aug 09 16:59:19 user nova-compute[73091]: DEBUG os_brick.utils [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3629b9-4f44-4b4f-ad29-f694b78f9035]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcbd6f0-1d70-444d-b3d3-66ccf2974c7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0ccd9d-167c-41c1-854f-78328e8eddcb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d9ea07-4076-4056-9cb4-923a7ea25fcf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:59:19 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:59:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a0b001-3843-43aa-b2cf-dc7927dc6d4a]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG os_brick.utils [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:59:19 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Updating existing volume attachment record: 347bb209-0f74-489c-8bf1-2ec4ab532e77 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:59:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:59:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 16:59:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:24 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:59:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 16:59:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 16:59:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:59:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 16:59:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 16:59:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-c3871ef4-45e7-4118-8227-e48cc857d481" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:59:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-c3871ef4-45e7-4118-8227-e48cc857d481" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:59:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 16:59:27 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid c3871ef4-45e7-4118-8227-e48cc857d481 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:59:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Updating instance_info_cache with network_info: [{"id": "1d3f6a45-6b36-4603-b510-442d6ba16232", "address": "fa:16:3e:78:8d:86", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3f6a45-6b", "ovs_interfaceid": "1d3f6a45-6b36-4603-b510-442d6ba16232", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:59:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-c3871ef4-45e7-4118-8227-e48cc857d481" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:59:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 16:59:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmydhAsH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:59:28 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:59:28 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 16:59:28 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 16:59:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b782d3-967d-46b1-a9dc-404a0d1dfd34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 16:59:28 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55b6b7a-40b1-4385-8a07-f43909b278f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33] added
Aug 09 16:59:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[49898ae9-288b-43f1-bffb-acca0ee3a441]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3d4cfb-e076-47b3-882c-6f22e67212c7]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cmydhAsH {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cmydhAsH" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[824e3473-6c51-42da-9e05-6b34cc7f9ac7]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cmydhAsH'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a974619c-a88e-48f1-86db-b38624af777e]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3da484b-1d48-4fa8-ac2f-762279e0aac7]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:59:28 user nova-compute[73091]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)
Aug 09 16:59:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:59:28 user nova-compute[73091]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)
Aug 09 16:59:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b079f80-d833-477a-b2df-69965bf4e7b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33, portal: 172.16.0.220,3260]
Aug 09 16:59:28 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33, portal: 172.16.0.220,3260] successful.
Aug 09 16:59:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[be709415-5ba0-4df1-86f5-84ce3ef2e202]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44f1234-e49a-478f-8e64-2933253632bb]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:59:28 user nova-compute[73091]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)
Aug 09 16:59:28 user nova-compute[73091]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)
Aug 09 16:59:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 16:59:28 user nova-compute[73091]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)
Aug 09 16:59:28 user nova-compute[73091]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)
Aug 09 16:59:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e3cc54-5585-4e96-8808-60c20f27e9a1]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmydhAsH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 16:59:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:59:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 16:59:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23131353461663539', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:59:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131353461663539', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 16:59:29 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'flavor' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:59:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 16:59:29 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 16:59:29 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 09 16:59:29 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 16:59:29 user nova-compute[73091]:   <serial>692152b7-2423-44c0-9adc-8a8066652c33</serial>
Aug 09 16:59:29 user nova-compute[73091]: </disk>
Aug 09 16:59:29 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 16:59:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:59:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:59:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:59:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 16:59:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] No VIF found with MAC fa:16:3e:47:35:8e, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 16:59:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1f1b0770-5678-41d9-93a8-97c2b9502a85 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.832s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:59:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:59:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:59:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:59:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:59:30 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 16:59:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-65d8bbad-72f4-4e62-9142-1232c2913f18 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:59:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-65d8bbad-72f4-4e62-9142-1232c2913f18 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.003s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:59:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-65d8bbad-72f4-4e62-9142-1232c2913f18 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:59:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-65d8bbad-72f4-4e62-9142-1232c2913f18 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73091) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 09 16:59:31 user nova-compute[73091]: DEBUG nova.objects.instance [None req-65d8bbad-72f4-4e62-9142-1232c2913f18 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'flavor' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 16:59:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:59:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:59:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 16:59:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-43ce04f8-4460-432d-a7ee-24aab7b14eee req-ec60234b-e2a9-48c0-86d9-cbc4aeec30dc service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received event network-vif-unplugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:59:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-43ce04f8-4460-432d-a7ee-24aab7b14eee req-ec60234b-e2a9-48c0-86d9-cbc4aeec30dc service nova] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:59:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-43ce04f8-4460-432d-a7ee-24aab7b14eee req-ec60234b-e2a9-48c0-86d9-cbc4aeec30dc service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:59:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-43ce04f8-4460-432d-a7ee-24aab7b14eee req-ec60234b-e2a9-48c0-86d9-cbc4aeec30dc service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:59:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-43ce04f8-4460-432d-a7ee-24aab7b14eee req-ec60234b-e2a9-48c0-86d9-cbc4aeec30dc service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] No waiting events found dispatching network-vif-unplugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:59:32 user nova-compute[73091]: WARNING nova.compute.manager [req-43ce04f8-4460-432d-a7ee-24aab7b14eee req-ec60234b-e2a9-48c0-86d9-cbc4aeec30dc service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received unexpected event network-vif-unplugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 for instance with vm_state active and task_state powering-off.
Aug 09 16:59:32 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Instance destroyed successfully.
Aug 09 16:59:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-65d8bbad-72f4-4e62-9142-1232c2913f18 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:59:32 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:59:32 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 16:59:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8320MB free_disk=25.003929138183594GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 16:59:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:59:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:59:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-65d8bbad-72f4-4e62-9142-1232c2913f18 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.288s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:59:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c3871ef4-45e7-4118-8227-e48cc857d481 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:59:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 76055017-05ff-4ea7-ae9c-66d2e502e090 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:59:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance be5d7299-6eb0-4ba4-a2a3-f4c513168d68 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:59:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:59:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 7b305674-a656-44f5-9d67-cf927acf62f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 16:59:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 16:59:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 16:59:33 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing inventories for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 16:59:33 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Updating ProviderTree inventory for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 16:59:33 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Updating inventory in ProviderTree for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 16:59:33 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing aggregate associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 16:59:33 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing trait associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, traits: HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 16:59:33 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:59:33 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:59:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 16:59:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.591s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:59:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:59:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-45d2bed8-433f-4249-b1a0-5b8bfe264f8e req-0de23d2f-5a7c-40e7-9e84-e09bc8532e4a service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received event network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:59:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-45d2bed8-433f-4249-b1a0-5b8bfe264f8e req-0de23d2f-5a7c-40e7-9e84-e09bc8532e4a service nova] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:59:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-45d2bed8-433f-4249-b1a0-5b8bfe264f8e req-0de23d2f-5a7c-40e7-9e84-e09bc8532e4a service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:59:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-45d2bed8-433f-4249-b1a0-5b8bfe264f8e req-0de23d2f-5a7c-40e7-9e84-e09bc8532e4a service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:59:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-45d2bed8-433f-4249-b1a0-5b8bfe264f8e req-0de23d2f-5a7c-40e7-9e84-e09bc8532e4a service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] No waiting events found dispatching network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 16:59:34 user nova-compute[73091]: WARNING nova.compute.manager [req-45d2bed8-433f-4249-b1a0-5b8bfe264f8e req-0de23d2f-5a7c-40e7-9e84-e09bc8532e4a service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received unexpected event network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 for instance with vm_state stopped and task_state None.
Aug 09 16:59:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:59:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:59:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 16:59:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:59:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:59:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:59:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 16:59:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:59:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:59:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:59:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:59:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 16:59:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:59:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:59:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 16:59:45 user nova-compute[73091]: INFO nova.compute.claims [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Claim successful on node user
Aug 09 16:59:45 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 16:59:45 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 16:59:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:59:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 16:59:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 16:59:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 16:59:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 16:59:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 16:59:46 user nova-compute[73091]: INFO nova.virt.block_device [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Booting with volume-backed-image bb270def-cd6e-4463-89d8-f4240c9cb724 at /dev/vda
Aug 09 16:59:46 user nova-compute[73091]: DEBUG nova.policy [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b831573c2594072890b548abda013e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39308f2160f14a1cb5ee136458054726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 16:59:47 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691600372.3083878, 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 16:59:47 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] VM Stopped (Lifecycle Event)
Aug 09 16:59:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ada9eb0f-96ac-4631-bbc4-375f366e5b5a None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 16:59:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ada9eb0f-96ac-4631-bbc4-375f366e5b5a None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 16:59:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Successfully created port: ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 16:59:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:59:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Successfully updated port: ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 16:59:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "refresh_cache-86938d92-2044-4f88-b2ea-f2e6711bd2d4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:59:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquired lock "refresh_cache-86938d92-2044-4f88-b2ea-f2e6711bd2d4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:59:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 16:59:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-f56279f9-5b30-414a-a3cb-9a6c5b762264 req-b0bfab32-a856-45cc-bdc8-c03f485ee3f2 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received event network-changed-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 16:59:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-f56279f9-5b30-414a-a3cb-9a6c5b762264 req-b0bfab32-a856-45cc-bdc8-c03f485ee3f2 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Refreshing instance network info cache due to event network-changed-ee82f5a2-a587-4d5a-92b4-0a866e67c041. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 16:59:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f56279f9-5b30-414a-a3cb-9a6c5b762264 req-b0bfab32-a856-45cc-bdc8-c03f485ee3f2 service nova] Acquiring lock "refresh_cache-86938d92-2044-4f88-b2ea-f2e6711bd2d4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 16:59:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 16:59:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Updating instance_info_cache with network_info: [{"id": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "address": "fa:16:3e:a7:60:45", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee82f5a2-a5", "ovs_interfaceid": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:59:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Releasing lock "refresh_cache-86938d92-2044-4f88-b2ea-f2e6711bd2d4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:59:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Instance network_info: |[{"id": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "address": "fa:16:3e:a7:60:45", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee82f5a2-a5", "ovs_interfaceid": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 16:59:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f56279f9-5b30-414a-a3cb-9a6c5b762264 req-b0bfab32-a856-45cc-bdc8-c03f485ee3f2 service nova] Acquired lock "refresh_cache-86938d92-2044-4f88-b2ea-f2e6711bd2d4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 16:59:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-f56279f9-5b30-414a-a3cb-9a6c5b762264 req-b0bfab32-a856-45cc-bdc8-c03f485ee3f2 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Refreshing network info cache for port ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 16:59:49 user nova-compute[73091]: DEBUG nova.network.neutron [req-f56279f9-5b30-414a-a3cb-9a6c5b762264 req-b0bfab32-a856-45cc-bdc8-c03f485ee3f2 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Updated VIF entry in instance network info cache for port ee82f5a2-a587-4d5a-92b4-0a866e67c041. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 16:59:49 user nova-compute[73091]: DEBUG nova.network.neutron [req-f56279f9-5b30-414a-a3cb-9a6c5b762264 req-b0bfab32-a856-45cc-bdc8-c03f485ee3f2 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Updating instance_info_cache with network_info: [{"id": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "address": "fa:16:3e:a7:60:45", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee82f5a2-a5", "ovs_interfaceid": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 16:59:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f56279f9-5b30-414a-a3cb-9a6c5b762264 req-b0bfab32-a856-45cc-bdc8-c03f485ee3f2 service nova] Releasing lock "refresh_cache-86938d92-2044-4f88-b2ea-f2e6711bd2d4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 16:59:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 16:59:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 16:59:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:59:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 16:59:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 16:59:56 user nova-compute[73091]: DEBUG os_brick.utils [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 16:59:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c96212c-e07b-4dd3-af5d-a1e90ada717d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cda2b65-5fde-4560-ab9e-16e0aea99fd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ee4dc0-0842-4773-ae0d-47dc217403e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf62d21-0b58-4e37-87ec-31f0c2184eba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_power_states {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 16:59:57 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2938ec-7af2-4808-bda8-1562ffb9d08b]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG os_brick.utils [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Updating existing volume attachment record: b46e6d51-1ddc-48d3-a909-6898fd0505ab {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 16:59:57 user nova-compute[73091]: WARNING nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] While synchronizing instance power states, found 6 instances in the database and 5 instances on the hypervisor.
Aug 09 16:59:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid c3871ef4-45e7-4118-8227-e48cc857d481 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid 76055017-05ff-4ea7-ae9c-66d2e502e090 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid be5d7299-6eb0-4ba4-a2a3-f4c513168d68 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid 7b305674-a656-44f5-9d67-cf927acf62f8 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid 86938d92-2044-4f88-b2ea-f2e6711bd2d4 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "c3871ef4-45e7-4118-8227-e48cc857d481" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "c3871ef4-45e7-4118-8227-e48cc857d481" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "76055017-05ff-4ea7-ae9c-66d2e502e090" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "7b305674-a656-44f5-9d67-cf927acf62f8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "7b305674-a656-44f5-9d67-cf927acf62f8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "c3871ef4-45e7-4118-8227-e48cc857d481" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "7b305674-a656-44f5-9d67-cf927acf62f8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:59:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 16:59:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:00:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:00:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:00:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:00:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:00:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 17:00:05 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Creating image(s)
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Ensure instance console log exists: /opt/stack/data/nova/instances/86938d92-2044-4f88-b2ea-f2e6711bd2d4/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Start _get_guest_xml network_info=[{"id": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "address": "fa:16:3e:a7:60:45", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee82f5a2-a5", "ovs_interfaceid": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'b46e6d51-1ddc-48d3-a909-6898fd0505ab', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpUmOrHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '86938d92-2044-4f88-b2ea-f2e6711bd2d4', 'attached_at': '', 'detached_at': '', 'volume_id': '486b2bbd-c3aa-4b52-aab7-15933bf1a35e', 'serial': '486b2bbd-c3aa-4b52-aab7-15933bf1a35e'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 17:00:05 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:00:05 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpUmOrHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:00:05 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:00:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:00:05 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:00:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:00:05 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4bb7f8-fd88-4927-9f7a-3d13c7f7929b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 17:00:05 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c033b0-586a-4288-8f77-410a75927118]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e] added
Aug 09 17:00:05 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa90d601-c165-482d-b646-134e486c66ef]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4449b0c1-b4ce-4ce2-8951-9c73a1975584]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PpUmOrHL {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PpUmOrHL" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7979eb6-b37a-4f40-9f61-1102651e6627]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PpUmOrHL'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deeb27c-88e5-4d4a-81bd-677871ede3fb]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[459dbe6d-f1b3-4c40-bcd6-5225ac615db0]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:00:05 user nova-compute[73091]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)
Aug 09 17:00:05 user nova-compute[73091]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)
Aug 09 17:00:05 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:00:05 user nova-compute[73091]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)
Aug 09 17:00:05 user nova-compute[73091]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)
Aug 09 17:00:05 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6552705c-b58a-4c42-9ea5-6da5bcb198cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e, portal: 172.16.0.220,3260]
Aug 09 17:00:05 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e, portal: 172.16.0.220,3260] successful.
Aug 09 17:00:05 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:00:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff762894-04bd-4c8e-99c7-b6223ea3558c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:00:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:00:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a331b33-5cb3-4750-9d60-d328911f243e]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:00:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:00:06 user nova-compute[73091]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)
Aug 09 17:00:06 user nova-compute[73091]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)
Aug 09 17:00:06 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:00:06 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:00:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:00:06 user nova-compute[73091]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)
Aug 09 17:00:06 user nova-compute[73091]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)
Aug 09 17:00:06 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:00:06 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:00:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:00:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 17:00:06 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] HCTL ('36', '-', '-', 0) found on session 54 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 17:00:06 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 17:00:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baa47cd-77eb-4f56-aa07-03ed6ddd1b1b]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:00:06 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Searching for a device in session 54 and hctl ['36', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Searching for a device in session 54 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpUmOrHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23639326339616131', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639326339616131', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:59:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1077072569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1077072569',id=48,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39308f2160f14a1cb5ee136458054726',ramdisk_id='',reservation_id='r-0q48u3yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:59:46Z,user_data=None,user_id='1b831573c2594072890b548abda013e3',uuid=86938d92-2044-4f88-b2ea-f2e6711bd2d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "address": "fa:16:3e:a7:60:45", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee82f5a2-a5", "ovs_interfaceid": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converting VIF {"id": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "address": "fa:16:3e:a7:60:45", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee82f5a2-a5", "ovs_interfaceid": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:60:45,bridge_name='br-int',has_traffic_filtering=True,id=ee82f5a2-a587-4d5a-92b4-0a866e67c041,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee82f5a2-a5') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'pci_devices' on Instance uuid 86938d92-2044-4f88-b2ea-f2e6711bd2d4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] End _get_guest_xml xml=<domain type="kvm">
Aug 09 17:00:07 user nova-compute[73091]:   <uuid>86938d92-2044-4f88-b2ea-f2e6711bd2d4</uuid>
Aug 09 17:00:07 user nova-compute[73091]:   <name>instance-00000030</name>
Aug 09 17:00:07 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 17:00:07 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 17:00:07 user nova-compute[73091]:   <metadata>
Aug 09 17:00:07 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 17:00:07 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 17:00:07 user nova-compute[73091]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1077072569</nova:name>
Aug 09 17:00:07 user nova-compute[73091]:       <nova:creationTime>2023-08-09 17:00:05</nova:creationTime>
Aug 09 17:00:07 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 17:00:07 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 17:00:07 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 17:00:07 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 17:00:07 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 17:00:07 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 17:00:07 user nova-compute[73091]:       </nova:flavor>
Aug 09 17:00:07 user nova-compute[73091]:       <nova:owner>
Aug 09 17:00:07 user nova-compute[73091]:         <nova:user uuid="1b831573c2594072890b548abda013e3">tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member</nova:user>
Aug 09 17:00:07 user nova-compute[73091]:         <nova:project uuid="39308f2160f14a1cb5ee136458054726">tempest-ServerBootFromVolumeStableRescueTest-1999746022</nova:project>
Aug 09 17:00:07 user nova-compute[73091]:       </nova:owner>
Aug 09 17:00:07 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 17:00:07 user nova-compute[73091]:       <nova:ports>
Aug 09 17:00:07 user nova-compute[73091]:         <nova:port uuid="ee82f5a2-a587-4d5a-92b4-0a866e67c041">
Aug 09 17:00:07 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 17:00:07 user nova-compute[73091]:         </nova:port>
Aug 09 17:00:07 user nova-compute[73091]:       </nova:ports>
Aug 09 17:00:07 user nova-compute[73091]:     </nova:instance>
Aug 09 17:00:07 user nova-compute[73091]:   </metadata>
Aug 09 17:00:07 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 17:00:07 user nova-compute[73091]:     <system>
Aug 09 17:00:07 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 17:00:07 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 17:00:07 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 17:00:07 user nova-compute[73091]:       <entry name="serial">86938d92-2044-4f88-b2ea-f2e6711bd2d4</entry>
Aug 09 17:00:07 user nova-compute[73091]:       <entry name="uuid">86938d92-2044-4f88-b2ea-f2e6711bd2d4</entry>
Aug 09 17:00:07 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 17:00:07 user nova-compute[73091]:     </system>
Aug 09 17:00:07 user nova-compute[73091]:   </sysinfo>
Aug 09 17:00:07 user nova-compute[73091]:   <os>
Aug 09 17:00:07 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 17:00:07 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 17:00:07 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 17:00:07 user nova-compute[73091]:   </os>
Aug 09 17:00:07 user nova-compute[73091]:   <features>
Aug 09 17:00:07 user nova-compute[73091]:     <acpi/>
Aug 09 17:00:07 user nova-compute[73091]:     <apic/>
Aug 09 17:00:07 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 17:00:07 user nova-compute[73091]:   </features>
Aug 09 17:00:07 user nova-compute[73091]:   <clock offset="utc">
Aug 09 17:00:07 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 17:00:07 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 17:00:07 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 17:00:07 user nova-compute[73091]:   </clock>
Aug 09 17:00:07 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 17:00:07 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 17:00:07 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 17:00:07 user nova-compute[73091]:   </cpu>
Aug 09 17:00:07 user nova-compute[73091]:   <devices>
Aug 09 17:00:07 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 17:00:07 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:00:07 user nova-compute[73091]:       <source dev="/dev/sde"/>
Aug 09 17:00:07 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 17:00:07 user nova-compute[73091]:       <serial>486b2bbd-c3aa-4b52-aab7-15933bf1a35e</serial>
Aug 09 17:00:07 user nova-compute[73091]:     </disk>
Aug 09 17:00:07 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 17:00:07 user nova-compute[73091]:       <mac address="fa:16:3e:a7:60:45"/>
Aug 09 17:00:07 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 17:00:07 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 17:00:07 user nova-compute[73091]:       <target dev="tapee82f5a2-a5"/>
Aug 09 17:00:07 user nova-compute[73091]:     </interface>
Aug 09 17:00:07 user nova-compute[73091]:     <serial type="pty">
Aug 09 17:00:07 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/86938d92-2044-4f88-b2ea-f2e6711bd2d4/console.log" append="off"/>
Aug 09 17:00:07 user nova-compute[73091]:     </serial>
Aug 09 17:00:07 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 17:00:07 user nova-compute[73091]:     <video>
Aug 09 17:00:07 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 17:00:07 user nova-compute[73091]:     </video>
Aug 09 17:00:07 user nova-compute[73091]:     <rng model="virtio">
Aug 09 17:00:07 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 17:00:07 user nova-compute[73091]:     </rng>
Aug 09 17:00:07 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 17:00:07 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 17:00:07 user nova-compute[73091]:       <stats period="10"/>
Aug 09 17:00:07 user nova-compute[73091]:     </memballoon>
Aug 09 17:00:07 user nova-compute[73091]:   </devices>
Aug 09 17:00:07 user nova-compute[73091]: </domain>
Aug 09 17:00:07 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:59:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1077072569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1077072569',id=48,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39308f2160f14a1cb5ee136458054726',ramdisk_id='',reservation_id='r-0q48u3yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:59:46Z,user_data=None,user_id='1b831573c2594072890b548abda013e3',uuid=86938d92-2044-4f88-b2ea-f2e6711bd2d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "address": "fa:16:3e:a7:60:45", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee82f5a2-a5", "ovs_interfaceid": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converting VIF {"id": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "address": "fa:16:3e:a7:60:45", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee82f5a2-a5", "ovs_interfaceid": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:60:45,bridge_name='br-int',has_traffic_filtering=True,id=ee82f5a2-a587-4d5a-92b4-0a866e67c041,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee82f5a2-a5') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG os_vif [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:60:45,bridge_name='br-int',has_traffic_filtering=True,id=ee82f5a2-a587-4d5a-92b4-0a866e67c041,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee82f5a2-a5') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee82f5a2-a5, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee82f5a2-a5, col_values=(('external_ids', {'iface-id': 'ee82f5a2-a587-4d5a-92b4-0a866e67c041', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:60:45', 'vm-uuid': '86938d92-2044-4f88-b2ea-f2e6711bd2d4'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:07 user nova-compute[73091]: INFO os_vif [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:60:45,bridge_name='br-int',has_traffic_filtering=True,id=ee82f5a2-a587-4d5a-92b4-0a866e67c041,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee82f5a2-a5')
Aug 09 17:00:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:00:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] No VIF found with MAC fa:16:3e:a7:60:45, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 17:00:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-c2bb9814-c962-446c-90fd-672e4175430b req-49e0631d-d4ff-459d-9ac8-47a0cad7133f service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:00:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c2bb9814-c962-446c-90fd-672e4175430b req-49e0631d-d4ff-459d-9ac8-47a0cad7133f service nova] Acquiring lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:00:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c2bb9814-c962-446c-90fd-672e4175430b req-49e0631d-d4ff-459d-9ac8-47a0cad7133f service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:00:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c2bb9814-c962-446c-90fd-672e4175430b req-49e0631d-d4ff-459d-9ac8-47a0cad7133f service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:00:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-c2bb9814-c962-446c-90fd-672e4175430b req-49e0631d-d4ff-459d-9ac8-47a0cad7133f service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] No waiting events found dispatching network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:00:08 user nova-compute[73091]: WARNING nova.compute.manager [req-c2bb9814-c962-446c-90fd-672e4175430b req-49e0631d-d4ff-459d-9ac8-47a0cad7133f service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received unexpected event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 for instance with vm_state building and task_state spawning.
Aug 09 17:00:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:10 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600410.5463476, 86938d92-2044-4f88-b2ea-f2e6711bd2d4 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:00:10 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] VM Resumed (Lifecycle Event)
Aug 09 17:00:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 17:00:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 17:00:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Instance spawned successfully.
Aug 09 17:00:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 17:00:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:00:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:00:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:00:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:00:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:00:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:00:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:00:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:00:10 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 17:00:10 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600410.550334, 86938d92-2044-4f88-b2ea-f2e6711bd2d4 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:00:10 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] VM Started (Lifecycle Event)
Aug 09 17:00:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:00:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:00:10 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 17:00:10 user nova-compute[73091]: INFO nova.compute.manager [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Took 4.96 seconds to spawn the instance on the hypervisor.
Aug 09 17:00:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:00:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-aeebbce4-8cf3-4070-abf4-c235705ad80a req-9e0e9707-0c16-4f88-a8ee-5a4d452d5d34 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:00:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-aeebbce4-8cf3-4070-abf4-c235705ad80a req-9e0e9707-0c16-4f88-a8ee-5a4d452d5d34 service nova] Acquiring lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:00:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-aeebbce4-8cf3-4070-abf4-c235705ad80a req-9e0e9707-0c16-4f88-a8ee-5a4d452d5d34 service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:00:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-aeebbce4-8cf3-4070-abf4-c235705ad80a req-9e0e9707-0c16-4f88-a8ee-5a4d452d5d34 service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:00:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-aeebbce4-8cf3-4070-abf4-c235705ad80a req-9e0e9707-0c16-4f88-a8ee-5a4d452d5d34 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] No waiting events found dispatching network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:00:10 user nova-compute[73091]: WARNING nova.compute.manager [req-aeebbce4-8cf3-4070-abf4-c235705ad80a req-9e0e9707-0c16-4f88-a8ee-5a4d452d5d34 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received unexpected event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 for instance with vm_state building and task_state spawning.
Aug 09 17:00:10 user nova-compute[73091]: INFO nova.compute.manager [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Took 25.34 seconds to build instance.
Aug 09 17:00:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1f1a774e-ca06-4a0e-bdec-1e6445369d26 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.452s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:00:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 13.781s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:00:10 user nova-compute[73091]: INFO nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 09 17:00:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:00:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:00:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:00:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:00:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:00:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:00:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:00:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:00:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:00:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:00:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:00:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Updating instance_info_cache with network_info: [{"id": "58bf6094-42a8-4567-abea-27c63a57cf8a", "address": "fa:16:3e:f3:dd:72", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf6094-42", "ovs_interfaceid": "58bf6094-42a8-4567-abea-27c63a57cf8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:00:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:00:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:00:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:00:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:00:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:00:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:00:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:00:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:00:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:00:31 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:00:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 17:00:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 17:00:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 17:00:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 17:00:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:33 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:00:33 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:00:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8279MB free_disk=25.001174926757812GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:00:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:00:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:00:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c3871ef4-45e7-4118-8227-e48cc857d481 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:00:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 76055017-05ff-4ea7-ae9c-66d2e502e090 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:00:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance be5d7299-6eb0-4ba4-a2a3-f4c513168d68 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:00:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:00:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 7b305674-a656-44f5-9d67-cf927acf62f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:00:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 86938d92-2044-4f88-b2ea-f2e6711bd2d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:00:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:00:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:00:33 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:00:33 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:00:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:00:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:00:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-83e9bc7e-f13a-4bd3-9ad5-a46ebbc7cce9 req-dea7cb20-93a7-4130-a9a6-5c5adaf98dd1 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received event network-changed-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:00:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-83e9bc7e-f13a-4bd3-9ad5-a46ebbc7cce9 req-dea7cb20-93a7-4130-a9a6-5c5adaf98dd1 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Refreshing instance network info cache due to event network-changed-969bce7a-0683-42cd-bae1-12ae87f2cf3b. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 17:00:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-83e9bc7e-f13a-4bd3-9ad5-a46ebbc7cce9 req-dea7cb20-93a7-4130-a9a6-5c5adaf98dd1 service nova] Acquiring lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:00:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-83e9bc7e-f13a-4bd3-9ad5-a46ebbc7cce9 req-dea7cb20-93a7-4130-a9a6-5c5adaf98dd1 service nova] Acquired lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:00:35 user nova-compute[73091]: DEBUG nova.network.neutron [req-83e9bc7e-f13a-4bd3-9ad5-a46ebbc7cce9 req-dea7cb20-93a7-4130-a9a6-5c5adaf98dd1 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Refreshing network info cache for port 969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 17:00:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:35 user nova-compute[73091]: DEBUG nova.network.neutron [req-83e9bc7e-f13a-4bd3-9ad5-a46ebbc7cce9 req-dea7cb20-93a7-4130-a9a6-5c5adaf98dd1 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Updated VIF entry in instance network info cache for port 969bce7a-0683-42cd-bae1-12ae87f2cf3b. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 17:00:35 user nova-compute[73091]: DEBUG nova.network.neutron [req-83e9bc7e-f13a-4bd3-9ad5-a46ebbc7cce9 req-dea7cb20-93a7-4130-a9a6-5c5adaf98dd1 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Updating instance_info_cache with network_info: [{"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:00:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-83e9bc7e-f13a-4bd3-9ad5-a46ebbc7cce9 req-dea7cb20-93a7-4130-a9a6-5c5adaf98dd1 service nova] Releasing lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:00:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:00:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquiring lock "7b305674-a656-44f5-9d67-cf927acf62f8" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:00:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "7b305674-a656-44f5-9d67-cf927acf62f8" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:00:36 user nova-compute[73091]: INFO nova.compute.manager [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Shelve offloading
Aug 09 17:00:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-ccac4485-edac-4e2f-b639-82b808a7dfb7 req-466baa4d-43f0-4985-9897-80496ffcbeda service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received event network-vif-unplugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:00:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ccac4485-edac-4e2f-b639-82b808a7dfb7 req-466baa4d-43f0-4985-9897-80496ffcbeda service nova] Acquiring lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:00:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ccac4485-edac-4e2f-b639-82b808a7dfb7 req-466baa4d-43f0-4985-9897-80496ffcbeda service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:00:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ccac4485-edac-4e2f-b639-82b808a7dfb7 req-466baa4d-43f0-4985-9897-80496ffcbeda service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:00:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-ccac4485-edac-4e2f-b639-82b808a7dfb7 req-466baa4d-43f0-4985-9897-80496ffcbeda service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] No waiting events found dispatching network-vif-unplugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:00:36 user nova-compute[73091]: WARNING nova.compute.manager [req-ccac4485-edac-4e2f-b639-82b808a7dfb7 req-466baa4d-43f0-4985-9897-80496ffcbeda service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received unexpected event network-vif-unplugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b for instance with vm_state active and task_state shelving.
Aug 09 17:00:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:37 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Instance destroyed successfully.
Aug 09 17:00:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:00:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquiring lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:00:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquired lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:00:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 17:00:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Updating instance_info_cache with network_info: [{"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:00:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Releasing lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:00:38 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Instance destroyed successfully.
Aug 09 17:00:38 user nova-compute[73091]: DEBUG nova.objects.instance [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lazy-loading 'resources' on Instance uuid 7b305674-a656-44f5-9d67-cf927acf62f8 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1712628175',display_name='tempest-TestShelveInstance-server-1712628175',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1712628175',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOW9jV/hfeCpzsdHs7XFFab0aEiC4shK8n6mgWb67Xb6Nt74n6LbvjQ/6+PuuON3YH7tiHMWI9JqXUl0nbKyfsqdZj68N9HhRnUC/2LcKon0+DH15Pk3wLXB52HK/NZ4Q==',key_name='tempest-TestShelveInstance-622552020',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:58:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05969405da7a47968fe16aabc3724131',ramdisk_id='',reservation_id='r-ctyu5xzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2078233597',owner_user_name='tempest-TestShelveInstance-2078233597-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:58:57Z,user_data=None,user_id='00eda119bf8041d59b4cf94b02b4b1a0',uuid=7b305674-a656-44f5-9d67-cf927acf62f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Converting VIF {"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=969bce7a-0683-42cd-bae1-12ae87f2cf3b,network=Network(d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bce7a-06') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG os_vif [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=969bce7a-0683-42cd-bae1-12ae87f2cf3b,network=Network(d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bce7a-06') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap969bce7a-06, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-4a52ffce-47a4-4882-a7ce-1f2e60a9b2bc req-e8aa1415-4ef0-42f3-b4e1-4e79312d9330 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received event network-changed-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-4a52ffce-47a4-4882-a7ce-1f2e60a9b2bc req-e8aa1415-4ef0-42f3-b4e1-4e79312d9330 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Refreshing instance network info cache due to event network-changed-969bce7a-0683-42cd-bae1-12ae87f2cf3b. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4a52ffce-47a4-4882-a7ce-1f2e60a9b2bc req-e8aa1415-4ef0-42f3-b4e1-4e79312d9330 service nova] Acquiring lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4a52ffce-47a4-4882-a7ce-1f2e60a9b2bc req-e8aa1415-4ef0-42f3-b4e1-4e79312d9330 service nova] Acquired lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG nova.network.neutron [req-4a52ffce-47a4-4882-a7ce-1f2e60a9b2bc req-e8aa1415-4ef0-42f3-b4e1-4e79312d9330 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Refreshing network info cache for port 969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:38 user nova-compute[73091]: INFO os_vif [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=969bce7a-0683-42cd-bae1-12ae87f2cf3b,network=Network(d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bce7a-06')
Aug 09 17:00:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byzNJqnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:00:38 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:00:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[832446b2-3def-47e0-a234-2151617f934a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9827c985-0540-4591-93d9-d9cc64d496b1]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:00:38 user nova-compute[73091]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)
Aug 09 17:00:38 user nova-compute[73091]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)
Aug 09 17:00:38 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:00:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:00:38 user nova-compute[73091]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)
Aug 09 17:00:38 user nova-compute[73091]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)
Aug 09 17:00:38 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:00:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0602017e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9288b64-1268-4d6c-9977-cc3a1729d1d3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-da33239a-b738-4e79-92cc-fd616a88dc83 req-78d9f58d-cdf7-4800-bea7-49b4e9591bf3 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received event network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da33239a-b738-4e79-92cc-fd616a88dc83 req-78d9f58d-cdf7-4800-bea7-49b4e9591bf3 service nova] Acquiring lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da33239a-b738-4e79-92cc-fd616a88dc83 req-78d9f58d-cdf7-4800-bea7-49b4e9591bf3 service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da33239a-b738-4e79-92cc-fd616a88dc83 req-78d9f58d-cdf7-4800-bea7-49b4e9591bf3 service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-da33239a-b738-4e79-92cc-fd616a88dc83 req-78d9f58d-cdf7-4800-bea7-49b4e9591bf3 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] No waiting events found dispatching network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:00:38 user nova-compute[73091]: WARNING nova.compute.manager [req-da33239a-b738-4e79-92cc-fd616a88dc83 req-78d9f58d-cdf7-4800-bea7-49b4e9591bf3 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received unexpected event network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b for instance with vm_state active and task_state shelving.
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8a9465-e0c3-462c-907e-e733b5ff50d3]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccfac86-d8cd-4782-a727-c7a2b4ef12ac]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 17:00:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba56fe7-92bf-439e-bc60-2c497e73e815]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[84953eda-cbab-4a1f-8062-24fbdd6617fc]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd33df90-be97-4296-a39c-b0e488bc1fb2]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2, portal: 172.16.0.220,3260]
Aug 09 17:00:39 user nova-compute[73091]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2, portal: 172.16.0.220,3260] successful.
Aug 09 17:00:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b089b44e-2bf0-446b-b4e9-e6e5c05704c6]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] <== disconnect_volume: return (312ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 17:00:39 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Deleting instance files /opt/stack/data/nova/instances/7b305674-a656-44f5-9d67-cf927acf62f8_del
Aug 09 17:00:39 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Deletion of /opt/stack/data/nova/instances/7b305674-a656-44f5-9d67-cf927acf62f8_del complete
Aug 09 17:00:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-4a52ffce-47a4-4882-a7ce-1f2e60a9b2bc req-e8aa1415-4ef0-42f3-b4e1-4e79312d9330 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Updated VIF entry in instance network info cache for port 969bce7a-0683-42cd-bae1-12ae87f2cf3b. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-4a52ffce-47a4-4882-a7ce-1f2e60a9b2bc req-e8aa1415-4ef0-42f3-b4e1-4e79312d9330 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Updating instance_info_cache with network_info: [{"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": null, "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap969bce7a-06", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:00:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4a52ffce-47a4-4882-a7ce-1f2e60a9b2bc req-e8aa1415-4ef0-42f3-b4e1-4e79312d9330 service nova] Releasing lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:00:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:40 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Deleted allocations for instance 7b305674-a656-44f5-9d67-cf927acf62f8
Aug 09 17:00:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:00:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:00:40 user nova-compute[73091]: DEBUG nova.objects.instance [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lazy-loading 'numa_topology' on Instance uuid 7b305674-a656-44f5-9d67-cf927acf62f8 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:00:40 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:00:40 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:00:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:00:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16d7969f-798e-42fd-81b4-ae7b893d966d tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "7b305674-a656-44f5-9d67-cf927acf62f8" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.389s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:00:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:52 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691600437.3039782, 7b305674-a656-44f5-9d67-cf927acf62f8 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:00:52 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] VM Stopped (Lifecycle Event)
Aug 09 17:00:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d50d7ad7-3347-440a-90c5-6b34fc207508 None None] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:00:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:00:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:00:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:00:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:00:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:00:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:00:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:01:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:01:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:01:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:01:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:01:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:01:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:01:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:01:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:01:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:01:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:01:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:01:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:01:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:01:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'flavor' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquired lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'info_cache' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Updating instance_info_cache with network_info: [{"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Releasing lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:01:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Instance destroyed successfully.
Aug 09 17:01:22 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'resources' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1683471410',display_name='tempest-AttachVolumeTestJSON-server-1683471410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1683471410',id=46,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSqU7018x0ZKxU/TnR68mmpQfJ3/iIdN4gO2b9qKuQMylnJbXqCJVU8sCvfuom/2tN1tKX2DuUHbuYDqL1PZuoNGYX3mudz2G438ekxd/krtTvJFcZJCDSXUYHm9JgRDQ==',key_name='tempest-keypair-1988166130',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:57:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0cfa5b9d92df40d6bdfef6e8dfd3fad8',ramdisk_id='',reservation_id='r-nye9wi1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-99081524',owner_user_name='tempest-AttachVolumeTestJSON-99081524-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e945ea4724446e5a6ee92a6b4d24ff0',uuid=980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converting VIF {"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG os_vif [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c3038f5-c9, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:01:22 user nova-compute[73091]: INFO os_vif [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9')
Aug 09 17:01:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmydhAsH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:01:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:01:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a39e66-1a6f-4dd7-9dae-69d5139a3c5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1721fc3c-ec06-43e0-aa02-3993cf71fcad]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:01:22 user nova-compute[73091]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)
Aug 09 17:01:22 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:01:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:01:22 user nova-compute[73091]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)
Aug 09 17:01:22 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:01:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0602029e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a2a4cd-740e-43e9-a106-c9f0286fecbe]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27fa428-b727-4f9e-a7bf-7cd948772fd8]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b7f30b-7e5e-420a-b12a-3d4ec50f71d8]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3285e4-bf47-4866-a120-bc518f2c3fca]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04f6938-0755-480c-867b-0a0611e3b588]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:01:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bed39d-dde7-445a-8a25-68592dc3aefd]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33, portal: 172.16.0.220,3260]
Aug 09 17:01:23 user nova-compute[73091]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33, portal: 172.16.0.220,3260] successful.
Aug 09 17:01:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cf79ec-150a-4bb6-8974-c2577615f84c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] <== disconnect_volume: return (272ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Start _get_guest_xml network_info=[{"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '347bb209-0f74-489c-8bf1-2ec4ab532e77', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmydhAsH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2', 'attached_at': '', 'detached_at': '', 'volume_id': '692152b7-2423-44c0-9adc-8a8066652c33', 'serial': '692152b7-2423-44c0-9adc-8a8066652c33'}, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'numa_topology' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:01:23 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:01:23 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'vcpu_model' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmydhAsH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:01:23 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:01:23 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:01:23 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d96233-aa8e-4cf3-9ffd-8fe36640aca9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 17:01:23 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd77cadd-7359-456c-a383-55914d78b2dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33] added
Aug 09 17:01:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab03083-746b-4355-aa16-a0e5f571377d]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a906fd00-bac3-448d-8f5d-4c23a67c3685]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cmydhAsH {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cmydhAsH" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[289bca68-9346-4783-9952-e9cb08228ab7]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cmydhAsH'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0d9703-d5de-475a-8372-13d0632e15f2]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[461ec383-faa8-4f13-b8c6-a8a1c778a7f7]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:01:23 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:01:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:01:23 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:01:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22f0af6-93ce-4e13-848b-dcb9eed788d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33, portal: 172.16.0.220,3260]
Aug 09 17:01:23 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33, portal: 172.16.0.220,3260] successful.
Aug 09 17:01:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d0518e-9507-4996-be9a-d51609c0e866]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6c3e15-63c3-42b2-b8ce-e5a251f018f9]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:01:23 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:01:23 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)
Aug 09 17:01:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:01:23 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:01:23 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)
Aug 09 17:01:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e771ded-25f9-458f-842c-50de8fbba63c]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:01:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmydhAsH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 17:01:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:01:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23131353461663539', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:01:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131353461663539', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 17:01:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1683471410',display_name='tempest-AttachVolumeTestJSON-server-1683471410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1683471410',id=46,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSqU7018x0ZKxU/TnR68mmpQfJ3/iIdN4gO2b9qKuQMylnJbXqCJVU8sCvfuom/2tN1tKX2DuUHbuYDqL1PZuoNGYX3mudz2G438ekxd/krtTvJFcZJCDSXUYHm9JgRDQ==',key_name='tempest-keypair-1988166130',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:57:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0cfa5b9d92df40d6bdfef6e8dfd3fad8',ramdisk_id='',reservation_id='r-nye9wi1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-99081524',owner_user_name='tempest-AttachVolumeTestJSON-99081524-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e945ea4724446e5a6ee92a6b4d24ff0',uuid=980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 17:01:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converting VIF {"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:01:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:01:24 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'pci_devices' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:01:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] End _get_guest_xml xml=<domain type="kvm">
Aug 09 17:01:24 user nova-compute[73091]:   <uuid>980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2</uuid>
Aug 09 17:01:24 user nova-compute[73091]:   <name>instance-0000002e</name>
Aug 09 17:01:24 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 17:01:24 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 17:01:24 user nova-compute[73091]:   <metadata>
Aug 09 17:01:24 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 17:01:24 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 17:01:24 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeTestJSON-server-1683471410</nova:name>
Aug 09 17:01:24 user nova-compute[73091]:       <nova:creationTime>2023-08-09 17:01:23</nova:creationTime>
Aug 09 17:01:24 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 17:01:24 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 17:01:24 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 17:01:24 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 17:01:24 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 17:01:24 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 17:01:24 user nova-compute[73091]:       </nova:flavor>
Aug 09 17:01:24 user nova-compute[73091]:       <nova:owner>
Aug 09 17:01:24 user nova-compute[73091]:         <nova:user uuid="2e945ea4724446e5a6ee92a6b4d24ff0">tempest-AttachVolumeTestJSON-99081524-project-member</nova:user>
Aug 09 17:01:24 user nova-compute[73091]:         <nova:project uuid="0cfa5b9d92df40d6bdfef6e8dfd3fad8">tempest-AttachVolumeTestJSON-99081524</nova:project>
Aug 09 17:01:24 user nova-compute[73091]:       </nova:owner>
Aug 09 17:01:24 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 17:01:24 user nova-compute[73091]:       <nova:ports>
Aug 09 17:01:24 user nova-compute[73091]:         <nova:port uuid="8c3038f5-c9cf-44e0-a2d5-5dee6e719d90">
Aug 09 17:01:24 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 17:01:24 user nova-compute[73091]:         </nova:port>
Aug 09 17:01:24 user nova-compute[73091]:       </nova:ports>
Aug 09 17:01:24 user nova-compute[73091]:     </nova:instance>
Aug 09 17:01:24 user nova-compute[73091]:   </metadata>
Aug 09 17:01:24 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 17:01:24 user nova-compute[73091]:     <system>
Aug 09 17:01:24 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 17:01:24 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 17:01:24 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 17:01:24 user nova-compute[73091]:       <entry name="serial">980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2</entry>
Aug 09 17:01:24 user nova-compute[73091]:       <entry name="uuid">980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2</entry>
Aug 09 17:01:24 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 17:01:24 user nova-compute[73091]:     </system>
Aug 09 17:01:24 user nova-compute[73091]:   </sysinfo>
Aug 09 17:01:24 user nova-compute[73091]:   <os>
Aug 09 17:01:24 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 17:01:24 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 17:01:24 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 17:01:24 user nova-compute[73091]:   </os>
Aug 09 17:01:24 user nova-compute[73091]:   <features>
Aug 09 17:01:24 user nova-compute[73091]:     <acpi/>
Aug 09 17:01:24 user nova-compute[73091]:     <apic/>
Aug 09 17:01:24 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 17:01:24 user nova-compute[73091]:   </features>
Aug 09 17:01:24 user nova-compute[73091]:   <clock offset="utc">
Aug 09 17:01:24 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 17:01:24 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 17:01:24 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 17:01:24 user nova-compute[73091]:   </clock>
Aug 09 17:01:24 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 17:01:24 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 17:01:24 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 17:01:24 user nova-compute[73091]:   </cpu>
Aug 09 17:01:24 user nova-compute[73091]:   <devices>
Aug 09 17:01:24 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 17:01:24 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 17:01:24 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk"/>
Aug 09 17:01:24 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 17:01:24 user nova-compute[73091]:     </disk>
Aug 09 17:01:24 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 17:01:24 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:01:24 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 09 17:01:24 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 09 17:01:24 user nova-compute[73091]:       <serial>692152b7-2423-44c0-9adc-8a8066652c33</serial>
Aug 09 17:01:24 user nova-compute[73091]:     </disk>
Aug 09 17:01:24 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 17:01:24 user nova-compute[73091]:       <mac address="fa:16:3e:47:35:8e"/>
Aug 09 17:01:24 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 17:01:24 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 17:01:24 user nova-compute[73091]:       <target dev="tap8c3038f5-c9"/>
Aug 09 17:01:24 user nova-compute[73091]:     </interface>
Aug 09 17:01:24 user nova-compute[73091]:     <serial type="pty">
Aug 09 17:01:24 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/console.log" append="off"/>
Aug 09 17:01:24 user nova-compute[73091]:     </serial>
Aug 09 17:01:24 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 17:01:24 user nova-compute[73091]:     <video>
Aug 09 17:01:24 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 17:01:24 user nova-compute[73091]:     </video>
Aug 09 17:01:24 user nova-compute[73091]:     <rng model="virtio">
Aug 09 17:01:24 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 17:01:24 user nova-compute[73091]:     </rng>
Aug 09 17:01:24 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 17:01:24 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 17:01:24 user nova-compute[73091]:       <stats period="10"/>
Aug 09 17:01:24 user nova-compute[73091]:     </memballoon>
Aug 09 17:01:24 user nova-compute[73091]:   </devices>
Aug 09 17:01:24 user nova-compute[73091]: </domain>
Aug 09 17:01:24 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 17:01:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 17:01:24 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'trusted_certs' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:01:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.135s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:24 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Checking if we can resize image /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 17:01:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:25 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Cannot resize image /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 17:01:25 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'migration_context' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:01:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1683471410',display_name='tempest-AttachVolumeTestJSON-server-1683471410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1683471410',id=46,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSqU7018x0ZKxU/TnR68mmpQfJ3/iIdN4gO2b9qKuQMylnJbXqCJVU8sCvfuom/2tN1tKX2DuUHbuYDqL1PZuoNGYX3mudz2G438ekxd/krtTvJFcZJCDSXUYHm9JgRDQ==',key_name='tempest-keypair-1988166130',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:57:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0cfa5b9d92df40d6bdfef6e8dfd3fad8',ramdisk_id='',reservation_id='r-nye9wi1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-99081524',owner_user_name='tempest-AttachVolumeTestJSON-99081524-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T16:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e945ea4724446e5a6ee92a6b4d24ff0',uuid=980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 17:01:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converting VIF {"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:01:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:01:25 user nova-compute[73091]: DEBUG os_vif [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 17:01:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:01:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 17:01:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c3038f5-c9, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:01:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c3038f5-c9, col_values=(('external_ids', {'iface-id': '8c3038f5-c9cf-44e0-a2d5-5dee6e719d90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:35:8e', 'vm-uuid': '980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:01:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:01:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:25 user nova-compute[73091]: INFO os_vif [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9')
Aug 09 17:01:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-30444775-e490-4f8a-afeb-9af4237db1d5 req-073e9278-a561-4f2f-9060-e42424025e2f service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received event network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:01:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-30444775-e490-4f8a-afeb-9af4237db1d5 req-073e9278-a561-4f2f-9060-e42424025e2f service nova] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:01:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-30444775-e490-4f8a-afeb-9af4237db1d5 req-073e9278-a561-4f2f-9060-e42424025e2f service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:01:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-30444775-e490-4f8a-afeb-9af4237db1d5 req-073e9278-a561-4f2f-9060-e42424025e2f service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:01:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-30444775-e490-4f8a-afeb-9af4237db1d5 req-073e9278-a561-4f2f-9060-e42424025e2f service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] No waiting events found dispatching network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:01:26 user nova-compute[73091]: WARNING nova.compute.manager [req-30444775-e490-4f8a-afeb-9af4237db1d5 req-073e9278-a561-4f2f-9060-e42424025e2f service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received unexpected event network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 for instance with vm_state stopped and task_state powering-on.
Aug 09 17:01:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:01:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:01:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-be5d7299-6eb0-4ba4-a2a3-f4c513168d68" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:01:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-be5d7299-6eb0-4ba4-a2a3-f4c513168d68" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:01:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:01:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:28 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Updating instance_info_cache with network_info: [{"id": "e1b7f229-903b-4665-bc7c-04cb578e7140", "address": "fa:16:3e:08:85:51", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b7f229-90", "ovs_interfaceid": "e1b7f229-903b-4665-bc7c-04cb578e7140", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:01:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-be5d7299-6eb0-4ba4-a2a3-f4c513168d68" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:01:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:01:28 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600488.5208895, 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:01:28 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] VM Resumed (Lifecycle Event)
Aug 09 17:01:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 17:01:28 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Instance rebooted successfully.
Aug 09 17:01:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b4979c44-d27f-4802-a22d-9f0b63f713bf tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:01:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:01:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:01:28 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 09 17:01:28 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600488.522226, 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:01:28 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] VM Started (Lifecycle Event)
Aug 09 17:01:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:01:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:01:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-a9116545-f215-4863-9347-e323f58d89dd req-58054065-44df-479d-aadc-7c3564cce660 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received event network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:01:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9116545-f215-4863-9347-e323f58d89dd req-58054065-44df-479d-aadc-7c3564cce660 service nova] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:01:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9116545-f215-4863-9347-e323f58d89dd req-58054065-44df-479d-aadc-7c3564cce660 service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:01:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a9116545-f215-4863-9347-e323f58d89dd req-58054065-44df-479d-aadc-7c3564cce660 service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:01:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-a9116545-f215-4863-9347-e323f58d89dd req-58054065-44df-479d-aadc-7c3564cce660 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] No waiting events found dispatching network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:01:28 user nova-compute[73091]: WARNING nova.compute.manager [req-a9116545-f215-4863-9347-e323f58d89dd req-58054065-44df-479d-aadc-7c3564cce660 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received unexpected event network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 for instance with vm_state active and task_state None.
Aug 09 17:01:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:01:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:01:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:01:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:01:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:01:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:01:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:01:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:01:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 17:01:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 17:01:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 17:01:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:35 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:01:35 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:01:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8449MB free_disk=24.999412536621094GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:01:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:01:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:01:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c3871ef4-45e7-4118-8227-e48cc857d481 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:01:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 76055017-05ff-4ea7-ae9c-66d2e502e090 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:01:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance be5d7299-6eb0-4ba4-a2a3-f4c513168d68 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:01:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:01:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 86938d92-2044-4f88-b2ea-f2e6711bd2d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:01:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:01:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:01:35 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:01:35 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:01:35 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:01:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.322s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:01:36 user nova-compute[73091]: INFO nova.compute.manager [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Rescuing
Aug 09 17:01:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "refresh_cache-86938d92-2044-4f88-b2ea-f2e6711bd2d4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:01:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquired lock "refresh_cache-86938d92-2044-4f88-b2ea-f2e6711bd2d4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:01:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 17:01:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:01:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:01:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Updating instance_info_cache with network_info: [{"id": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "address": "fa:16:3e:a7:60:45", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee82f5a2-a5", "ovs_interfaceid": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:01:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Releasing lock "refresh_cache-86938d92-2044-4f88-b2ea-f2e6711bd2d4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:01:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-bfd88387-804b-4a39-a62c-12756fe21033 req-73ac67e2-7710-4d83-bbbe-3b2f55ad8550 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received event network-vif-unplugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:01:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bfd88387-804b-4a39-a62c-12756fe21033 req-73ac67e2-7710-4d83-bbbe-3b2f55ad8550 service nova] Acquiring lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:01:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bfd88387-804b-4a39-a62c-12756fe21033 req-73ac67e2-7710-4d83-bbbe-3b2f55ad8550 service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:01:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bfd88387-804b-4a39-a62c-12756fe21033 req-73ac67e2-7710-4d83-bbbe-3b2f55ad8550 service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:01:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-bfd88387-804b-4a39-a62c-12756fe21033 req-73ac67e2-7710-4d83-bbbe-3b2f55ad8550 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] No waiting events found dispatching network-vif-unplugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:01:37 user nova-compute[73091]: WARNING nova.compute.manager [req-bfd88387-804b-4a39-a62c-12756fe21033 req-73ac67e2-7710-4d83-bbbe-3b2f55ad8550 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received unexpected event network-vif-unplugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 for instance with vm_state active and task_state rescuing.
Aug 09 17:01:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:37 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Instance destroyed successfully.
Aug 09 17:01:37 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Attempting a stable device rescue
Aug 09 17:01:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73091) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 17:01:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 17:01:37 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Creating image(s)
Aug 09 17:01:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "/opt/stack/data/nova/instances/86938d92-2044-4f88-b2ea-f2e6711bd2d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:01:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "/opt/stack/data/nova/instances/86938d92-2044-4f88-b2ea-f2e6711bd2d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:01:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "/opt/stack/data/nova/instances/86938d92-2044-4f88-b2ea-f2e6711bd2d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:01:37 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'trusted_certs' on Instance uuid 86938d92-2044-4f88-b2ea-f2e6711bd2d4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:01:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "dec08bd5298854fb6d8990a1c1610733a4b23015" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:01:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "dec08bd5298854fb6d8990a1c1610733a4b23015" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:01:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dec08bd5298854fb6d8990a1c1610733a4b23015.part --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dec08bd5298854fb6d8990a1c1610733a4b23015.part --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:38 user nova-compute[73091]: DEBUG nova.virt.images [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] 6c8d985c-c3f1-4bd9-b2d0-c14c6412ccd8 was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 17:01:38 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 17:01:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dec08bd5298854fb6d8990a1c1610733a4b23015.part /opt/stack/data/nova/instances/_base/dec08bd5298854fb6d8990a1c1610733a4b23015.converted {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-d7d90534-2074-49c0-850b-4b5f2d1ad232 req-59d2b69b-60c3-4c56-840b-54ad8c2f7aee service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7d90534-2074-49c0-850b-4b5f2d1ad232 req-59d2b69b-60c3-4c56-840b-54ad8c2f7aee service nova] Acquiring lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7d90534-2074-49c0-850b-4b5f2d1ad232 req-59d2b69b-60c3-4c56-840b-54ad8c2f7aee service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7d90534-2074-49c0-850b-4b5f2d1ad232 req-59d2b69b-60c3-4c56-840b-54ad8c2f7aee service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-d7d90534-2074-49c0-850b-4b5f2d1ad232 req-59d2b69b-60c3-4c56-840b-54ad8c2f7aee service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] No waiting events found dispatching network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:01:39 user nova-compute[73091]: WARNING nova.compute.manager [req-d7d90534-2074-49c0-850b-4b5f2d1ad232 req-59d2b69b-60c3-4c56-840b-54ad8c2f7aee service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received unexpected event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 for instance with vm_state active and task_state rescuing.
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dec08bd5298854fb6d8990a1c1610733a4b23015.part /opt/stack/data/nova/instances/_base/dec08bd5298854fb6d8990a1c1610733a4b23015.converted" returned: 0 in 0.488s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dec08bd5298854fb6d8990a1c1610733a4b23015.converted --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dec08bd5298854fb6d8990a1c1610733a4b23015.converted --force-share --output=json" returned: 0 in 0.144s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "dec08bd5298854fb6d8990a1c1610733a4b23015" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.744s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "dec08bd5298854fb6d8990a1c1610733a4b23015" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "dec08bd5298854fb6d8990a1c1610733a4b23015" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dec08bd5298854fb6d8990a1c1610733a4b23015 --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dec08bd5298854fb6d8990a1c1610733a4b23015 --force-share --output=json" returned: 0 in 0.133s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dec08bd5298854fb6d8990a1c1610733a4b23015,backing_fmt=raw /opt/stack/data/nova/instances/86938d92-2044-4f88-b2ea-f2e6711bd2d4/disk.rescue {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dec08bd5298854fb6d8990a1c1610733a4b23015,backing_fmt=raw /opt/stack/data/nova/instances/86938d92-2044-4f88-b2ea-f2e6711bd2d4/disk.rescue" returned: 0 in 0.053s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "dec08bd5298854fb6d8990a1c1610733a4b23015" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'migration_context' on Instance uuid 86938d92-2044-4f88-b2ea-f2e6711bd2d4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Start _get_guest_xml network_info=[{"id": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "address": "fa:16:3e:a7:60:45", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "vif_mac": "fa:16:3e:a7:60:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee82f5a2-a5", "ovs_interfaceid": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6c8d985c-c3f1-4bd9-b2d0-c14c6412ccd8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'b46e6d51-1ddc-48d3-a909-6898fd0505ab', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpUmOrHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '86938d92-2044-4f88-b2ea-f2e6711bd2d4', 'attached_at': '', 'detached_at': '', 'volume_id': '486b2bbd-c3aa-4b52-aab7-15933bf1a35e', 'serial': '486b2bbd-c3aa-4b52-aab7-15933bf1a35e'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'resources' on Instance uuid 86938d92-2044-4f88-b2ea-f2e6711bd2d4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'numa_topology' on Instance uuid 86938d92-2044-4f88-b2ea-f2e6711bd2d4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:01:39 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:01:39 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'vcpu_model' on Instance uuid 86938d92-2044-4f88-b2ea-f2e6711bd2d4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpUmOrHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:01:39 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:01:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:01:39 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:01:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:01:39 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a896a29-33ad-4022-bb51-81967f370949]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PpUmOrHL\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 17:01:39 user nova-compute[73091]: node.name = iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e
Aug 09 17:01:39 user nova-compute[73091]: node.tpgt = -1
Aug 09 17:01:39 user nova-compute[73091]: node.startup = automatic
Aug 09 17:01:39 user nova-compute[73091]: node.leading_login = No
Aug 09 17:01:39 user nova-compute[73091]: iface.iscsi_ifacename = default
Aug 09 17:01:39 user nova-compute[73091]: iface.net_ifacename = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.ipaddress = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.prefix_len = 0
Aug 09 17:01:39 user nova-compute[73091]: iface.hwaddress = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.transport_name = tcp
Aug 09 17:01:39 user nova-compute[73091]: iface.initiatorname = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.state = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.vlan_id = 0
Aug 09 17:01:39 user nova-compute[73091]: iface.vlan_priority = 0
Aug 09 17:01:39 user nova-compute[73091]: iface.vlan_state = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.iface_num = 0
Aug 09 17:01:39 user nova-compute[73091]: iface.mtu = 0
Aug 09 17:01:39 user nova-compute[73091]: iface.port = 0
Aug 09 17:01:39 user nova-compute[73091]: iface.bootproto = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.subnet_mask = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.gateway = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.dhcp_alt_client_id = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.dhcp_dns = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.dhcp_learn_iqn = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.dhcp_vendor_id_state = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.dhcp_vendor_id = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.dhcp_slp_da = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.fragmentation = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.gratuitous_arp = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.incoming_forwarding = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.tos_state = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.tos = 0
Aug 09 17:01:39 user nova-compute[73091]: iface.ttl = 0
Aug 09 17:01:39 user nova-compute[73091]: iface.delayed_ack = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.tcp_nagle = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.tcp_wsf_state = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.tcp_wsf = 0
Aug 09 17:01:39 user nova-compute[73091]: iface.tcp_timer_scale = 0
Aug 09 17:01:39 user nova-compute[73091]: iface.tcp_timestamp = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.redirect = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.def_task_mgmt_timeout = 0
Aug 09 17:01:39 user nova-compute[73091]: iface.header_digest = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.data_digest = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.immediate_data = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.initial_r2t = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.data_seq_inorder = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.data_pdu_inorder = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.erl = 0
Aug 09 17:01:39 user nova-compute[73091]: iface.max_receive_data_len = 0
Aug 09 17:01:39 user nova-compute[73091]: iface.first_burst_len = 0
Aug 09 17:01:39 user nova-compute[73091]: iface.max_outstanding_r2t = 0
Aug 09 17:01:39 user nova-compute[73091]: iface.max_burst_len = 0
Aug 09 17:01:39 user nova-compute[73091]: iface.chap_auth = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.bidi_chap = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.strict_login_compliance = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.discovery_auth = <empty>
Aug 09 17:01:39 user nova-compute[73091]: iface.discovery_logout = <empty>
Aug 09 17:01:39 user nova-compute[73091]: node.discovery_address = <empty>
Aug 09 17:01:39 user nova-compute[73091]: node.discovery_port = 0
Aug 09 17:01:39 user nova-compute[73091]: node.discovery_type = static
Aug 09 17:01:39 user nova-compute[73091]: node.session.initial_cmdsn = 0
Aug 09 17:01:39 user nova-compute[73091]: node.session.initial_login_retry_max = 8
Aug 09 17:01:39 user nova-compute[73091]: node.session.xmit_thread_priority = -20
Aug 09 17:01:39 user nova-compute[73091]: node.session.cmds_max = 128
Aug 09 17:01:39 user nova-compute[73091]: node.session.queue_depth = 32
Aug 09 17:01:39 user nova-compute[73091]: node.session.nr_sessions = 1
Aug 09 17:01:39 user nova-compute[73091]: node.session.auth.authmethod = CHAP
Aug 09 17:01:39 user nova-compute[73091]: node.session.auth.username = PpUmOrHL
Aug 09 17:01:39 user nova-compute[73091]: node.session.auth.password = ***
Aug 09 17:01:39 user nova-compute[73091]: node.session.auth.username_in = <empty>
Aug 09 17:01:39 user nova-compute[73091]: node.session.auth.password_in = <empty>
Aug 09 17:01:39 user nova-compute[73091]: node.session.auth.chap_algs = MD5
Aug 09 17:01:39 user nova-compute[73091]: node.session.timeo.replacement_timeout = 120
Aug 09 17:01:39 user nova-compute[73091]: node.session.err_timeo.abort_timeout = 15
Aug 09 17:01:39 user nova-compute[73091]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 17:01:39 user nova-compute[73091]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 17:01:39 user nova-compute[73091]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 17:01:39 user nova-compute[73091]: node.session.iscsi.FastAbort = Yes
Aug 09 17:01:39 user nova-compute[73091]: node.session.iscsi.InitialR2T = No
Aug 09 17:01:39 user nova-compute[73091]: node.session.iscsi.ImmediateData = Yes
Aug 09 17:01:39 user nova-compute[73091]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 17:01:39 user nova-compute[73091]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 17:01:39 user nova-compute[73091]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 17:01:39 user nova-compute[73091]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 17:01:39 user nova-compute[73091]: node.session.iscsi.MaxConnections = 1
Aug 09 17:01:39 user nova-compute[73091]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 17:01:39 user nova-compute[73091]: node.session.iscsi.ERL = 0
Aug 09 17:01:39 user nova-compute[73091]: node.session.scan = manual
Aug 09 17:01:39 user nova-compute[73091]: node.session.reopen_max = 0
Aug 09 17:01:39 user nova-compute[73091]: node.conn[0].address = 172.16.0.220
Aug 09 17:01:39 user nova-compute[73091]: node.conn[0].port = 3260
Aug 09 17:01:39 user nova-compute[73091]: node.conn[0].startup = manual
Aug 09 17:01:39 user nova-compute[73091]: node.conn[0].tcp.window_size = 524288
Aug 09 17:01:39 user nova-compute[73091]: node.conn[0].tcp.type_of_service = 0
Aug 09 17:01:39 user nova-compute[73091]: node.conn[0].timeo.logout_timeout = 15
Aug 09 17:01:39 user nova-compute[73091]: node.conn[0].timeo.login_timeout = 15
Aug 09 17:01:39 user nova-compute[73091]: node.conn[0].timeo.auth_timeout = 45
Aug 09 17:01:39 user nova-compute[73091]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 17:01:39 user nova-compute[73091]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 17:01:39 user nova-compute[73091]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 17:01:39 user nova-compute[73091]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 17:01:39 user nova-compute[73091]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 17:01:39 user nova-compute[73091]: node.conn[0].iscsi.DataDigest = None
Aug 09 17:01:39 user nova-compute[73091]: node.conn[0].iscsi.IFMarker = No
Aug 09 17:01:39 user nova-compute[73091]: node.conn[0].iscsi.OFMarker = No
Aug 09 17:01:39 user nova-compute[73091]: # END RECORD
Aug 09 17:01:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d81f86c-b985-4907-8680-a11e24079aeb]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a3aec7-b9cb-4f2e-b7ed-cc7fb2e9742e]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PpUmOrHL {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PpUmOrHL" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4b5212-0cfd-4bb0-adc5-e6f822612e42]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PpUmOrHL'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.050s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6c6116-cc61-40f9-90c4-29570cc46d14]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.075s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c40893-b6a5-462b-a899-7638ea733fbb]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:01:39 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:01:39 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)
Aug 09 17:01:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:01:39 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:01:39 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)
Aug 09 17:01:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] HCTL ('36', '0', '0', 0) found on session 54 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b88fc75-20f5-499b-890a-077a93221dde]: (4, ('0 0 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Searching for a device in session 54 and hctl ('36', '0', '0', 0) yield: sde {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpUmOrHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.285s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] <== connect_volume: return (287ms) {'type': 'block', 'scsi_wwn': '23639326339616131', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:01:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639326339616131', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 17:01:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:59:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1077072569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1077072569',id=48,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T17:00:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39308f2160f14a1cb5ee136458054726',ramdisk_id='',reservation_id='r-0q48u3yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T17:00:11Z,user_data=None,user_id='1b831573c2594072890b548abda013e3',uuid=86938d92-2044-4f88-b2ea-f2e6711bd2d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "address": "fa:16:3e:a7:60:45", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "vif_mac": "fa:16:3e:a7:60:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee82f5a2-a5", "ovs_interfaceid": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 17:01:40 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converting VIF {"id": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "address": "fa:16:3e:a7:60:45", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "vif_mac": "fa:16:3e:a7:60:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee82f5a2-a5", "ovs_interfaceid": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:01:40 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:60:45,bridge_name='br-int',has_traffic_filtering=True,id=ee82f5a2-a587-4d5a-92b4-0a866e67c041,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee82f5a2-a5') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:01:40 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'pci_devices' on Instance uuid 86938d92-2044-4f88-b2ea-f2e6711bd2d4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:01:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] End _get_guest_xml xml=<domain type="kvm">
Aug 09 17:01:40 user nova-compute[73091]:   <uuid>86938d92-2044-4f88-b2ea-f2e6711bd2d4</uuid>
Aug 09 17:01:40 user nova-compute[73091]:   <name>instance-00000030</name>
Aug 09 17:01:40 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 17:01:40 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 17:01:40 user nova-compute[73091]:   <metadata>
Aug 09 17:01:40 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 17:01:40 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 17:01:40 user nova-compute[73091]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1077072569</nova:name>
Aug 09 17:01:40 user nova-compute[73091]:       <nova:creationTime>2023-08-09 17:01:39</nova:creationTime>
Aug 09 17:01:40 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 17:01:40 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 17:01:40 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 17:01:40 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 17:01:40 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 17:01:40 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 17:01:40 user nova-compute[73091]:       </nova:flavor>
Aug 09 17:01:40 user nova-compute[73091]:       <nova:owner>
Aug 09 17:01:40 user nova-compute[73091]:         <nova:user uuid="1b831573c2594072890b548abda013e3">tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member</nova:user>
Aug 09 17:01:40 user nova-compute[73091]:         <nova:project uuid="39308f2160f14a1cb5ee136458054726">tempest-ServerBootFromVolumeStableRescueTest-1999746022</nova:project>
Aug 09 17:01:40 user nova-compute[73091]:       </nova:owner>
Aug 09 17:01:40 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 17:01:40 user nova-compute[73091]:       <nova:ports>
Aug 09 17:01:40 user nova-compute[73091]:         <nova:port uuid="ee82f5a2-a587-4d5a-92b4-0a866e67c041">
Aug 09 17:01:40 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 17:01:40 user nova-compute[73091]:         </nova:port>
Aug 09 17:01:40 user nova-compute[73091]:       </nova:ports>
Aug 09 17:01:40 user nova-compute[73091]:     </nova:instance>
Aug 09 17:01:40 user nova-compute[73091]:   </metadata>
Aug 09 17:01:40 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 17:01:40 user nova-compute[73091]:     <system>
Aug 09 17:01:40 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 17:01:40 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 17:01:40 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 17:01:40 user nova-compute[73091]:       <entry name="serial">86938d92-2044-4f88-b2ea-f2e6711bd2d4</entry>
Aug 09 17:01:40 user nova-compute[73091]:       <entry name="uuid">86938d92-2044-4f88-b2ea-f2e6711bd2d4</entry>
Aug 09 17:01:40 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 17:01:40 user nova-compute[73091]:     </system>
Aug 09 17:01:40 user nova-compute[73091]:   </sysinfo>
Aug 09 17:01:40 user nova-compute[73091]:   <os>
Aug 09 17:01:40 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 17:01:40 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 17:01:40 user nova-compute[73091]:   </os>
Aug 09 17:01:40 user nova-compute[73091]:   <features>
Aug 09 17:01:40 user nova-compute[73091]:     <acpi/>
Aug 09 17:01:40 user nova-compute[73091]:     <apic/>
Aug 09 17:01:40 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 17:01:40 user nova-compute[73091]:   </features>
Aug 09 17:01:40 user nova-compute[73091]:   <clock offset="utc">
Aug 09 17:01:40 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 17:01:40 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 17:01:40 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 17:01:40 user nova-compute[73091]:   </clock>
Aug 09 17:01:40 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 17:01:40 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 17:01:40 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 17:01:40 user nova-compute[73091]:   </cpu>
Aug 09 17:01:40 user nova-compute[73091]:   <devices>
Aug 09 17:01:40 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 17:01:40 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:01:40 user nova-compute[73091]:       <source dev="/dev/sde"/>
Aug 09 17:01:40 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 17:01:40 user nova-compute[73091]:       <serial>486b2bbd-c3aa-4b52-aab7-15933bf1a35e</serial>
Aug 09 17:01:40 user nova-compute[73091]:     </disk>
Aug 09 17:01:40 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 17:01:40 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 17:01:40 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/86938d92-2044-4f88-b2ea-f2e6711bd2d4/disk.rescue"/>
Aug 09 17:01:40 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 09 17:01:40 user nova-compute[73091]:       <boot order="1"/>
Aug 09 17:01:40 user nova-compute[73091]:     </disk>
Aug 09 17:01:40 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 17:01:40 user nova-compute[73091]:       <mac address="fa:16:3e:a7:60:45"/>
Aug 09 17:01:40 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 17:01:40 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 17:01:40 user nova-compute[73091]:       <target dev="tapee82f5a2-a5"/>
Aug 09 17:01:40 user nova-compute[73091]:     </interface>
Aug 09 17:01:40 user nova-compute[73091]:     <serial type="pty">
Aug 09 17:01:40 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/86938d92-2044-4f88-b2ea-f2e6711bd2d4/console.log" append="off"/>
Aug 09 17:01:40 user nova-compute[73091]:     </serial>
Aug 09 17:01:40 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 17:01:40 user nova-compute[73091]:     <video>
Aug 09 17:01:40 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 17:01:40 user nova-compute[73091]:     </video>
Aug 09 17:01:40 user nova-compute[73091]:     <rng model="virtio">
Aug 09 17:01:40 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 17:01:40 user nova-compute[73091]:     </rng>
Aug 09 17:01:40 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 17:01:40 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 17:01:40 user nova-compute[73091]:       <stats period="10"/>
Aug 09 17:01:40 user nova-compute[73091]:     </memballoon>
Aug 09 17:01:40 user nova-compute[73091]:   </devices>
Aug 09 17:01:40 user nova-compute[73091]: </domain>
Aug 09 17:01:40 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 17:01:40 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Instance destroyed successfully.
Aug 09 17:01:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:01:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:01:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] No VIF found with MAC fa:16:3e:a7:60:45, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 17:01:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-48e17ed6-63e7-4404-bd8f-f15f3686b740 req-1d7dd659-36fa-45e4-860c-def30b292581 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:01:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-48e17ed6-63e7-4404-bd8f-f15f3686b740 req-1d7dd659-36fa-45e4-860c-def30b292581 service nova] Acquiring lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:01:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-48e17ed6-63e7-4404-bd8f-f15f3686b740 req-1d7dd659-36fa-45e4-860c-def30b292581 service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:01:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-48e17ed6-63e7-4404-bd8f-f15f3686b740 req-1d7dd659-36fa-45e4-860c-def30b292581 service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:01:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-48e17ed6-63e7-4404-bd8f-f15f3686b740 req-1d7dd659-36fa-45e4-860c-def30b292581 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] No waiting events found dispatching network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:01:41 user nova-compute[73091]: WARNING nova.compute.manager [req-48e17ed6-63e7-4404-bd8f-f15f3686b740 req-1d7dd659-36fa-45e4-860c-def30b292581 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received unexpected event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 for instance with vm_state active and task_state rescuing.
Aug 09 17:01:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Removed pending event for 86938d92-2044-4f88-b2ea-f2e6711bd2d4 due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 17:01:43 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600503.6341028, 86938d92-2044-4f88-b2ea-f2e6711bd2d4 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:01:43 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] VM Resumed (Lifecycle Event)
Aug 09 17:01:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5caa1400-64e1-4e09-972d-d5ae063bd3b3 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:01:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:01:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:01:43 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 17:01:43 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600503.6354012, 86938d92-2044-4f88-b2ea-f2e6711bd2d4 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:01:43 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] VM Started (Lifecycle Event)
Aug 09 17:01:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:01:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:01:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-f2a7a1a9-ff11-427b-82e1-27d7f8c5fc4a req-212e8f38-a695-4b8d-9c7e-a153a4e424d9 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:01:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f2a7a1a9-ff11-427b-82e1-27d7f8c5fc4a req-212e8f38-a695-4b8d-9c7e-a153a4e424d9 service nova] Acquiring lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:01:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f2a7a1a9-ff11-427b-82e1-27d7f8c5fc4a req-212e8f38-a695-4b8d-9c7e-a153a4e424d9 service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:01:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f2a7a1a9-ff11-427b-82e1-27d7f8c5fc4a req-212e8f38-a695-4b8d-9c7e-a153a4e424d9 service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:01:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-f2a7a1a9-ff11-427b-82e1-27d7f8c5fc4a req-212e8f38-a695-4b8d-9c7e-a153a4e424d9 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] No waiting events found dispatching network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:01:43 user nova-compute[73091]: WARNING nova.compute.manager [req-f2a7a1a9-ff11-427b-82e1-27d7f8c5fc4a req-212e8f38-a695-4b8d-9c7e-a153a4e424d9 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received unexpected event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 for instance with vm_state rescued and task_state None.
Aug 09 17:01:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:01:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:02:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:02:22 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:02:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:02:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:02:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:02:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:02:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:02:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquiring lock "7b305674-a656-44f5-9d67-cf927acf62f8" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "7b305674-a656-44f5-9d67-cf927acf62f8" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:02:28 user nova-compute[73091]: INFO nova.compute.manager [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Unshelving
Aug 09 17:02:28 user nova-compute[73091]: INFO nova.virt.block_device [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Booting with volume 7d410516-eabf-450f-b315-9b31d3909db2 at /dev/vda
Aug 09 17:02:28 user nova-compute[73091]: DEBUG os_brick.utils [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b7fcf9-4be9-42c9-b49e-7bb550fd31dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a4b3c3-39f6-4697-9151-cf6f4549f7c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bcdff5-e8a1-4fef-ad6e-380d6c1f6731]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6f90c1-64ab-47f7-a51f-69f846603bd2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:02:28 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 17:02:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dc8942-7b13-4f4a-ace5-4825b120159f]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG os_brick.utils [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Updating existing volume attachment record: 6a15c080-e393-4005-b891-e00a0d983064 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Updating instance_info_cache with network_info: [{"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:02:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:02:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:02:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:02:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:02:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:02:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:02:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:02:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:02:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:02:34 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:02:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 17:02:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86938d92-2044-4f88-b2ea-f2e6711bd2d4/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86938d92-2044-4f88-b2ea-f2e6711bd2d4/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86938d92-2044-4f88-b2ea-f2e6711bd2d4/disk.rescue --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86938d92-2044-4f88-b2ea-f2e6711bd2d4/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 17:02:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 17:02:36 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:02:36 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:02:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8383MB free_disk=24.90219497680664GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:02:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:02:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:02:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c3871ef4-45e7-4118-8227-e48cc857d481 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:02:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 76055017-05ff-4ea7-ae9c-66d2e502e090 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:02:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance be5d7299-6eb0-4ba4-a2a3-f4c513168d68 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:02:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:02:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 86938d92-2044-4f88-b2ea-f2e6711bd2d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:02:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 7b305674-a656-44f5-9d67-cf927acf62f8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 09 17:02:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:02:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:02:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:02:37 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:02:37 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:02:37 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:02:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.323s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:02:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.202s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:02:37 user nova-compute[73091]: DEBUG nova.objects.instance [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lazy-loading 'pci_requests' on Instance uuid 7b305674-a656-44f5-9d67-cf927acf62f8 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:02:37 user nova-compute[73091]: DEBUG nova.objects.instance [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lazy-loading 'numa_topology' on Instance uuid 7b305674-a656-44f5-9d67-cf927acf62f8 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:02:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 17:02:37 user nova-compute[73091]: INFO nova.compute.claims [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Claim successful on node user
Aug 09 17:02:37 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:02:37 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:02:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:02:37 user nova-compute[73091]: INFO nova.network.neutron [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Updating port 969bce7a-0683-42cd-bae1-12ae87f2cf3b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 17:02:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquiring lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquired lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-3008676a-e01c-4d47-ab54-a43af7a4d393 req-57cb426c-2229-43c0-a446-732a1f928fb2 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received event network-changed-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-3008676a-e01c-4d47-ab54-a43af7a4d393 req-57cb426c-2229-43c0-a446-732a1f928fb2 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Refreshing instance network info cache due to event network-changed-969bce7a-0683-42cd-bae1-12ae87f2cf3b. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3008676a-e01c-4d47-ab54-a43af7a4d393 req-57cb426c-2229-43c0-a446-732a1f928fb2 service nova] Acquiring lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Updating instance_info_cache with network_info: [{"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Releasing lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 17:02:38 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Creating image(s)
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Ensure instance console log exists: /opt/stack/data/nova/instances/7b305674-a656-44f5-9d67-cf927acf62f8/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Start _get_guest_xml network_info=[{"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '6a15c080-e393-4005-b891-e00a0d983064', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byzNJqnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7b305674-a656-44f5-9d67-cf927acf62f8', 'attached_at': '', 'detached_at': '', 'volume_id': '7d410516-eabf-450f-b315-9b31d3909db2', 'serial': '7d410516-eabf-450f-b315-9b31d3909db2'}, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3008676a-e01c-4d47-ab54-a43af7a4d393 req-57cb426c-2229-43c0-a446-732a1f928fb2 service nova] Acquired lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.network.neutron [req-3008676a-e01c-4d47-ab54-a43af7a4d393 req-57cb426c-2229-43c0-a446-732a1f928fb2 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Refreshing network info cache for port 969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 17:02:38 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:02:38 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.objects.instance [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7b305674-a656-44f5-9d67-cf927acf62f8 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byzNJqnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:02:38 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:02:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:02:38 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:02:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:02:38 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 17:02:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f80e55-a7e9-4dda-8877-6ee3794022db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 17:02:38 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5118b32b-5b8d-4f85-922d-d657012e91a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2] added
Aug 09 17:02:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[88051324-c9d6-4890-a92b-d059cf4cab0f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:02:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[904f655a-ca5d-46b0-9682-8b55ea3e8338]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v byzNJqnZ {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v byzNJqnZ" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[016a5be6-50aa-4799-9ed0-b9bcd8ac1561]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'byzNJqnZ'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb7d631-f57a-42ff-b7d9-5e108a7a0677]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25f6f77-1733-48f9-8513-6938ff231b40]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:02:39 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:02:39 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)
Aug 09 17:02:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:02:39 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:02:39 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)
Aug 09 17:02:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac198c6-2593-4cd0-90cb-6ebfc3a35657]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2, portal: 172.16.0.220,3260]
Aug 09 17:02:39 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2, portal: 172.16.0.220,3260] successful.
Aug 09 17:02:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e793c1-fdea-431c-ad01-5854041cf3a0]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[29319378-cc31-486e-b8bb-1a96d9b76cf7]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:02:39 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:02:39 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)
Aug 09 17:02:39 user nova-compute[73091]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)
Aug 09 17:02:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:02:39 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:02:39 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)
Aug 09 17:02:39 user nova-compute[73091]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)
Aug 09 17:02:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52ddfa8-e600-4884-a684-486598dfc7bc]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byzNJqnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-3008676a-e01c-4d47-ab54-a43af7a4d393 req-57cb426c-2229-43c0-a446-732a1f928fb2 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Updated VIF entry in instance network info cache for port 969bce7a-0683-42cd-bae1-12ae87f2cf3b. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-3008676a-e01c-4d47-ab54-a43af7a4d393 req-57cb426c-2229-43c0-a446-732a1f928fb2 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Updating instance_info_cache with network_info: [{"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:02:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3008676a-e01c-4d47-ab54-a43af7a4d393 req-57cb426c-2229-43c0-a446-732a1f928fb2 service nova] Releasing lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23835663331326433', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835663331326433', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T16:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1712628175',display_name='tempest-TestShelveInstance-server-1712628175',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1712628175',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-622552020',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:58:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='05969405da7a47968fe16aabc3724131',ramdisk_id='',reservation_id='r-ctyu5xzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2078233597',owner_user_name='tempest-TestShelveInstance-2078233597-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T17:02:28Z,user_data=None,user_id='00eda119bf8041d59b4cf94b02b4b1a0',uuid=7b305674-a656-44f5-9d67-cf927acf62f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Converting VIF {"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=969bce7a-0683-42cd-bae1-12ae87f2cf3b,network=Network(d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bce7a-06') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG nova.objects.instance [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b305674-a656-44f5-9d67-cf927acf62f8 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] End _get_guest_xml xml=<domain type="kvm">
Aug 09 17:02:40 user nova-compute[73091]:   <uuid>7b305674-a656-44f5-9d67-cf927acf62f8</uuid>
Aug 09 17:02:40 user nova-compute[73091]:   <name>instance-0000002f</name>
Aug 09 17:02:40 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 17:02:40 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 17:02:40 user nova-compute[73091]:   <metadata>
Aug 09 17:02:40 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 17:02:40 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 17:02:40 user nova-compute[73091]:       <nova:name>tempest-TestShelveInstance-server-1712628175</nova:name>
Aug 09 17:02:40 user nova-compute[73091]:       <nova:creationTime>2023-08-09 17:02:38</nova:creationTime>
Aug 09 17:02:40 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 17:02:40 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 17:02:40 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 17:02:40 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 17:02:40 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 17:02:40 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 17:02:40 user nova-compute[73091]:       </nova:flavor>
Aug 09 17:02:40 user nova-compute[73091]:       <nova:owner>
Aug 09 17:02:40 user nova-compute[73091]:         <nova:user uuid="00eda119bf8041d59b4cf94b02b4b1a0">tempest-TestShelveInstance-2078233597-project-member</nova:user>
Aug 09 17:02:40 user nova-compute[73091]:         <nova:project uuid="05969405da7a47968fe16aabc3724131">tempest-TestShelveInstance-2078233597</nova:project>
Aug 09 17:02:40 user nova-compute[73091]:       </nova:owner>
Aug 09 17:02:40 user nova-compute[73091]:       <nova:ports>
Aug 09 17:02:40 user nova-compute[73091]:         <nova:port uuid="969bce7a-0683-42cd-bae1-12ae87f2cf3b">
Aug 09 17:02:40 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 17:02:40 user nova-compute[73091]:         </nova:port>
Aug 09 17:02:40 user nova-compute[73091]:       </nova:ports>
Aug 09 17:02:40 user nova-compute[73091]:     </nova:instance>
Aug 09 17:02:40 user nova-compute[73091]:   </metadata>
Aug 09 17:02:40 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 17:02:40 user nova-compute[73091]:     <system>
Aug 09 17:02:40 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 17:02:40 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 17:02:40 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 17:02:40 user nova-compute[73091]:       <entry name="serial">7b305674-a656-44f5-9d67-cf927acf62f8</entry>
Aug 09 17:02:40 user nova-compute[73091]:       <entry name="uuid">7b305674-a656-44f5-9d67-cf927acf62f8</entry>
Aug 09 17:02:40 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 17:02:40 user nova-compute[73091]:     </system>
Aug 09 17:02:40 user nova-compute[73091]:   </sysinfo>
Aug 09 17:02:40 user nova-compute[73091]:   <os>
Aug 09 17:02:40 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 17:02:40 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 17:02:40 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 17:02:40 user nova-compute[73091]:   </os>
Aug 09 17:02:40 user nova-compute[73091]:   <features>
Aug 09 17:02:40 user nova-compute[73091]:     <acpi/>
Aug 09 17:02:40 user nova-compute[73091]:     <apic/>
Aug 09 17:02:40 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 17:02:40 user nova-compute[73091]:   </features>
Aug 09 17:02:40 user nova-compute[73091]:   <clock offset="utc">
Aug 09 17:02:40 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 17:02:40 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 17:02:40 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 17:02:40 user nova-compute[73091]:   </clock>
Aug 09 17:02:40 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 17:02:40 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 17:02:40 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 17:02:40 user nova-compute[73091]:   </cpu>
Aug 09 17:02:40 user nova-compute[73091]:   <devices>
Aug 09 17:02:40 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 09 17:02:40 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:02:40 user nova-compute[73091]:       <source dev="/dev/sdc"/>
Aug 09 17:02:40 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 17:02:40 user nova-compute[73091]:       <serial>7d410516-eabf-450f-b315-9b31d3909db2</serial>
Aug 09 17:02:40 user nova-compute[73091]:     </disk>
Aug 09 17:02:40 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 17:02:40 user nova-compute[73091]:       <mac address="fa:16:3e:e3:fa:65"/>
Aug 09 17:02:40 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 17:02:40 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 17:02:40 user nova-compute[73091]:       <target dev="tap969bce7a-06"/>
Aug 09 17:02:40 user nova-compute[73091]:     </interface>
Aug 09 17:02:40 user nova-compute[73091]:     <serial type="pty">
Aug 09 17:02:40 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/7b305674-a656-44f5-9d67-cf927acf62f8/console.log" append="off"/>
Aug 09 17:02:40 user nova-compute[73091]:     </serial>
Aug 09 17:02:40 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 17:02:40 user nova-compute[73091]:     <video>
Aug 09 17:02:40 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 17:02:40 user nova-compute[73091]:     </video>
Aug 09 17:02:40 user nova-compute[73091]:     <rng model="virtio">
Aug 09 17:02:40 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 17:02:40 user nova-compute[73091]:     </rng>
Aug 09 17:02:40 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 17:02:40 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 17:02:40 user nova-compute[73091]:       <stats period="10"/>
Aug 09 17:02:40 user nova-compute[73091]:     </memballoon>
Aug 09 17:02:40 user nova-compute[73091]:   </devices>
Aug 09 17:02:40 user nova-compute[73091]: </domain>
Aug 09 17:02:40 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T16:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1712628175',display_name='tempest-TestShelveInstance-server-1712628175',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1712628175',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-622552020',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:58:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='05969405da7a47968fe16aabc3724131',ramdisk_id='',reservation_id='r-ctyu5xzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2078233597',owner_user_name='tempest-TestShelveInstance-2078233597-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T17:02:28Z,user_data=None,user_id='00eda119bf8041d59b4cf94b02b4b1a0',uuid=7b305674-a656-44f5-9d67-cf927acf62f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Converting VIF {"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=969bce7a-0683-42cd-bae1-12ae87f2cf3b,network=Network(d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bce7a-06') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG os_vif [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=969bce7a-0683-42cd-bae1-12ae87f2cf3b,network=Network(d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bce7a-06') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap969bce7a-06, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap969bce7a-06, col_values=(('external_ids', {'iface-id': '969bce7a-0683-42cd-bae1-12ae87f2cf3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:fa:65', 'vm-uuid': '7b305674-a656-44f5-9d67-cf927acf62f8'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:40 user nova-compute[73091]: INFO os_vif [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=969bce7a-0683-42cd-bae1-12ae87f2cf3b,network=Network(d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bce7a-06')
Aug 09 17:02:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:02:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] No VIF found with MAC fa:16:3e:e3:fa:65, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 17:02:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-265eb393-d7e7-4efb-b93f-f1c7b20c835c req-87ac99ad-28c2-4ac3-8416-48aed8184945 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received event network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-265eb393-d7e7-4efb-b93f-f1c7b20c835c req-87ac99ad-28c2-4ac3-8416-48aed8184945 service nova] Acquiring lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-265eb393-d7e7-4efb-b93f-f1c7b20c835c req-87ac99ad-28c2-4ac3-8416-48aed8184945 service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:02:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-265eb393-d7e7-4efb-b93f-f1c7b20c835c req-87ac99ad-28c2-4ac3-8416-48aed8184945 service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:02:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-265eb393-d7e7-4efb-b93f-f1c7b20c835c req-87ac99ad-28c2-4ac3-8416-48aed8184945 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] No waiting events found dispatching network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:02:41 user nova-compute[73091]: WARNING nova.compute.manager [req-265eb393-d7e7-4efb-b93f-f1c7b20c835c req-87ac99ad-28c2-4ac3-8416-48aed8184945 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received unexpected event network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 17:02:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:43 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600563.6795766, 7b305674-a656-44f5-9d67-cf927acf62f8 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:02:43 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] VM Resumed (Lifecycle Event)
Aug 09 17:02:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 17:02:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 17:02:43 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Instance spawned successfully.
Aug 09 17:02:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:02:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:02:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:02:43 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 17:02:43 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600563.681891, 7b305674-a656-44f5-9d67-cf927acf62f8 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:02:43 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] VM Started (Lifecycle Event)
Aug 09 17:02:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:02:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-75cc7fd1-8c1f-445e-8047-a749da510605 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "7b305674-a656-44f5-9d67-cf927acf62f8" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.665s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:02:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-08ab5bcd-2bfe-49e7-9671-2a25730c3436 req-7a939a86-e830-4392-b98d-fdb3cc6fcf94 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received event network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-08ab5bcd-2bfe-49e7-9671-2a25730c3436 req-7a939a86-e830-4392-b98d-fdb3cc6fcf94 service nova] Acquiring lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-08ab5bcd-2bfe-49e7-9671-2a25730c3436 req-7a939a86-e830-4392-b98d-fdb3cc6fcf94 service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:02:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-08ab5bcd-2bfe-49e7-9671-2a25730c3436 req-7a939a86-e830-4392-b98d-fdb3cc6fcf94 service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:02:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-08ab5bcd-2bfe-49e7-9671-2a25730c3436 req-7a939a86-e830-4392-b98d-fdb3cc6fcf94 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] No waiting events found dispatching network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:02:43 user nova-compute[73091]: WARNING nova.compute.manager [req-08ab5bcd-2bfe-49e7-9671-2a25730c3436 req-7a939a86-e830-4392-b98d-fdb3cc6fcf94 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received unexpected event network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b for instance with vm_state active and task_state None.
Aug 09 17:02:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:02:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:02:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:02:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:02:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:02:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:03:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:03:13 user nova-compute[73091]: INFO nova.compute.manager [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Detaching volume 692152b7-2423-44c0-9adc-8a8066652c33
Aug 09 17:03:13 user nova-compute[73091]: INFO nova.virt.block_device [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Attempting to driver detach volume 692152b7-2423-44c0-9adc-8a8066652c33 from mountpoint /dev/vdb
Aug 09 17:03:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Attempting to detach device vdb from instance 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 17:03:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:03:13 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:03:13 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:03:13 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:03:13 user nova-compute[73091]:   <serial>692152b7-2423-44c0-9adc-8a8066652c33</serial>
Aug 09 17:03:13 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 17:03:13 user nova-compute[73091]: </disk>
Aug 09 17:03:13 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:03:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Successfully detached device vdb from instance 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 from the persistent domain config.
Aug 09 17:03:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 17:03:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:03:13 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:03:13 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:03:13 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:03:13 user nova-compute[73091]:   <serial>692152b7-2423-44c0-9adc-8a8066652c33</serial>
Aug 09 17:03:13 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 17:03:13 user nova-compute[73091]: </disk>
Aug 09 17:03:13 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:03:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691600593.9285674, 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 17:03:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 17:03:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Successfully detached device vdb from instance 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 from the live domain config.
Aug 09 17:03:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 17:03:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmydhAsH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:03:13 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:03:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:03:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:03:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 17:03:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:03:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:03:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22c76c1-a4cf-410e-9a1d-6892bb81c53a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:03:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:03:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:03:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ec0af6-b881-4982-8f4a-f7c578804886]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:03:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:03:13 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:03:13 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)
Aug 09 17:03:13 user nova-compute[73091]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)
Aug 09 17:03:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:03:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:03:13 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:03:13 user nova-compute[73091]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 (non-flash)
Aug 09 17:03:13 user nova-compute[73091]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)
Aug 09 17:03:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:03:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff08041a9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 17:03:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 17:03:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecd5234-51de-413d-8d5e-d627d93dc682]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edc2c9e-6130-47cf-9c67-148618e0dfd9]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f4e47b-db46-4767-b244-2534ab261e2e]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfce51a-716e-4af7-9bdd-1d57d364628d]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0e0c2c-77c5-4e89-84fc-67a060217db1]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[75239888-2bca-4191-b31b-581fd24d60fd]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33, portal: 172.16.0.220,3260]
Aug 09 17:03:14 user nova-compute[73091]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33, portal: 172.16.0.220,3260] successful.
Aug 09 17:03:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692152b7-2423-44c0-9adc-8a8066652c33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b297bb40-537c-4661-a78e-348e5d2ece8f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] <== disconnect_volume: return (289ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'flavor' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:03:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ef4c7180-448e-458e-b8f4-d1807ac2bdb9 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.590s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:03:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f276ebb5-614b-46c2-862e-0f788f544fd7 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:03:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f276ebb5-614b-46c2-862e-0f788f544fd7 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:03:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f276ebb5-614b-46c2-862e-0f788f544fd7 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:03:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f276ebb5-614b-46c2-862e-0f788f544fd7 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73091) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 09 17:03:15 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f276ebb5-614b-46c2-862e-0f788f544fd7 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'flavor' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:03:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-3a28e5ce-7d45-4974-8d32-ddc749687a62 req-47d64cbf-96b0-4cf3-b738-ee0178a5aa70 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received event network-vif-unplugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:03:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3a28e5ce-7d45-4974-8d32-ddc749687a62 req-47d64cbf-96b0-4cf3-b738-ee0178a5aa70 service nova] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:03:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3a28e5ce-7d45-4974-8d32-ddc749687a62 req-47d64cbf-96b0-4cf3-b738-ee0178a5aa70 service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:03:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3a28e5ce-7d45-4974-8d32-ddc749687a62 req-47d64cbf-96b0-4cf3-b738-ee0178a5aa70 service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:03:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-3a28e5ce-7d45-4974-8d32-ddc749687a62 req-47d64cbf-96b0-4cf3-b738-ee0178a5aa70 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] No waiting events found dispatching network-vif-unplugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:03:15 user nova-compute[73091]: WARNING nova.compute.manager [req-3a28e5ce-7d45-4974-8d32-ddc749687a62 req-47d64cbf-96b0-4cf3-b738-ee0178a5aa70 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received unexpected event network-vif-unplugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 for instance with vm_state active and task_state powering-off.
Aug 09 17:03:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Instance destroyed successfully.
Aug 09 17:03:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f276ebb5-614b-46c2-862e-0f788f544fd7 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:03:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f276ebb5-614b-46c2-862e-0f788f544fd7 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.842s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:03:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-16e8fde1-2ec9-4088-8697-5870d305c69e req-3ffcb956-5486-4665-8937-5f8d8539c4a6 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received event network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:03:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16e8fde1-2ec9-4088-8697-5870d305c69e req-3ffcb956-5486-4665-8937-5f8d8539c4a6 service nova] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:03:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16e8fde1-2ec9-4088-8697-5870d305c69e req-3ffcb956-5486-4665-8937-5f8d8539c4a6 service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:03:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-16e8fde1-2ec9-4088-8697-5870d305c69e req-3ffcb956-5486-4665-8937-5f8d8539c4a6 service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:03:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-16e8fde1-2ec9-4088-8697-5870d305c69e req-3ffcb956-5486-4665-8937-5f8d8539c4a6 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] No waiting events found dispatching network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:03:18 user nova-compute[73091]: WARNING nova.compute.manager [req-16e8fde1-2ec9-4088-8697-5870d305c69e req-3ffcb956-5486-4665-8937-5f8d8539c4a6 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received unexpected event network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 for instance with vm_state stopped and task_state None.
Aug 09 17:03:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:03:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:03:24 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:03:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:03:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:03:26 user nova-compute[73091]: INFO nova.compute.manager [None req-16492c7f-1507-4dbe-9b07-0706e493e545 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Unrescuing
Aug 09 17:03:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16492c7f-1507-4dbe-9b07-0706e493e545 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "refresh_cache-86938d92-2044-4f88-b2ea-f2e6711bd2d4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:03:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16492c7f-1507-4dbe-9b07-0706e493e545 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquired lock "refresh_cache-86938d92-2044-4f88-b2ea-f2e6711bd2d4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:03:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-16492c7f-1507-4dbe-9b07-0706e493e545 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 17:03:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-16492c7f-1507-4dbe-9b07-0706e493e545 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Updating instance_info_cache with network_info: [{"id": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "address": "fa:16:3e:a7:60:45", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee82f5a2-a5", "ovs_interfaceid": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:03:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16492c7f-1507-4dbe-9b07-0706e493e545 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Releasing lock "refresh_cache-86938d92-2044-4f88-b2ea-f2e6711bd2d4" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:03:27 user nova-compute[73091]: DEBUG nova.objects.instance [None req-16492c7f-1507-4dbe-9b07-0706e493e545 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'flavor' on Instance uuid 86938d92-2044-4f88-b2ea-f2e6711bd2d4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:03:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-6e6a007a-381b-438f-aa65-b60092fef0da req-8b717e74-8912-4ec5-807f-64d1113e6858 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received event network-vif-unplugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:03:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6e6a007a-381b-438f-aa65-b60092fef0da req-8b717e74-8912-4ec5-807f-64d1113e6858 service nova] Acquiring lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:03:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6e6a007a-381b-438f-aa65-b60092fef0da req-8b717e74-8912-4ec5-807f-64d1113e6858 service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:03:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6e6a007a-381b-438f-aa65-b60092fef0da req-8b717e74-8912-4ec5-807f-64d1113e6858 service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:03:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-6e6a007a-381b-438f-aa65-b60092fef0da req-8b717e74-8912-4ec5-807f-64d1113e6858 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] No waiting events found dispatching network-vif-unplugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:03:27 user nova-compute[73091]: WARNING nova.compute.manager [req-6e6a007a-381b-438f-aa65-b60092fef0da req-8b717e74-8912-4ec5-807f-64d1113e6858 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received unexpected event network-vif-unplugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 for instance with vm_state rescued and task_state unrescuing.
Aug 09 17:03:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:28 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Instance destroyed successfully.
Aug 09 17:03:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:03:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:03:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:03:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:03:28 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Updating instance_info_cache with network_info: [{"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] Acquiring lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] No waiting events found dispatching network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:03:29 user nova-compute[73091]: WARNING nova.compute.manager [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received unexpected event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 for instance with vm_state rescued and task_state unrescuing.
Aug 09 17:03:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] Acquiring lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] No waiting events found dispatching network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:03:29 user nova-compute[73091]: WARNING nova.compute.manager [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received unexpected event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 for instance with vm_state rescued and task_state unrescuing.
Aug 09 17:03:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] Acquiring lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] No waiting events found dispatching network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:03:29 user nova-compute[73091]: WARNING nova.compute.manager [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received unexpected event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 for instance with vm_state rescued and task_state unrescuing.
Aug 09 17:03:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received event network-vif-unplugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] Acquiring lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] No waiting events found dispatching network-vif-unplugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:03:29 user nova-compute[73091]: WARNING nova.compute.manager [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received unexpected event network-vif-unplugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 for instance with vm_state rescued and task_state unrescuing.
Aug 09 17:03:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] Acquiring lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] No waiting events found dispatching network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:03:29 user nova-compute[73091]: WARNING nova.compute.manager [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received unexpected event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 for instance with vm_state rescued and task_state unrescuing.
Aug 09 17:03:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] Acquiring lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:03:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] No waiting events found dispatching network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:03:29 user nova-compute[73091]: WARNING nova.compute.manager [req-cb50bee6-2ae7-41e1-b0c2-20bd28ddb7c9 req-cc1d3746-77f0-49f1-a527-bb265f54aa9c service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received unexpected event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 for instance with vm_state rescued and task_state unrescuing.
Aug 09 17:03:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:31 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691600596.4485855, 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:03:31 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] VM Stopped (Lifecycle Event)
Aug 09 17:03:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-df7c8b83-e6ea-4bb2-a900-3f9122c61e9d None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:03:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-df7c8b83-e6ea-4bb2-a900-3f9122c61e9d None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:03:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Removed pending event for 86938d92-2044-4f88-b2ea-f2e6711bd2d4 due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 17:03:31 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600611.5097854, 86938d92-2044-4f88-b2ea-f2e6711bd2d4 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:03:31 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] VM Resumed (Lifecycle Event)
Aug 09 17:03:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-16492c7f-1507-4dbe-9b07-0706e493e545 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:03:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:03:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:03:31 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 17:03:31 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600611.5111935, 86938d92-2044-4f88-b2ea-f2e6711bd2d4 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:03:31 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] VM Started (Lifecycle Event)
Aug 09 17:03:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:03:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:03:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-9ada7720-df4a-4a88-b0d2-e2c551b89947 req-204a342d-6d18-4f14-b01d-b27a3670f391 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:03:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9ada7720-df4a-4a88-b0d2-e2c551b89947 req-204a342d-6d18-4f14-b01d-b27a3670f391 service nova] Acquiring lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:03:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9ada7720-df4a-4a88-b0d2-e2c551b89947 req-204a342d-6d18-4f14-b01d-b27a3670f391 service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:03:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9ada7720-df4a-4a88-b0d2-e2c551b89947 req-204a342d-6d18-4f14-b01d-b27a3670f391 service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:03:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-9ada7720-df4a-4a88-b0d2-e2c551b89947 req-204a342d-6d18-4f14-b01d-b27a3670f391 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] No waiting events found dispatching network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:03:31 user nova-compute[73091]: WARNING nova.compute.manager [req-9ada7720-df4a-4a88-b0d2-e2c551b89947 req-204a342d-6d18-4f14-b01d-b27a3670f391 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received unexpected event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 for instance with vm_state active and task_state None.
Aug 09 17:03:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:03:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:03:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:03:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:03:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:03:34 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:03:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:03:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:03:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:03:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:03:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 17:03:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:03:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:03:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:03:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:03:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 17:03:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 17:03:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:03:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:03:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:03:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:03:36 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:03:36 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:03:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8447MB free_disk=24.901103973388672GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:03:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:03:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:03:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c3871ef4-45e7-4118-8227-e48cc857d481 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:03:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 76055017-05ff-4ea7-ae9c-66d2e502e090 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:03:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance be5d7299-6eb0-4ba4-a2a3-f4c513168d68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:03:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:03:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 86938d92-2044-4f88-b2ea-f2e6711bd2d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:03:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 7b305674-a656-44f5-9d67-cf927acf62f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:03:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:03:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:03:36 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:03:36 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:03:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:03:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:03:38 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:03:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:03:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:03:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:03:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:04:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 17:04:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-c9a4c912-972e-4207-8eb6-b8d930f754d0 req-ea12ad5c-2128-4ed2-8f69-d289fb690fc7 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received event network-changed-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-c9a4c912-972e-4207-8eb6-b8d930f754d0 req-ea12ad5c-2128-4ed2-8f69-d289fb690fc7 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Refreshing instance network info cache due to event network-changed-969bce7a-0683-42cd-bae1-12ae87f2cf3b. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9a4c912-972e-4207-8eb6-b8d930f754d0 req-ea12ad5c-2128-4ed2-8f69-d289fb690fc7 service nova] Acquiring lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9a4c912-972e-4207-8eb6-b8d930f754d0 req-ea12ad5c-2128-4ed2-8f69-d289fb690fc7 service nova] Acquired lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-c9a4c912-972e-4207-8eb6-b8d930f754d0 req-ea12ad5c-2128-4ed2-8f69-d289fb690fc7 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Refreshing network info cache for port 969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquiring lock "7b305674-a656-44f5-9d67-cf927acf62f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "7b305674-a656-44f5-9d67-cf927acf62f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquiring lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:04:19 user nova-compute[73091]: INFO nova.compute.manager [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Terminating instance
Aug 09 17:04:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-5f40be0b-5319-4f10-8023-4e03ce529482 req-94ad29b7-0a7c-4f0e-b1f5-085085701da0 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received event network-vif-unplugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5f40be0b-5319-4f10-8023-4e03ce529482 req-94ad29b7-0a7c-4f0e-b1f5-085085701da0 service nova] Acquiring lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5f40be0b-5319-4f10-8023-4e03ce529482 req-94ad29b7-0a7c-4f0e-b1f5-085085701da0 service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5f40be0b-5319-4f10-8023-4e03ce529482 req-94ad29b7-0a7c-4f0e-b1f5-085085701da0 service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-5f40be0b-5319-4f10-8023-4e03ce529482 req-94ad29b7-0a7c-4f0e-b1f5-085085701da0 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] No waiting events found dispatching network-vif-unplugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-5f40be0b-5319-4f10-8023-4e03ce529482 req-94ad29b7-0a7c-4f0e-b1f5-085085701da0 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received event network-vif-unplugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-c9a4c912-972e-4207-8eb6-b8d930f754d0 req-ea12ad5c-2128-4ed2-8f69-d289fb690fc7 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Updated VIF entry in instance network info cache for port 969bce7a-0683-42cd-bae1-12ae87f2cf3b. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-c9a4c912-972e-4207-8eb6-b8d930f754d0 req-ea12ad5c-2128-4ed2-8f69-d289fb690fc7 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Updating instance_info_cache with network_info: [{"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c9a4c912-972e-4207-8eb6-b8d930f754d0 req-ea12ad5c-2128-4ed2-8f69-d289fb690fc7 service nova] Releasing lock "refresh_cache-7b305674-a656-44f5-9d67-cf927acf62f8" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Instance destroyed successfully.
Aug 09 17:04:19 user nova-compute[73091]: DEBUG nova.objects.instance [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lazy-loading 'resources' on Instance uuid 7b305674-a656-44f5-9d67-cf927acf62f8 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T16:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1712628175',display_name='tempest-TestShelveInstance-server-1712628175',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1712628175',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOW9jV/hfeCpzsdHs7XFFab0aEiC4shK8n6mgWb67Xb6Nt74n6LbvjQ/6+PuuON3YH7tiHMWI9JqXUl0nbKyfsqdZj68N9HhRnUC/2LcKon0+DH15Pk3wLXB52HK/NZ4Q==',key_name='tempest-TestShelveInstance-622552020',keypairs=<?>,launch_index=0,launched_at=2023-08-09T17:02:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05969405da7a47968fe16aabc3724131',ramdisk_id='',reservation_id='r-ctyu5xzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2078233597',owner_user_name='tempest-TestShelveInstance-2078233597-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T17:02:44Z,user_data=None,user_id='00eda119bf8041d59b4cf94b02b4b1a0',uuid=7b305674-a656-44f5-9d67-cf927acf62f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Converting VIF {"id": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "address": "fa:16:3e:e3:fa:65", "network": {"id": "d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730408102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05969405da7a47968fe16aabc3724131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bce7a-06", "ovs_interfaceid": "969bce7a-0683-42cd-bae1-12ae87f2cf3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=969bce7a-0683-42cd-bae1-12ae87f2cf3b,network=Network(d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bce7a-06') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG os_vif [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=969bce7a-0683-42cd-bae1-12ae87f2cf3b,network=Network(d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bce7a-06') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap969bce7a-06, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:19 user nova-compute[73091]: INFO os_vif [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=969bce7a-0683-42cd-bae1-12ae87f2cf3b,network=Network(d6b5a539-24aa-4e1c-b7fd-e33efb1e6cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bce7a-06')
Aug 09 17:04:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byzNJqnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:04:19 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:04:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f8248e-95de-4779-9d57-de40db893bf1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53fc45b-f045-40de-a239-feda5e26aef8]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:04:19 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:04:19 user nova-compute[73091]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)
Aug 09 17:04:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:04:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:04:19 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:04:19 user nova-compute[73091]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 (non-flash)
Aug 09 17:04:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff08047f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[109a9cb3-8e77-4598-907d-56bf06061ace]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[753bc910-826a-4261-a19f-a9975e0dae08]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[17168f76-8752-4ed4-92e3-8481d1d1007a]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[538802cc-8cb4-4b5d-8fdb-3afa577c60d0]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO889045d1-85f312d3e3dcaa4d', '/dev/disk/by-id/scsi-23835663331326433', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_889045d1') {{(pid=83925) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 17:04:20 user nova-compute[73091]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO889045d1-85f312d3e3dcaa4d
Aug 09 17:04:20 user nova-compute[73091]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23835663331326433
Aug 09 17:04:20 user nova-compute[73091]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_889045d1
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e50b7c-85e8-4845-94f3-66b62eb45380]: (4, None) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[686a517c-1a2a-4c9d-a639-b3f65e3d6aa7]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b748133-3ef2-4876-9ad3-8bc381d85131]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2, portal: 172.16.0.220,3260]
Aug 09 17:04:20 user nova-compute[73091]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2, portal: 172.16.0.220,3260] successful.
Aug 09 17:04:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d410516-eabf-450f-b315-9b31d3909db2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e82332-0549-4a1c-819b-97c1fb62ad3f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] <== disconnect_volume: return (325ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 17:04:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Deleting instance files /opt/stack/data/nova/instances/7b305674-a656-44f5-9d67-cf927acf62f8_del
Aug 09 17:04:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Deletion of /opt/stack/data/nova/instances/7b305674-a656-44f5-9d67-cf927acf62f8_del complete
Aug 09 17:04:20 user nova-compute[73091]: INFO nova.compute.manager [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 09 17:04:20 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:04:21 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Took 0.72 seconds to deallocate network for instance.
Aug 09 17:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-f2989880-ec89-4e17-9cfb-88ee166a8686 req-921dbcc1-eb8a-4d3a-b842-ca086e72ddf6 service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received event network-vif-deleted-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received event network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] Acquiring lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] No waiting events found dispatching network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:04:21 user nova-compute[73091]: WARNING nova.compute.manager [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received unexpected event network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b for instance with vm_state active and task_state deleting.
Aug 09 17:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received event network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] Acquiring lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] No waiting events found dispatching network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:04:21 user nova-compute[73091]: WARNING nova.compute.manager [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received unexpected event network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b for instance with vm_state active and task_state deleting.
Aug 09 17:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received event network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] Acquiring lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] No waiting events found dispatching network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:04:21 user nova-compute[73091]: WARNING nova.compute.manager [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received unexpected event network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b for instance with vm_state active and task_state deleting.
Aug 09 17:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received event network-vif-unplugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] Acquiring lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] No waiting events found dispatching network-vif-unplugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received event network-vif-unplugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received event network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] Acquiring lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] Lock "7b305674-a656-44f5-9d67-cf927acf62f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] No waiting events found dispatching network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:04:21 user nova-compute[73091]: WARNING nova.compute.manager [req-da7209f5-f492-4f11-b76f-c6dcf509faf5 req-b0af1d65-4d9d-4698-80bf-31ba758feb3d service nova] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Received unexpected event network-vif-plugged-969bce7a-0683-42cd-bae1-12ae87f2cf3b for instance with vm_state active and task_state deleting.
Aug 09 17:04:21 user nova-compute[73091]: INFO nova.compute.manager [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Took 0.77 seconds to detach 1 volumes for instance.
Aug 09 17:04:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Deleting volume: 7d410516-eabf-450f-b315-9b31d3909db2 {{(pid=73091) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:04:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:04:22 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:04:22 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:04:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.210s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:04:22 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Deleted allocations for instance 7b305674-a656-44f5-9d67-cf927acf62f8
Aug 09 17:04:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-27f81562-ae8c-4565-8227-f105802f7272 tempest-TestShelveInstance-2078233597 tempest-TestShelveInstance-2078233597-project-member] Lock "7b305674-a656-44f5-9d67-cf927acf62f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.216s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:04:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:04:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:04:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:04:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:04:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:04:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:04:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 17:04:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-c3871ef4-45e7-4118-8227-e48cc857d481" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:04:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-c3871ef4-45e7-4118-8227-e48cc857d481" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:04:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:04:30 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid c3871ef4-45e7-4118-8227-e48cc857d481 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:04:31 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Updating instance_info_cache with network_info: [{"id": "1d3f6a45-6b36-4603-b510-442d6ba16232", "address": "fa:16:3e:78:8d:86", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3f6a45-6b", "ovs_interfaceid": "1d3f6a45-6b36-4603-b510-442d6ba16232", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:04:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-c3871ef4-45e7-4118-8227-e48cc857d481" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:04:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:04:34 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691600659.8591862, 7b305674-a656-44f5-9d67-cf927acf62f8 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:04:34 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] VM Stopped (Lifecycle Event)
Aug 09 17:04:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-aa11d297-ae47-4cfd-a13f-72782c6b7d77 None None] [instance: 7b305674-a656-44f5-9d67-cf927acf62f8] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:04:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:04:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:04:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:04:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:04:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:04:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:04:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:04:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:04:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:04:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 17:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:04:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 17:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:04:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:04:38 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:04:38 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:04:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8484MB free_disk=24.89211654663086GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c3871ef4-45e7-4118-8227-e48cc857d481 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 76055017-05ff-4ea7-ae9c-66d2e502e090 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance be5d7299-6eb0-4ba4-a2a3-f4c513168d68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 86938d92-2044-4f88-b2ea-f2e6711bd2d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing inventories for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Updating ProviderTree inventory for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Updating inventory in ProviderTree for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing aggregate associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing trait associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, traits: HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 17:04:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 17:04:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:04:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:04:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:04:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:04:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:04:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:04:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:04:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:04:52 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:04:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:04:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:05:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:06 user nova-compute[73091]: DEBUG nova.objects.instance [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'flavor' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:05:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:05:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquired lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:05:06 user nova-compute[73091]: DEBUG nova.network.neutron [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 17:05:06 user nova-compute[73091]: DEBUG nova.objects.instance [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'info_cache' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Updating instance_info_cache with network_info: [{"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Releasing lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:05:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Instance destroyed successfully.
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'resources' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1683471410',display_name='tempest-AttachVolumeTestJSON-server-1683471410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1683471410',id=46,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSqU7018x0ZKxU/TnR68mmpQfJ3/iIdN4gO2b9qKuQMylnJbXqCJVU8sCvfuom/2tN1tKX2DuUHbuYDqL1PZuoNGYX3mudz2G438ekxd/krtTvJFcZJCDSXUYHm9JgRDQ==',key_name='tempest-keypair-1988166130',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:57:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0cfa5b9d92df40d6bdfef6e8dfd3fad8',ramdisk_id='',reservation_id='r-nye9wi1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-99081524',owner_user_name='tempest-AttachVolumeTestJSON-99081524-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T17:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e945ea4724446e5a6ee92a6b4d24ff0',uuid=980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converting VIF {"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG os_vif [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c3038f5-c9, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:05:07 user nova-compute[73091]: INFO os_vif [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9')
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Start _get_guest_xml network_info=[{"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'numa_topology' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:05:07 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:05:07 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'vcpu_model' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1683471410',display_name='tempest-AttachVolumeTestJSON-server-1683471410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1683471410',id=46,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSqU7018x0ZKxU/TnR68mmpQfJ3/iIdN4gO2b9qKuQMylnJbXqCJVU8sCvfuom/2tN1tKX2DuUHbuYDqL1PZuoNGYX3mudz2G438ekxd/krtTvJFcZJCDSXUYHm9JgRDQ==',key_name='tempest-keypair-1988166130',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:57:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0cfa5b9d92df40d6bdfef6e8dfd3fad8',ramdisk_id='',reservation_id='r-nye9wi1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-99081524',owner_user_name='tempest-AttachVolumeTestJSON-99081524-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T17:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e945ea4724446e5a6ee92a6b4d24ff0',uuid=980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converting VIF {"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'pci_devices' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] End _get_guest_xml xml=<domain type="kvm">
Aug 09 17:05:07 user nova-compute[73091]:   <uuid>980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2</uuid>
Aug 09 17:05:07 user nova-compute[73091]:   <name>instance-0000002e</name>
Aug 09 17:05:07 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 17:05:07 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 17:05:07 user nova-compute[73091]:   <metadata>
Aug 09 17:05:07 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 17:05:07 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 17:05:07 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeTestJSON-server-1683471410</nova:name>
Aug 09 17:05:07 user nova-compute[73091]:       <nova:creationTime>2023-08-09 17:05:07</nova:creationTime>
Aug 09 17:05:07 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 17:05:07 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 17:05:07 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 17:05:07 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 17:05:07 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 17:05:07 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 17:05:07 user nova-compute[73091]:       </nova:flavor>
Aug 09 17:05:07 user nova-compute[73091]:       <nova:owner>
Aug 09 17:05:07 user nova-compute[73091]:         <nova:user uuid="2e945ea4724446e5a6ee92a6b4d24ff0">tempest-AttachVolumeTestJSON-99081524-project-member</nova:user>
Aug 09 17:05:07 user nova-compute[73091]:         <nova:project uuid="0cfa5b9d92df40d6bdfef6e8dfd3fad8">tempest-AttachVolumeTestJSON-99081524</nova:project>
Aug 09 17:05:07 user nova-compute[73091]:       </nova:owner>
Aug 09 17:05:07 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 17:05:07 user nova-compute[73091]:       <nova:ports>
Aug 09 17:05:07 user nova-compute[73091]:         <nova:port uuid="8c3038f5-c9cf-44e0-a2d5-5dee6e719d90">
Aug 09 17:05:07 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 17:05:07 user nova-compute[73091]:         </nova:port>
Aug 09 17:05:07 user nova-compute[73091]:       </nova:ports>
Aug 09 17:05:07 user nova-compute[73091]:     </nova:instance>
Aug 09 17:05:07 user nova-compute[73091]:   </metadata>
Aug 09 17:05:07 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 17:05:07 user nova-compute[73091]:     <system>
Aug 09 17:05:07 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 17:05:07 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 17:05:07 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 17:05:07 user nova-compute[73091]:       <entry name="serial">980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2</entry>
Aug 09 17:05:07 user nova-compute[73091]:       <entry name="uuid">980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2</entry>
Aug 09 17:05:07 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 17:05:07 user nova-compute[73091]:     </system>
Aug 09 17:05:07 user nova-compute[73091]:   </sysinfo>
Aug 09 17:05:07 user nova-compute[73091]:   <os>
Aug 09 17:05:07 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 17:05:07 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 17:05:07 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 17:05:07 user nova-compute[73091]:   </os>
Aug 09 17:05:07 user nova-compute[73091]:   <features>
Aug 09 17:05:07 user nova-compute[73091]:     <acpi/>
Aug 09 17:05:07 user nova-compute[73091]:     <apic/>
Aug 09 17:05:07 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 17:05:07 user nova-compute[73091]:   </features>
Aug 09 17:05:07 user nova-compute[73091]:   <clock offset="utc">
Aug 09 17:05:07 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 17:05:07 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 17:05:07 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 17:05:07 user nova-compute[73091]:   </clock>
Aug 09 17:05:07 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 17:05:07 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 17:05:07 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 17:05:07 user nova-compute[73091]:   </cpu>
Aug 09 17:05:07 user nova-compute[73091]:   <devices>
Aug 09 17:05:07 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 17:05:07 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 17:05:07 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk"/>
Aug 09 17:05:07 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 17:05:07 user nova-compute[73091]:     </disk>
Aug 09 17:05:07 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 17:05:07 user nova-compute[73091]:       <mac address="fa:16:3e:47:35:8e"/>
Aug 09 17:05:07 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 17:05:07 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 17:05:07 user nova-compute[73091]:       <target dev="tap8c3038f5-c9"/>
Aug 09 17:05:07 user nova-compute[73091]:     </interface>
Aug 09 17:05:07 user nova-compute[73091]:     <serial type="pty">
Aug 09 17:05:07 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/console.log" append="off"/>
Aug 09 17:05:07 user nova-compute[73091]:     </serial>
Aug 09 17:05:07 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 17:05:07 user nova-compute[73091]:     <video>
Aug 09 17:05:07 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 17:05:07 user nova-compute[73091]:     </video>
Aug 09 17:05:07 user nova-compute[73091]:     <rng model="virtio">
Aug 09 17:05:07 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 17:05:07 user nova-compute[73091]:     </rng>
Aug 09 17:05:07 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 17:05:07 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 17:05:07 user nova-compute[73091]:       <stats period="10"/>
Aug 09 17:05:07 user nova-compute[73091]:     </memballoon>
Aug 09 17:05:07 user nova-compute[73091]:   </devices>
Aug 09 17:05:07 user nova-compute[73091]: </domain>
Aug 09 17:05:07 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'trusted_certs' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.132s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Checking if we can resize image /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Cannot resize image /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'migration_context' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1683471410',display_name='tempest-AttachVolumeTestJSON-server-1683471410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1683471410',id=46,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSqU7018x0ZKxU/TnR68mmpQfJ3/iIdN4gO2b9qKuQMylnJbXqCJVU8sCvfuom/2tN1tKX2DuUHbuYDqL1PZuoNGYX3mudz2G438ekxd/krtTvJFcZJCDSXUYHm9JgRDQ==',key_name='tempest-keypair-1988166130',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:57:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0cfa5b9d92df40d6bdfef6e8dfd3fad8',ramdisk_id='',reservation_id='r-nye9wi1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-99081524',owner_user_name='tempest-AttachVolumeTestJSON-99081524-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T17:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e945ea4724446e5a6ee92a6b4d24ff0',uuid=980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converting VIF {"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG os_vif [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c3038f5-c9, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c3038f5-c9, col_values=(('external_ids', {'iface-id': '8c3038f5-c9cf-44e0-a2d5-5dee6e719d90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:35:8e', 'vm-uuid': '980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:05:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:07 user nova-compute[73091]: INFO os_vif [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9')
Aug 09 17:05:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-fb73068a-208c-49b5-a80c-73140380dff6 req-5f68e387-7e42-4e15-a53c-c12824ae50a0 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received event network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:05:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fb73068a-208c-49b5-a80c-73140380dff6 req-5f68e387-7e42-4e15-a53c-c12824ae50a0 service nova] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:05:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fb73068a-208c-49b5-a80c-73140380dff6 req-5f68e387-7e42-4e15-a53c-c12824ae50a0 service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:05:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fb73068a-208c-49b5-a80c-73140380dff6 req-5f68e387-7e42-4e15-a53c-c12824ae50a0 service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:05:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-fb73068a-208c-49b5-a80c-73140380dff6 req-5f68e387-7e42-4e15-a53c-c12824ae50a0 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] No waiting events found dispatching network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:05:09 user nova-compute[73091]: WARNING nova.compute.manager [req-fb73068a-208c-49b5-a80c-73140380dff6 req-5f68e387-7e42-4e15-a53c-c12824ae50a0 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received unexpected event network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 for instance with vm_state stopped and task_state powering-on.
Aug 09 17:05:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:11 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600711.29289, 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:05:11 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] VM Resumed (Lifecycle Event)
Aug 09 17:05:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 17:05:11 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Instance rebooted successfully.
Aug 09 17:05:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-494e49b8-5935-4e2d-8579-12d47a763a7c tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:05:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:05:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:05:11 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 09 17:05:11 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600711.294403, 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:05:11 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] VM Started (Lifecycle Event)
Aug 09 17:05:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:05:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:05:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-2772792b-bbe2-456f-b5db-d2ff3168845a req-87b62881-c4bc-474a-887b-b14dbd255039 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received event network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:05:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2772792b-bbe2-456f-b5db-d2ff3168845a req-87b62881-c4bc-474a-887b-b14dbd255039 service nova] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:05:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2772792b-bbe2-456f-b5db-d2ff3168845a req-87b62881-c4bc-474a-887b-b14dbd255039 service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:05:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2772792b-bbe2-456f-b5db-d2ff3168845a req-87b62881-c4bc-474a-887b-b14dbd255039 service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:05:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-2772792b-bbe2-456f-b5db-d2ff3168845a req-87b62881-c4bc-474a-887b-b14dbd255039 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] No waiting events found dispatching network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:05:11 user nova-compute[73091]: WARNING nova.compute.manager [req-2772792b-bbe2-456f-b5db-d2ff3168845a req-87b62881-c4bc-474a-887b-b14dbd255039 service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received unexpected event network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 for instance with vm_state active and task_state None.
Aug 09 17:05:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:05:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:05:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:05:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:05:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:05:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:17 user nova-compute[73091]: INFO nova.compute.manager [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Terminating instance
Aug 09 17:05:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-2b0e5319-2552-4a4e-8dc7-0959e2bcae96 req-fc096725-c868-4779-920c-f532cb9422d8 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received event network-vif-unplugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b0e5319-2552-4a4e-8dc7-0959e2bcae96 req-fc096725-c868-4779-920c-f532cb9422d8 service nova] Acquiring lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b0e5319-2552-4a4e-8dc7-0959e2bcae96 req-fc096725-c868-4779-920c-f532cb9422d8 service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b0e5319-2552-4a4e-8dc7-0959e2bcae96 req-fc096725-c868-4779-920c-f532cb9422d8 service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-2b0e5319-2552-4a4e-8dc7-0959e2bcae96 req-fc096725-c868-4779-920c-f532cb9422d8 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] No waiting events found dispatching network-vif-unplugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-2b0e5319-2552-4a4e-8dc7-0959e2bcae96 req-fc096725-c868-4779-920c-f532cb9422d8 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received event network-vif-unplugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:18 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Instance destroyed successfully.
Aug 09 17:05:18 user nova-compute[73091]: DEBUG nova.objects.instance [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'resources' on Instance uuid 86938d92-2044-4f88-b2ea-f2e6711bd2d4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:59:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1077072569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1077072569',id=48,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T17:01:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39308f2160f14a1cb5ee136458054726',ramdisk_id='',reservation_id='r-0q48u3yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T17:03:32Z,user_data=None,user_id='1b831573c2594072890b548abda013e3',uuid=86938d92-2044-4f88-b2ea-f2e6711bd2d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "address": "fa:16:3e:a7:60:45", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee82f5a2-a5", "ovs_interfaceid": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converting VIF {"id": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "address": "fa:16:3e:a7:60:45", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee82f5a2-a5", "ovs_interfaceid": "ee82f5a2-a587-4d5a-92b4-0a866e67c041", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:60:45,bridge_name='br-int',has_traffic_filtering=True,id=ee82f5a2-a587-4d5a-92b4-0a866e67c041,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee82f5a2-a5') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG os_vif [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:60:45,bridge_name='br-int',has_traffic_filtering=True,id=ee82f5a2-a587-4d5a-92b4-0a866e67c041,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee82f5a2-a5') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee82f5a2-a5, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:05:18 user nova-compute[73091]: INFO os_vif [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:60:45,bridge_name='br-int',has_traffic_filtering=True,id=ee82f5a2-a587-4d5a-92b4-0a866e67c041,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee82f5a2-a5')
Aug 09 17:05:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpUmOrHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:05:18 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:05:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f2446e-449a-4290-a12e-1232f1d2b5c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d756b7cb-334f-4fad-9d6e-e97087257383]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:05:18 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:05:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:05:18 user nova-compute[73091]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e (non-flash)
Aug 09 17:05:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0602027a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Removing single pathed devices sde {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84b70a6-870a-4b06-b86c-f4cb2e35c229]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b58b04-db1e-4831-94ef-e4306c972366]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[00457f90-1764-4cd5-9c8d-e09952bf9b38]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6f9c42-7f2f-433d-8bb5-74c71287cc65]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b64e01d8', '/dev/disk/by-id/scsi-23639326339616131', '/dev/disk/by-id/scsi-1SCST_BIOb64e01d8-692c9aa15723191f') {{(pid=83925) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49a692d-4131-4692-92a2-8366c7a11986]: (4, None) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5801be4e-548c-4827-b095-e653058bc6ec]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:05:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3d00be-f068-40b5-98f5-902b904c0b21]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:05:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e, portal: 172.16.0.220,3260]
Aug 09 17:05:19 user nova-compute[73091]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e, portal: 172.16.0.220,3260] successful.
Aug 09 17:05:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:05:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:486b2bbd-c3aa-4b52-aab7-15933bf1a35e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[72efd1ad-3545-49e1-8e66-b583498d5f52]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:05:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:05:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:05:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] <== disconnect_volume: return (309ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:05:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 17:05:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Deleting instance files /opt/stack/data/nova/instances/86938d92-2044-4f88-b2ea-f2e6711bd2d4_del
Aug 09 17:05:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Deletion of /opt/stack/data/nova/instances/86938d92-2044-4f88-b2ea-f2e6711bd2d4_del complete
Aug 09 17:05:19 user nova-compute[73091]: INFO nova.compute.manager [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 09 17:05:19 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 17:05:19 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 17:05:19 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 17:05:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:19 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:05:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-9ca4b57a-874a-40c3-8485-779b82ebecb1 req-3242251c-58c1-4852-8ccd-d25619ace9ed service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received event network-vif-deleted-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:05:19 user nova-compute[73091]: INFO nova.compute.manager [req-9ca4b57a-874a-40c3-8485-779b82ebecb1 req-3242251c-58c1-4852-8ccd-d25619ace9ed service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Neutron deleted interface ee82f5a2-a587-4d5a-92b4-0a866e67c041; detaching it from the instance and deleting it from the info cache
Aug 09 17:05:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-9ca4b57a-874a-40c3-8485-779b82ebecb1 req-3242251c-58c1-4852-8ccd-d25619ace9ed service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:05:19 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Took 0.87 seconds to deallocate network for instance.
Aug 09 17:05:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-9ca4b57a-874a-40c3-8485-779b82ebecb1 req-3242251c-58c1-4852-8ccd-d25619ace9ed service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Detach interface failed, port_id=ee82f5a2-a587-4d5a-92b4-0a866e67c041, reason: Instance 86938d92-2044-4f88-b2ea-f2e6711bd2d4 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 17:05:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-0584f797-6b4d-4540-b30b-80bf4b31fdd1 req-9c27ae7b-1aa3-4492-8d96-f5c7c58ecb48 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:05:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0584f797-6b4d-4540-b30b-80bf4b31fdd1 req-9c27ae7b-1aa3-4492-8d96-f5c7c58ecb48 service nova] Acquiring lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:05:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0584f797-6b4d-4540-b30b-80bf4b31fdd1 req-9c27ae7b-1aa3-4492-8d96-f5c7c58ecb48 service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:05:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0584f797-6b4d-4540-b30b-80bf4b31fdd1 req-9c27ae7b-1aa3-4492-8d96-f5c7c58ecb48 service nova] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:05:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-0584f797-6b4d-4540-b30b-80bf4b31fdd1 req-9c27ae7b-1aa3-4492-8d96-f5c7c58ecb48 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] No waiting events found dispatching network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:05:20 user nova-compute[73091]: WARNING nova.compute.manager [req-0584f797-6b4d-4540-b30b-80bf4b31fdd1 req-9c27ae7b-1aa3-4492-8d96-f5c7c58ecb48 service nova] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Received unexpected event network-vif-plugged-ee82f5a2-a587-4d5a-92b4-0a866e67c041 for instance with vm_state active and task_state deleting.
Aug 09 17:05:20 user nova-compute[73091]: INFO nova.compute.manager [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Took 0.81 seconds to detach 1 volumes for instance.
Aug 09 17:05:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:05:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:05:21 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:05:21 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:05:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:05:21 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Deleted allocations for instance 86938d92-2044-4f88-b2ea-f2e6711bd2d4
Aug 09 17:05:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-07083a42-86c1-406d-833a-4be96c3a421e tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "86938d92-2044-4f88-b2ea-f2e6711bd2d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.281s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:05:21 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:05:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:05:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:05:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:05:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:05:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:05:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:05:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:05:32 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:05:33 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Updating instance_info_cache with network_info: [{"id": "58bf6094-42a8-4567-abea-27c63a57cf8a", "address": "fa:16:3e:f3:dd:72", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf6094-42", "ovs_interfaceid": "58bf6094-42a8-4567-abea-27c63a57cf8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:05:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-76055017-05ff-4ea7-ae9c-66d2e502e090" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:05:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:05:33 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691600718.6877732, 86938d92-2044-4f88-b2ea-f2e6711bd2d4 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:05:33 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] VM Stopped (Lifecycle Event)
Aug 09 17:05:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ea80c202-ef56-4f04-94b7-bad324d830c8 None None] [instance: 86938d92-2044-4f88-b2ea-f2e6711bd2d4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:05:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 17:05:36 user nova-compute[73091]: INFO nova.compute.claims [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Claim successful on node user
Aug 09 17:05:36 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 17:05:36 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 17:05:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG nova.policy [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ee5c215b9ee41ae87e81ae22496049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba31c994632452891e5aa16005d62d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 17:05:36 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Creating image(s)
Aug 09 17:05:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "/opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "/opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:05:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk 1073741824" returned: 0 in 0.050s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Cannot resize image /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG nova.objects.instance [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lazy-loading 'migration_context' on Instance uuid 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Ensure instance console log exists: /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Successfully created port: 43cf267f-df5c-4b9e-b950-7837c9643aab {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:05:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:05:38 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:05:38 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8437MB free_disk=24.888744354248047GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Successfully updated port: 43cf267f-df5c-4b9e-b950-7837c9643aab {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquired lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c3871ef4-45e7-4118-8227-e48cc857d481 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 76055017-05ff-4ea7-ae9c-66d2e502e090 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance be5d7299-6eb0-4ba4-a2a3-f4c513168d68 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-125ebfc9-41d8-40f4-a614-f92e492787c6 req-b532b69d-12ba-41fd-a62b-7af36ff8528c service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Received event network-changed-43cf267f-df5c-4b9e-b950-7837c9643aab {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-125ebfc9-41d8-40f4-a614-f92e492787c6 req-b532b69d-12ba-41fd-a62b-7af36ff8528c service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Refreshing instance network info cache due to event network-changed-43cf267f-df5c-4b9e-b950-7837c9643aab. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-125ebfc9-41d8-40f4-a614-f92e492787c6 req-b532b69d-12ba-41fd-a62b-7af36ff8528c service nova] Acquiring lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Updating instance_info_cache with network_info: [{"id": "43cf267f-df5c-4b9e-b950-7837c9643aab", "address": "fa:16:3e:55:df:10", "network": {"id": "d6efa64f-c1e2-438e-82e7-3760c89c8492", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2060056810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba31c994632452891e5aa16005d62d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cf267f-df", "ovs_interfaceid": "43cf267f-df5c-4b9e-b950-7837c9643aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Releasing lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Instance network_info: |[{"id": "43cf267f-df5c-4b9e-b950-7837c9643aab", "address": "fa:16:3e:55:df:10", "network": {"id": "d6efa64f-c1e2-438e-82e7-3760c89c8492", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2060056810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba31c994632452891e5aa16005d62d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cf267f-df", "ovs_interfaceid": "43cf267f-df5c-4b9e-b950-7837c9643aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-125ebfc9-41d8-40f4-a614-f92e492787c6 req-b532b69d-12ba-41fd-a62b-7af36ff8528c service nova] Acquired lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.network.neutron [req-125ebfc9-41d8-40f4-a614-f92e492787c6 req-b532b69d-12ba-41fd-a62b-7af36ff8528c service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Refreshing network info cache for port 43cf267f-df5c-4b9e-b950-7837c9643aab {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Start _get_guest_xml network_info=[{"id": "43cf267f-df5c-4b9e-b950-7837c9643aab", "address": "fa:16:3e:55:df:10", "network": {"id": "d6efa64f-c1e2-438e-82e7-3760c89c8492", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2060056810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba31c994632452891e5aa16005d62d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cf267f-df", "ovs_interfaceid": "43cf267f-df5c-4b9e-b950-7837c9643aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 17:05:38 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:05:38 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T17:05:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-599722711',display_name='tempest-SnapshotDataIntegrityTests-server-599722711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-599722711',id=49,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYEmIeK5mTSazElT7Kf7hm6KPY/c24FIn+rE1AhVVwXjRAuv0EuSXdJ7A/gh/IZp2/NAO27aLrobzQlObPh5zoLFEE0q6YmOG2vWfhp5rRFuU/SOqiXZwz0UiTxbYjZ/g==',key_name='tempest-keypair-1751868432',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ba31c994632452891e5aa16005d62d8',ramdisk_id='',reservation_id='r-hmot0w5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1716172847',owner_user_name='tempest-SnapshotDataIntegrityTests-1716172847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T17:05:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ee5c215b9ee41ae87e81ae22496049a',uuid=8c5cd921-9e64-475a-b796-7e6f6b95f07f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43cf267f-df5c-4b9e-b950-7837c9643aab", "address": "fa:16:3e:55:df:10", "network": {"id": "d6efa64f-c1e2-438e-82e7-3760c89c8492", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2060056810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba31c994632452891e5aa16005d62d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cf267f-df", "ovs_interfaceid": "43cf267f-df5c-4b9e-b950-7837c9643aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Converting VIF {"id": "43cf267f-df5c-4b9e-b950-7837c9643aab", "address": "fa:16:3e:55:df:10", "network": {"id": "d6efa64f-c1e2-438e-82e7-3760c89c8492", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2060056810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba31c994632452891e5aa16005d62d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cf267f-df", "ovs_interfaceid": "43cf267f-df5c-4b9e-b950-7837c9643aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:df:10,bridge_name='br-int',has_traffic_filtering=True,id=43cf267f-df5c-4b9e-b950-7837c9643aab,network=Network(d6efa64f-c1e2-438e-82e7-3760c89c8492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43cf267f-df') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.objects.instance [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 17:05:38 user nova-compute[73091]:   <uuid>8c5cd921-9e64-475a-b796-7e6f6b95f07f</uuid>
Aug 09 17:05:38 user nova-compute[73091]:   <name>instance-00000031</name>
Aug 09 17:05:38 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 17:05:38 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 17:05:38 user nova-compute[73091]:   <metadata>
Aug 09 17:05:38 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 17:05:38 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 17:05:38 user nova-compute[73091]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-599722711</nova:name>
Aug 09 17:05:38 user nova-compute[73091]:       <nova:creationTime>2023-08-09 17:05:38</nova:creationTime>
Aug 09 17:05:38 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 17:05:38 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 17:05:38 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 17:05:38 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 17:05:38 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 17:05:38 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 17:05:38 user nova-compute[73091]:       </nova:flavor>
Aug 09 17:05:38 user nova-compute[73091]:       <nova:owner>
Aug 09 17:05:38 user nova-compute[73091]:         <nova:user uuid="8ee5c215b9ee41ae87e81ae22496049a">tempest-SnapshotDataIntegrityTests-1716172847-project-member</nova:user>
Aug 09 17:05:38 user nova-compute[73091]:         <nova:project uuid="2ba31c994632452891e5aa16005d62d8">tempest-SnapshotDataIntegrityTests-1716172847</nova:project>
Aug 09 17:05:38 user nova-compute[73091]:       </nova:owner>
Aug 09 17:05:38 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 17:05:38 user nova-compute[73091]:       <nova:ports>
Aug 09 17:05:38 user nova-compute[73091]:         <nova:port uuid="43cf267f-df5c-4b9e-b950-7837c9643aab">
Aug 09 17:05:38 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 17:05:38 user nova-compute[73091]:         </nova:port>
Aug 09 17:05:38 user nova-compute[73091]:       </nova:ports>
Aug 09 17:05:38 user nova-compute[73091]:     </nova:instance>
Aug 09 17:05:38 user nova-compute[73091]:   </metadata>
Aug 09 17:05:38 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 17:05:38 user nova-compute[73091]:     <system>
Aug 09 17:05:38 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 17:05:38 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 17:05:38 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 17:05:38 user nova-compute[73091]:       <entry name="serial">8c5cd921-9e64-475a-b796-7e6f6b95f07f</entry>
Aug 09 17:05:38 user nova-compute[73091]:       <entry name="uuid">8c5cd921-9e64-475a-b796-7e6f6b95f07f</entry>
Aug 09 17:05:38 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 17:05:38 user nova-compute[73091]:     </system>
Aug 09 17:05:38 user nova-compute[73091]:   </sysinfo>
Aug 09 17:05:38 user nova-compute[73091]:   <os>
Aug 09 17:05:38 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 17:05:38 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 17:05:38 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 17:05:38 user nova-compute[73091]:   </os>
Aug 09 17:05:38 user nova-compute[73091]:   <features>
Aug 09 17:05:38 user nova-compute[73091]:     <acpi/>
Aug 09 17:05:38 user nova-compute[73091]:     <apic/>
Aug 09 17:05:38 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 17:05:38 user nova-compute[73091]:   </features>
Aug 09 17:05:38 user nova-compute[73091]:   <clock offset="utc">
Aug 09 17:05:38 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 17:05:38 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 17:05:38 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 17:05:38 user nova-compute[73091]:   </clock>
Aug 09 17:05:38 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 17:05:38 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 17:05:38 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 17:05:38 user nova-compute[73091]:   </cpu>
Aug 09 17:05:38 user nova-compute[73091]:   <devices>
Aug 09 17:05:38 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 17:05:38 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 17:05:38 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk"/>
Aug 09 17:05:38 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 17:05:38 user nova-compute[73091]:     </disk>
Aug 09 17:05:38 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 17:05:38 user nova-compute[73091]:       <mac address="fa:16:3e:55:df:10"/>
Aug 09 17:05:38 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 17:05:38 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 17:05:38 user nova-compute[73091]:       <target dev="tap43cf267f-df"/>
Aug 09 17:05:38 user nova-compute[73091]:     </interface>
Aug 09 17:05:38 user nova-compute[73091]:     <serial type="pty">
Aug 09 17:05:38 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/console.log" append="off"/>
Aug 09 17:05:38 user nova-compute[73091]:     </serial>
Aug 09 17:05:38 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 17:05:38 user nova-compute[73091]:     <video>
Aug 09 17:05:38 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 17:05:38 user nova-compute[73091]:     </video>
Aug 09 17:05:38 user nova-compute[73091]:     <rng model="virtio">
Aug 09 17:05:38 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 17:05:38 user nova-compute[73091]:     </rng>
Aug 09 17:05:38 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 17:05:38 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 17:05:38 user nova-compute[73091]:       <stats period="10"/>
Aug 09 17:05:38 user nova-compute[73091]:     </memballoon>
Aug 09 17:05:38 user nova-compute[73091]:   </devices>
Aug 09 17:05:38 user nova-compute[73091]: </domain>
Aug 09 17:05:38 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T17:05:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-599722711',display_name='tempest-SnapshotDataIntegrityTests-server-599722711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-599722711',id=49,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYEmIeK5mTSazElT7Kf7hm6KPY/c24FIn+rE1AhVVwXjRAuv0EuSXdJ7A/gh/IZp2/NAO27aLrobzQlObPh5zoLFEE0q6YmOG2vWfhp5rRFuU/SOqiXZwz0UiTxbYjZ/g==',key_name='tempest-keypair-1751868432',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ba31c994632452891e5aa16005d62d8',ramdisk_id='',reservation_id='r-hmot0w5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1716172847',owner_user_name='tempest-SnapshotDataIntegrityTests-1716172847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T17:05:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ee5c215b9ee41ae87e81ae22496049a',uuid=8c5cd921-9e64-475a-b796-7e6f6b95f07f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43cf267f-df5c-4b9e-b950-7837c9643aab", "address": "fa:16:3e:55:df:10", "network": {"id": "d6efa64f-c1e2-438e-82e7-3760c89c8492", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2060056810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba31c994632452891e5aa16005d62d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cf267f-df", "ovs_interfaceid": "43cf267f-df5c-4b9e-b950-7837c9643aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Converting VIF {"id": "43cf267f-df5c-4b9e-b950-7837c9643aab", "address": "fa:16:3e:55:df:10", "network": {"id": "d6efa64f-c1e2-438e-82e7-3760c89c8492", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2060056810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba31c994632452891e5aa16005d62d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cf267f-df", "ovs_interfaceid": "43cf267f-df5c-4b9e-b950-7837c9643aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:df:10,bridge_name='br-int',has_traffic_filtering=True,id=43cf267f-df5c-4b9e-b950-7837c9643aab,network=Network(d6efa64f-c1e2-438e-82e7-3760c89c8492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43cf267f-df') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG os_vif [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:df:10,bridge_name='br-int',has_traffic_filtering=True,id=43cf267f-df5c-4b9e-b950-7837c9643aab,network=Network(d6efa64f-c1e2-438e-82e7-3760c89c8492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43cf267f-df') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43cf267f-df, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap43cf267f-df, col_values=(('external_ids', {'iface-id': '43cf267f-df5c-4b9e-b950-7837c9643aab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:df:10', 'vm-uuid': '8c5cd921-9e64-475a-b796-7e6f6b95f07f'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:38 user nova-compute[73091]: INFO os_vif [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:df:10,bridge_name='br-int',has_traffic_filtering=True,id=43cf267f-df5c-4b9e-b950-7837c9643aab,network=Network(d6efa64f-c1e2-438e-82e7-3760c89c8492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43cf267f-df')
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:05:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] No VIF found with MAC fa:16:3e:55:df:10, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 17:05:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-125ebfc9-41d8-40f4-a614-f92e492787c6 req-b532b69d-12ba-41fd-a62b-7af36ff8528c service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Updated VIF entry in instance network info cache for port 43cf267f-df5c-4b9e-b950-7837c9643aab. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 17:05:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-125ebfc9-41d8-40f4-a614-f92e492787c6 req-b532b69d-12ba-41fd-a62b-7af36ff8528c service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Updating instance_info_cache with network_info: [{"id": "43cf267f-df5c-4b9e-b950-7837c9643aab", "address": "fa:16:3e:55:df:10", "network": {"id": "d6efa64f-c1e2-438e-82e7-3760c89c8492", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2060056810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba31c994632452891e5aa16005d62d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cf267f-df", "ovs_interfaceid": "43cf267f-df5c-4b9e-b950-7837c9643aab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:05:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-125ebfc9-41d8-40f4-a614-f92e492787c6 req-b532b69d-12ba-41fd-a62b-7af36ff8528c service nova] Releasing lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:05:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:05:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:05:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-2afcdda4-c9b1-49ea-9c06-02dba4856b64 req-cc133738-8bce-469a-83d0-8b949aecd676 service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Received event network-vif-plugged-43cf267f-df5c-4b9e-b950-7837c9643aab {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:05:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2afcdda4-c9b1-49ea-9c06-02dba4856b64 req-cc133738-8bce-469a-83d0-8b949aecd676 service nova] Acquiring lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:05:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2afcdda4-c9b1-49ea-9c06-02dba4856b64 req-cc133738-8bce-469a-83d0-8b949aecd676 service nova] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:05:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2afcdda4-c9b1-49ea-9c06-02dba4856b64 req-cc133738-8bce-469a-83d0-8b949aecd676 service nova] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:05:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-2afcdda4-c9b1-49ea-9c06-02dba4856b64 req-cc133738-8bce-469a-83d0-8b949aecd676 service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] No waiting events found dispatching network-vif-plugged-43cf267f-df5c-4b9e-b950-7837c9643aab {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:05:40 user nova-compute[73091]: WARNING nova.compute.manager [req-2afcdda4-c9b1-49ea-9c06-02dba4856b64 req-cc133738-8bce-469a-83d0-8b949aecd676 service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Received unexpected event network-vif-plugged-43cf267f-df5c-4b9e-b950-7837c9643aab for instance with vm_state building and task_state spawning.
Aug 09 17:05:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:42 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600742.514524, 8c5cd921-9e64-475a-b796-7e6f6b95f07f => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:05:42 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] VM Resumed (Lifecycle Event)
Aug 09 17:05:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 17:05:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 17:05:42 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Instance spawned successfully.
Aug 09 17:05:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 17:05:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:05:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:05:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:05:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:05:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:05:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:05:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:05:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:05:42 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 17:05:42 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600742.5179074, 8c5cd921-9e64-475a-b796-7e6f6b95f07f => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:05:42 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] VM Started (Lifecycle Event)
Aug 09 17:05:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:05:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:05:42 user nova-compute[73091]: INFO nova.compute.manager [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Took 5.82 seconds to spawn the instance on the hypervisor.
Aug 09 17:05:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:05:42 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 17:05:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-05cce1fa-a65e-4fcc-b814-a7266cbc09af req-ea114319-3bcd-4df4-a31b-e979592b42c5 service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Received event network-vif-plugged-43cf267f-df5c-4b9e-b950-7837c9643aab {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:05:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-05cce1fa-a65e-4fcc-b814-a7266cbc09af req-ea114319-3bcd-4df4-a31b-e979592b42c5 service nova] Acquiring lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:05:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-05cce1fa-a65e-4fcc-b814-a7266cbc09af req-ea114319-3bcd-4df4-a31b-e979592b42c5 service nova] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:05:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-05cce1fa-a65e-4fcc-b814-a7266cbc09af req-ea114319-3bcd-4df4-a31b-e979592b42c5 service nova] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:05:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-05cce1fa-a65e-4fcc-b814-a7266cbc09af req-ea114319-3bcd-4df4-a31b-e979592b42c5 service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] No waiting events found dispatching network-vif-plugged-43cf267f-df5c-4b9e-b950-7837c9643aab {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:05:42 user nova-compute[73091]: WARNING nova.compute.manager [req-05cce1fa-a65e-4fcc-b814-a7266cbc09af req-ea114319-3bcd-4df4-a31b-e979592b42c5 service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Received unexpected event network-vif-plugged-43cf267f-df5c-4b9e-b950-7837c9643aab for instance with vm_state building and task_state spawning.
Aug 09 17:05:42 user nova-compute[73091]: INFO nova.compute.manager [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Took 6.41 seconds to build instance.
Aug 09 17:05:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-944fb14d-115b-4f49-9254-618535655044 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.507s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:05:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:44 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:05:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:05:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:05:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:05:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:05:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:05:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:06:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:06:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:06:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:06:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:06:08 user nova-compute[73091]: INFO nova.compute.manager [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Terminating instance
Aug 09 17:06:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 17:06:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-f32203b7-cdc9-457d-b893-8b023de65c1e req-7c742edd-adca-4157-a289-3931ae0f1c64 service nova] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Received event network-vif-unplugged-e1b7f229-903b-4665-bc7c-04cb578e7140 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:06:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f32203b7-cdc9-457d-b893-8b023de65c1e req-7c742edd-adca-4157-a289-3931ae0f1c64 service nova] Acquiring lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:06:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f32203b7-cdc9-457d-b893-8b023de65c1e req-7c742edd-adca-4157-a289-3931ae0f1c64 service nova] Lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:06:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f32203b7-cdc9-457d-b893-8b023de65c1e req-7c742edd-adca-4157-a289-3931ae0f1c64 service nova] Lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:06:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-f32203b7-cdc9-457d-b893-8b023de65c1e req-7c742edd-adca-4157-a289-3931ae0f1c64 service nova] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] No waiting events found dispatching network-vif-unplugged-e1b7f229-903b-4665-bc7c-04cb578e7140 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:06:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-f32203b7-cdc9-457d-b893-8b023de65c1e req-7c742edd-adca-4157-a289-3931ae0f1c64 service nova] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Received event network-vif-unplugged-e1b7f229-903b-4665-bc7c-04cb578e7140 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 17:06:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:09 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Instance destroyed successfully.
Aug 09 17:06:09 user nova-compute[73091]: DEBUG nova.objects.instance [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'resources' on Instance uuid be5d7299-6eb0-4ba4-a2a3-f4c513168d68 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:06:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:56:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-50644406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-50644406',id=45,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:56:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39308f2160f14a1cb5ee136458054726',ramdisk_id='',reservation_id='r-jtiqe8fu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:58:43Z,user_data=None,user_id='1b831573c2594072890b548abda013e3',uuid=be5d7299-6eb0-4ba4-a2a3-f4c513168d68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1b7f229-903b-4665-bc7c-04cb578e7140", "address": "fa:16:3e:08:85:51", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b7f229-90", "ovs_interfaceid": "e1b7f229-903b-4665-bc7c-04cb578e7140", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 17:06:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converting VIF {"id": "e1b7f229-903b-4665-bc7c-04cb578e7140", "address": "fa:16:3e:08:85:51", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1b7f229-90", "ovs_interfaceid": "e1b7f229-903b-4665-bc7c-04cb578e7140", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:06:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:85:51,bridge_name='br-int',has_traffic_filtering=True,id=e1b7f229-903b-4665-bc7c-04cb578e7140,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b7f229-90') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:06:09 user nova-compute[73091]: DEBUG os_vif [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:85:51,bridge_name='br-int',has_traffic_filtering=True,id=e1b7f229-903b-4665-bc7c-04cb578e7140,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b7f229-90') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 17:06:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1b7f229-90, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:06:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:06:09 user nova-compute[73091]: INFO os_vif [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:85:51,bridge_name='br-int',has_traffic_filtering=True,id=e1b7f229-903b-4665-bc7c-04cb578e7140,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1b7f229-90')
Aug 09 17:06:09 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Deleting instance files /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68_del
Aug 09 17:06:09 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Deletion of /opt/stack/data/nova/instances/be5d7299-6eb0-4ba4-a2a3-f4c513168d68_del complete
Aug 09 17:06:09 user nova-compute[73091]: INFO nova.compute.manager [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Took 0.65 seconds to destroy the instance on the hypervisor.
Aug 09 17:06:09 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 17:06:09 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 17:06:09 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 17:06:09 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:06:09 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Took 0.52 seconds to deallocate network for instance.
Aug 09 17:06:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:06:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:06:10 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:06:10 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:06:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:06:10 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Deleted allocations for instance be5d7299-6eb0-4ba4-a2a3-f4c513168d68
Aug 09 17:06:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-85808079-67d2-47d9-bdcc-92fd5c2be379 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.533s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:06:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-b6e570cb-81ba-45ee-80a0-a4d3c9d429ab req-b81ca3a9-1f5c-47b3-8bfc-6daa275af151 service nova] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Received event network-vif-plugged-e1b7f229-903b-4665-bc7c-04cb578e7140 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:06:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b6e570cb-81ba-45ee-80a0-a4d3c9d429ab req-b81ca3a9-1f5c-47b3-8bfc-6daa275af151 service nova] Acquiring lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:06:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b6e570cb-81ba-45ee-80a0-a4d3c9d429ab req-b81ca3a9-1f5c-47b3-8bfc-6daa275af151 service nova] Lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:06:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b6e570cb-81ba-45ee-80a0-a4d3c9d429ab req-b81ca3a9-1f5c-47b3-8bfc-6daa275af151 service nova] Lock "be5d7299-6eb0-4ba4-a2a3-f4c513168d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:06:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-b6e570cb-81ba-45ee-80a0-a4d3c9d429ab req-b81ca3a9-1f5c-47b3-8bfc-6daa275af151 service nova] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] No waiting events found dispatching network-vif-plugged-e1b7f229-903b-4665-bc7c-04cb578e7140 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:06:11 user nova-compute[73091]: WARNING nova.compute.manager [req-b6e570cb-81ba-45ee-80a0-a4d3c9d429ab req-b81ca3a9-1f5c-47b3-8bfc-6daa275af151 service nova] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Received unexpected event network-vif-plugged-e1b7f229-903b-4665-bc7c-04cb578e7140 for instance with vm_state deleted and task_state None.
Aug 09 17:06:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-b6e570cb-81ba-45ee-80a0-a4d3c9d429ab req-b81ca3a9-1f5c-47b3-8bfc-6daa275af151 service nova] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Received event network-vif-deleted-e1b7f229-903b-4665-bc7c-04cb578e7140 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:06:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:06:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:06:24 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691600769.3003488, be5d7299-6eb0-4ba4-a2a3-f4c513168d68 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:06:24 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] VM Stopped (Lifecycle Event)
Aug 09 17:06:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-acd225f1-1438-4f1e-a30d-ab3976ff518c None None] [instance: be5d7299-6eb0-4ba4-a2a3-f4c513168d68] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:06:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:06:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:06:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:06:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:06:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:06:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:06:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:06:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:06:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:06:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:06:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:06:32 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:06:33 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Updating instance_info_cache with network_info: [{"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:06:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:06:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:06:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:06:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:06:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:06:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:06:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:06:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:06:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:06:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 17:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:06:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:06:38 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:06:38 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:06:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8472MB free_disk=24.984542846679688GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:06:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c3871ef4-45e7-4118-8227-e48cc857d481 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:06:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 76055017-05ff-4ea7-ae9c-66d2e502e090 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:06:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:06:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:06:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:06:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:06:38 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:06:38 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:06:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:06:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:06:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:06:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:06:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:06:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:06:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:06:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:06:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:06:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:06:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:06:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:06:57 user nova-compute[73091]: INFO nova.compute.manager [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Terminating instance
Aug 09 17:06:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 17:06:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-25af4219-f278-432e-a7b2-e0496f66349e req-1581b1f5-e118-4263-b0be-346b521ea8fa service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received event network-vif-unplugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:06:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-25af4219-f278-432e-a7b2-e0496f66349e req-1581b1f5-e118-4263-b0be-346b521ea8fa service nova] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:06:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-25af4219-f278-432e-a7b2-e0496f66349e req-1581b1f5-e118-4263-b0be-346b521ea8fa service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:06:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-25af4219-f278-432e-a7b2-e0496f66349e req-1581b1f5-e118-4263-b0be-346b521ea8fa service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:06:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-25af4219-f278-432e-a7b2-e0496f66349e req-1581b1f5-e118-4263-b0be-346b521ea8fa service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] No waiting events found dispatching network-vif-unplugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:06:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-25af4219-f278-432e-a7b2-e0496f66349e req-1581b1f5-e118-4263-b0be-346b521ea8fa service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received event network-vif-unplugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 17:06:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Instance destroyed successfully.
Aug 09 17:06:58 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'resources' on Instance uuid 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:06:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1683471410',display_name='tempest-AttachVolumeTestJSON-server-1683471410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1683471410',id=46,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSqU7018x0ZKxU/TnR68mmpQfJ3/iIdN4gO2b9qKuQMylnJbXqCJVU8sCvfuom/2tN1tKX2DuUHbuYDqL1PZuoNGYX3mudz2G438ekxd/krtTvJFcZJCDSXUYHm9JgRDQ==',key_name='tempest-keypair-1988166130',keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:57:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cfa5b9d92df40d6bdfef6e8dfd3fad8',ramdisk_id='',reservation_id='r-nye9wi1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-99081524',owner_user_name='tempest-AttachVolumeTestJSON-99081524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T17:05:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e945ea4724446e5a6ee92a6b4d24ff0',uuid=980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 17:06:58 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converting VIF {"id": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "address": "fa:16:3e:47:35:8e", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c3038f5-c9", "ovs_interfaceid": "8c3038f5-c9cf-44e0-a2d5-5dee6e719d90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:06:58 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:06:58 user nova-compute[73091]: DEBUG os_vif [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 17:06:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c3038f5-c9, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:06:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:06:58 user nova-compute[73091]: INFO os_vif [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:35:8e,bridge_name='br-int',has_traffic_filtering=True,id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c3038f5-c9')
Aug 09 17:06:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Deleting instance files /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2_del
Aug 09 17:06:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Deletion of /opt/stack/data/nova/instances/980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2_del complete
Aug 09 17:06:58 user nova-compute[73091]: INFO nova.compute.manager [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 09 17:06:58 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 17:06:58 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 17:06:58 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 17:06:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "76055017-05ff-4ea7-ae9c-66d2e502e090" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:06:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:06:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:06:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:06:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:06:59 user nova-compute[73091]: INFO nova.compute.manager [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Terminating instance
Aug 09 17:06:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 17:06:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:06:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-12d57a05-3176-4408-8833-659e2a4b512c req-3559f248-d8a8-448a-8bb3-d9829a2bd1ce service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received event network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-12d57a05-3176-4408-8833-659e2a4b512c req-3559f248-d8a8-448a-8bb3-d9829a2bd1ce service nova] Acquiring lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-12d57a05-3176-4408-8833-659e2a4b512c req-3559f248-d8a8-448a-8bb3-d9829a2bd1ce service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-12d57a05-3176-4408-8833-659e2a4b512c req-3559f248-d8a8-448a-8bb3-d9829a2bd1ce service nova] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-12d57a05-3176-4408-8833-659e2a4b512c req-3559f248-d8a8-448a-8bb3-d9829a2bd1ce service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] No waiting events found dispatching network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:07:00 user nova-compute[73091]: WARNING nova.compute.manager [req-12d57a05-3176-4408-8833-659e2a4b512c req-3559f248-d8a8-448a-8bb3-d9829a2bd1ce service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received unexpected event network-vif-plugged-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 for instance with vm_state active and task_state deleting.
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-12d57a05-3176-4408-8833-659e2a4b512c req-3559f248-d8a8-448a-8bb3-d9829a2bd1ce service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received event network-vif-unplugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-12d57a05-3176-4408-8833-659e2a4b512c req-3559f248-d8a8-448a-8bb3-d9829a2bd1ce service nova] Acquiring lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-12d57a05-3176-4408-8833-659e2a4b512c req-3559f248-d8a8-448a-8bb3-d9829a2bd1ce service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-12d57a05-3176-4408-8833-659e2a4b512c req-3559f248-d8a8-448a-8bb3-d9829a2bd1ce service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-12d57a05-3176-4408-8833-659e2a4b512c req-3559f248-d8a8-448a-8bb3-d9829a2bd1ce service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] No waiting events found dispatching network-vif-unplugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-12d57a05-3176-4408-8833-659e2a4b512c req-3559f248-d8a8-448a-8bb3-d9829a2bd1ce service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received event network-vif-unplugged-58bf6094-42a8-4567-abea-27c63a57cf8a for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-12d57a05-3176-4408-8833-659e2a4b512c req-3559f248-d8a8-448a-8bb3-d9829a2bd1ce service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received event network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-12d57a05-3176-4408-8833-659e2a4b512c req-3559f248-d8a8-448a-8bb3-d9829a2bd1ce service nova] Acquiring lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-12d57a05-3176-4408-8833-659e2a4b512c req-3559f248-d8a8-448a-8bb3-d9829a2bd1ce service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-12d57a05-3176-4408-8833-659e2a4b512c req-3559f248-d8a8-448a-8bb3-d9829a2bd1ce service nova] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-12d57a05-3176-4408-8833-659e2a4b512c req-3559f248-d8a8-448a-8bb3-d9829a2bd1ce service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] No waiting events found dispatching network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:07:00 user nova-compute[73091]: WARNING nova.compute.manager [req-12d57a05-3176-4408-8833-659e2a4b512c req-3559f248-d8a8-448a-8bb3-d9829a2bd1ce service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received unexpected event network-vif-plugged-58bf6094-42a8-4567-abea-27c63a57cf8a for instance with vm_state active and task_state deleting.
Aug 09 17:07:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:07:00 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Took 1.70 seconds to deallocate network for instance.
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-4e217dd2-5069-4d09-8bda-347c6e160aea req-90aacdfe-8da0-4605-bd6e-5af6deb63fcc service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Received event network-vif-deleted-8c3038f5-c9cf-44e0-a2d5-5dee6e719d90 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:07:00 user nova-compute[73091]: INFO nova.compute.manager [req-4e217dd2-5069-4d09-8bda-347c6e160aea req-90aacdfe-8da0-4605-bd6e-5af6deb63fcc service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Neutron deleted interface 8c3038f5-c9cf-44e0-a2d5-5dee6e719d90; detaching it from the instance and deleting it from the info cache
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.network.neutron [req-4e217dd2-5069-4d09-8bda-347c6e160aea req-90aacdfe-8da0-4605-bd6e-5af6deb63fcc service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:07:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Instance destroyed successfully.
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.objects.instance [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'resources' on Instance uuid 76055017-05ff-4ea7-ae9c-66d2e502e090 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-778120530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-778120530',id=40,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:53:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39308f2160f14a1cb5ee136458054726',ramdisk_id='',reservation_id='r-i2p91t84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:54:58Z,user_data=None,user_id='1b831573c2594072890b548abda013e3',uuid=76055017-05ff-4ea7-ae9c-66d2e502e090,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58bf6094-42a8-4567-abea-27c63a57cf8a", "address": "fa:16:3e:f3:dd:72", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf6094-42", "ovs_interfaceid": "58bf6094-42a8-4567-abea-27c63a57cf8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converting VIF {"id": "58bf6094-42a8-4567-abea-27c63a57cf8a", "address": "fa:16:3e:f3:dd:72", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bf6094-42", "ovs_interfaceid": "58bf6094-42a8-4567-abea-27c63a57cf8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:dd:72,bridge_name='br-int',has_traffic_filtering=True,id=58bf6094-42a8-4567-abea-27c63a57cf8a,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58bf6094-42') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG os_vif [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:dd:72,bridge_name='br-int',has_traffic_filtering=True,id=58bf6094-42a8-4567-abea-27c63a57cf8a,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58bf6094-42') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-4e217dd2-5069-4d09-8bda-347c6e160aea req-90aacdfe-8da0-4605-bd6e-5af6deb63fcc service nova] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Detach interface failed, port_id=8c3038f5-c9cf-44e0-a2d5-5dee6e719d90, reason: Instance 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58bf6094-42, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:00 user nova-compute[73091]: INFO os_vif [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:dd:72,bridge_name='br-int',has_traffic_filtering=True,id=58bf6094-42a8-4567-abea-27c63a57cf8a,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58bf6094-42')
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQivsqeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:07:00 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:07:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[de858dda-c963-420e-bb51-6e3517682514]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f302f3cb-2df5-47aa-a38e-e4db44daafd3]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:07:00 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 (non-flash)
Aug 09 17:07:00 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0603d43a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5'): ({'sdd'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Removing single pathed devices sdd {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8774765-4417-4f82-bdb2-4ce8f16c2652]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f54e48-ba77-4a9d-97ee-2e7ee6f50730]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Flushing IO for device /dev/sdd {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8123601f-074b-4150-a601-e82caeec8034]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[994f752a-92e5-41e0-b7f0-10e4a702e78e]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cffff5-3355-4289-ab50-62c3edb3af98]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a07d2e-8355-4aef-930d-a2d493404abd]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5, portal: 172.16.0.220,3260]
Aug 09 17:07:00 user nova-compute[73091]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5, portal: 172.16.0.220,3260] successful.
Aug 09 17:07:00 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06296a53-7a38-4d42-836c-f02cf17391b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be956dc-79d2-407a-9a60-d77677101622]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] <== disconnect_volume: return (273ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 17:07:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Deleting instance files /opt/stack/data/nova/instances/76055017-05ff-4ea7-ae9c-66d2e502e090_del
Aug 09 17:07:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Deletion of /opt/stack/data/nova/instances/76055017-05ff-4ea7-ae9c-66d2e502e090_del complete
Aug 09 17:07:00 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Deleted allocations for instance 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2
Aug 09 17:07:00 user nova-compute[73091]: INFO nova.compute.manager [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a4b3266-d841-4800-a1d9-a6c480bd9bef tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.789s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:00 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:07:01 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Took 0.55 seconds to deallocate network for instance.
Aug 09 17:07:01 user nova-compute[73091]: INFO nova.compute.manager [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Took 0.73 seconds to detach 1 volumes for instance.
Aug 09 17:07:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:01 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:07:01 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:07:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:01 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Deleted allocations for instance 76055017-05ff-4ea7-ae9c-66d2e502e090
Aug 09 17:07:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9851a432-bd0e-4167-9d9d-5eedf47a6965 tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "76055017-05ff-4ea7-ae9c-66d2e502e090" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.846s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-e1ab6d8a-4a8e-4a66-93be-4a42beb93dff req-53f9cbdd-f180-441c-966a-f26a608daab7 service nova] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Received event network-vif-deleted-58bf6094-42a8-4567-abea-27c63a57cf8a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:07:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:07:13 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691600818.2680972, 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:07:13 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] VM Stopped (Lifecycle Event)
Aug 09 17:07:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-59528066-fece-4731-be33-274d80cea03c None None] [instance: 980d837f-1f17-4dc1-a3e6-7ebae5a8d4f2] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:07:15 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691600820.0749094, 76055017-05ff-4ea7-ae9c-66d2e502e090 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:07:15 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] VM Stopped (Lifecycle Event)
Aug 09 17:07:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5b685259-0230-4d65-8af6-efcefd4c7180 None None] [instance: 76055017-05ff-4ea7-ae9c-66d2e502e090] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:07:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:07:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:07:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:07:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:07:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:07:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:07:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:07:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-078078d7-6c2e-4294-8ed4-14d9d02cf0b6 req-3a1a8611-25c8-4cf7-b991-d365ba064304 service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Received event network-changed-43cf267f-df5c-4b9e-b950-7837c9643aab {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:07:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-078078d7-6c2e-4294-8ed4-14d9d02cf0b6 req-3a1a8611-25c8-4cf7-b991-d365ba064304 service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Refreshing instance network info cache due to event network-changed-43cf267f-df5c-4b9e-b950-7837c9643aab. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 17:07:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-078078d7-6c2e-4294-8ed4-14d9d02cf0b6 req-3a1a8611-25c8-4cf7-b991-d365ba064304 service nova] Acquiring lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:07:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-078078d7-6c2e-4294-8ed4-14d9d02cf0b6 req-3a1a8611-25c8-4cf7-b991-d365ba064304 service nova] Acquired lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:07:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-078078d7-6c2e-4294-8ed4-14d9d02cf0b6 req-3a1a8611-25c8-4cf7-b991-d365ba064304 service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Refreshing network info cache for port 43cf267f-df5c-4b9e-b950-7837c9643aab {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 17:07:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-078078d7-6c2e-4294-8ed4-14d9d02cf0b6 req-3a1a8611-25c8-4cf7-b991-d365ba064304 service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Updated VIF entry in instance network info cache for port 43cf267f-df5c-4b9e-b950-7837c9643aab. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 17:07:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-078078d7-6c2e-4294-8ed4-14d9d02cf0b6 req-3a1a8611-25c8-4cf7-b991-d365ba064304 service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Updating instance_info_cache with network_info: [{"id": "43cf267f-df5c-4b9e-b950-7837c9643aab", "address": "fa:16:3e:55:df:10", "network": {"id": "d6efa64f-c1e2-438e-82e7-3760c89c8492", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2060056810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba31c994632452891e5aa16005d62d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cf267f-df", "ovs_interfaceid": "43cf267f-df5c-4b9e-b950-7837c9643aab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:07:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-078078d7-6c2e-4294-8ed4-14d9d02cf0b6 req-3a1a8611-25c8-4cf7-b991-d365ba064304 service nova] Releasing lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:07:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:07:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:32 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lazy-loading 'flavor' on Instance uuid 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:07:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:32 user nova-compute[73091]: INFO nova.compute.manager [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Attaching volume 6f44e031-5367-4c9b-a1de-5ca2b5eee774 to /dev/vdb
Aug 09 17:07:33 user nova-compute[73091]: DEBUG os_brick.utils [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:07:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4417e86b-f658-4ee5-8a03-75184be42a8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a1441a-7da9-45bc-931f-96a4ee0a7c61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b470345-adf6-43aa-811f-7a45fa567b40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ac4a4a-3c46-411c-b392-c2f2e1cc61af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:07:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 17:07:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:07:33 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 17:07:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d83b9d-12a5-4bab-9478-65942bcf6672]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 17:07:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 17:07:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 17:07:33 user nova-compute[73091]: DEBUG os_brick.utils [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:07:33 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Updating existing volume attachment record: 98da6c9c-bd3e-4bb5-9e09-f7f210bf1d01 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 17:07:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:07:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:07:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 17:07:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:07:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:07:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:36 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:07:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:37 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:07:37 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:07:37 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8616MB free_disk=25.00368881225586GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:07:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance c3871ef4-45e7-4118-8227-e48cc857d481 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:07:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:07:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:07:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:07:38 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:07:38 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:07:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:07:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:07:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:07:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:07:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 17:07:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oltvNXAO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:07:40 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:07:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:07:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:07:40 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:07:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:07:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:07:40 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 17:07:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:40 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[09be77a1-511e-4a31-9789-07aae397f412]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:40 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 17:07:40 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:07:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bc6456-4408-4ac2-9b4d-e22fb0ecb661]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774] added
Aug 09 17:07:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b6069f-56d7-45ae-ae69-280f0295e554]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[56da5ac0-a9f1-48af-a032-db785a4cd2c5]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oltvNXAO {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oltvNXAO" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d15ffc5-584a-432b-9b01-d3145ab03e81]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oltvNXAO'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57ced18-322f-4b3f-94f7-1db176b93f64]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b596d3-ae9f-4c12-9d13-9936a970e1ad]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 17:07:41 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 17:07:41 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:07:41 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 17:07:41 user nova-compute[73091]: 
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7ab93f-a920-4c82-a768-d19b8c858233]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774, portal: 172.16.0.220,3260]
Aug 09 17:07:41 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774, portal: 172.16.0.220,3260] successful.
Aug 09 17:07:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c414fe91-dccf-4adc-966b-b690971439d9]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fe050d-c5b7-47aa-83c1-90df2cf72f4c]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 (non-flash)
Aug 09 17:07:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 (non-flash)
Aug 09 17:07:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9bda49-df2c-41c2-9a0a-cecb468de004]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:07:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:07:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:07:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oltvNXAO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 17:07:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:07:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23136373162356536', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:07:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136373162356536', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 17:07:42 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lazy-loading 'flavor' on Instance uuid 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:07:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 17:07:42 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:07:42 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:07:42 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:07:42 user nova-compute[73091]:   <serial>6f44e031-5367-4c9b-a1de-5ca2b5eee774</serial>
Aug 09 17:07:42 user nova-compute[73091]: </disk>
Aug 09 17:07:42 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 17:07:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:07:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:07:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] No VIF found with MAC fa:16:3e:55:df:10, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 17:07:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5a08b692-e285-41e4-93f8-dddd53b6682a tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.836s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:49 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:07:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "c3871ef4-45e7-4118-8227-e48cc857d481" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "c3871ef4-45e7-4118-8227-e48cc857d481" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "c3871ef4-45e7-4118-8227-e48cc857d481-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "c3871ef4-45e7-4118-8227-e48cc857d481-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "c3871ef4-45e7-4118-8227-e48cc857d481-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:49 user nova-compute[73091]: INFO nova.compute.manager [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Terminating instance
Aug 09 17:07:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-d703b4c9-6a36-44e5-a96d-0d5184a3de21 req-fd2d6212-cb55-4e5a-8325-a7a8a178acac service nova] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Received event network-vif-unplugged-1d3f6a45-6b36-4603-b510-442d6ba16232 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d703b4c9-6a36-44e5-a96d-0d5184a3de21 req-fd2d6212-cb55-4e5a-8325-a7a8a178acac service nova] Acquiring lock "c3871ef4-45e7-4118-8227-e48cc857d481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d703b4c9-6a36-44e5-a96d-0d5184a3de21 req-fd2d6212-cb55-4e5a-8325-a7a8a178acac service nova] Lock "c3871ef4-45e7-4118-8227-e48cc857d481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d703b4c9-6a36-44e5-a96d-0d5184a3de21 req-fd2d6212-cb55-4e5a-8325-a7a8a178acac service nova] Lock "c3871ef4-45e7-4118-8227-e48cc857d481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-d703b4c9-6a36-44e5-a96d-0d5184a3de21 req-fd2d6212-cb55-4e5a-8325-a7a8a178acac service nova] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] No waiting events found dispatching network-vif-unplugged-1d3f6a45-6b36-4603-b510-442d6ba16232 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-d703b4c9-6a36-44e5-a96d-0d5184a3de21 req-fd2d6212-cb55-4e5a-8325-a7a8a178acac service nova] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Received event network-vif-unplugged-1d3f6a45-6b36-4603-b510-442d6ba16232 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 17:07:50 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Instance destroyed successfully.
Aug 09 17:07:50 user nova-compute[73091]: DEBUG nova.objects.instance [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lazy-loading 'resources' on Instance uuid c3871ef4-45e7-4118-8227-e48cc857d481 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T16:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1649553508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1649553508',id=34,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T16:48:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39308f2160f14a1cb5ee136458054726',ramdisk_id='',reservation_id='r-cgrda13f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T16:50:09Z,user_data=None,user_id='1b831573c2594072890b548abda013e3',uuid=c3871ef4-45e7-4118-8227-e48cc857d481,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d3f6a45-6b36-4603-b510-442d6ba16232", "address": "fa:16:3e:78:8d:86", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3f6a45-6b", "ovs_interfaceid": "1d3f6a45-6b36-4603-b510-442d6ba16232", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converting VIF {"id": "1d3f6a45-6b36-4603-b510-442d6ba16232", "address": "fa:16:3e:78:8d:86", "network": {"id": "722097a0-f95e-48d4-ad1a-1ff1a42e1c8b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-523452211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39308f2160f14a1cb5ee136458054726", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3f6a45-6b", "ovs_interfaceid": "1d3f6a45-6b36-4603-b510-442d6ba16232", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:8d:86,bridge_name='br-int',has_traffic_filtering=True,id=1d3f6a45-6b36-4603-b510-442d6ba16232,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3f6a45-6b') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG os_vif [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:8d:86,bridge_name='br-int',has_traffic_filtering=True,id=1d3f6a45-6b36-4603-b510-442d6ba16232,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3f6a45-6b') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d3f6a45-6b, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:07:50 user nova-compute[73091]: INFO os_vif [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:8d:86,bridge_name='br-int',has_traffic_filtering=True,id=1d3f6a45-6b36-4603-b510-442d6ba16232,network=Network(722097a0-f95e-48d4-ad1a-1ff1a42e1c8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3f6a45-6b')
Aug 09 17:07:50 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Deleting instance files /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481_del
Aug 09 17:07:50 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Deletion of /opt/stack/data/nova/instances/c3871ef4-45e7-4118-8227-e48cc857d481_del complete
Aug 09 17:07:50 user nova-compute[73091]: INFO nova.compute.manager [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 09 17:07:50 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 17:07:50 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 17:07:51 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:07:51 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Took 0.64 seconds to deallocate network for instance.
Aug 09 17:07:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-789c9b6a-5efd-4a52-b7d1-ad0bbadbbbcd req-1a6f262f-2600-407c-9388-9eedc5b4c616 service nova] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Received event network-vif-deleted-1d3f6a45-6b36-4603-b510-442d6ba16232 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:07:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:51 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:07:51 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:07:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:51 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Deleted allocations for instance c3871ef4-45e7-4118-8227-e48cc857d481
Aug 09 17:07:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-38d79bd7-c6bf-4c17-a681-826d2062c1bc tempest-ServerBootFromVolumeStableRescueTest-1999746022 tempest-ServerBootFromVolumeStableRescueTest-1999746022-project-member] Lock "c3871ef4-45e7-4118-8227-e48cc857d481" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.639s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "241d8b82-c878-41e2-a307-764260a75d1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "241d8b82-c878-41e2-a307-764260a75d1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 17:07:52 user nova-compute[73091]: INFO nova.compute.claims [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Claim successful on node user
Aug 09 17:07:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-c6c58c7e-a18a-48aa-9384-45c540571e81 req-f0a1bff6-a0c4-481c-b691-85aea8ecfd01 service nova] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Received event network-vif-plugged-1d3f6a45-6b36-4603-b510-442d6ba16232 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c6c58c7e-a18a-48aa-9384-45c540571e81 req-f0a1bff6-a0c4-481c-b691-85aea8ecfd01 service nova] Acquiring lock "c3871ef4-45e7-4118-8227-e48cc857d481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c6c58c7e-a18a-48aa-9384-45c540571e81 req-f0a1bff6-a0c4-481c-b691-85aea8ecfd01 service nova] Lock "c3871ef4-45e7-4118-8227-e48cc857d481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c6c58c7e-a18a-48aa-9384-45c540571e81 req-f0a1bff6-a0c4-481c-b691-85aea8ecfd01 service nova] Lock "c3871ef4-45e7-4118-8227-e48cc857d481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-c6c58c7e-a18a-48aa-9384-45c540571e81 req-f0a1bff6-a0c4-481c-b691-85aea8ecfd01 service nova] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] No waiting events found dispatching network-vif-plugged-1d3f6a45-6b36-4603-b510-442d6ba16232 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:07:52 user nova-compute[73091]: WARNING nova.compute.manager [req-c6c58c7e-a18a-48aa-9384-45c540571e81 req-f0a1bff6-a0c4-481c-b691-85aea8ecfd01 service nova] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Received unexpected event network-vif-plugged-1d3f6a45-6b36-4603-b510-442d6ba16232 for instance with vm_state deleted and task_state None.
Aug 09 17:07:52 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 17:07:52 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 17:07:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 17:07:52 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Creating image(s)
Aug 09 17:07:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "/opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "/opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "/opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:52 user nova-compute[73091]: DEBUG nova.policy [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e945ea4724446e5a6ee92a6b4d24ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfa5b9d92df40d6bdfef6e8dfd3fad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.135s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.158s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/disk 1073741824" returned: 0 in 0.051s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Checking if we can resize image /opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Cannot resize image /opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'migration_context' on Instance uuid 241d8b82-c878-41e2-a307-764260a75d1b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Ensure instance console log exists: /opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Successfully created port: b51fd660-c996-40ac-8d70-59d7d1064f1b {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Successfully updated port: b51fd660-c996-40ac-8d70-59d7d1064f1b {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "refresh_cache-241d8b82-c878-41e2-a307-764260a75d1b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquired lock "refresh_cache-241d8b82-c878-41e2-a307-764260a75d1b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-bc9b72c2-5118-427c-ad10-58dd852aff86 req-fc602ed7-9ee7-4052-88cb-0268fb2c261c service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Received event network-changed-b51fd660-c996-40ac-8d70-59d7d1064f1b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-bc9b72c2-5118-427c-ad10-58dd852aff86 req-fc602ed7-9ee7-4052-88cb-0268fb2c261c service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Refreshing instance network info cache due to event network-changed-b51fd660-c996-40ac-8d70-59d7d1064f1b. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bc9b72c2-5118-427c-ad10-58dd852aff86 req-fc602ed7-9ee7-4052-88cb-0268fb2c261c service nova] Acquiring lock "refresh_cache-241d8b82-c878-41e2-a307-764260a75d1b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Updating instance_info_cache with network_info: [{"id": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "address": "fa:16:3e:f1:54:aa", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51fd660-c9", "ovs_interfaceid": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Releasing lock "refresh_cache-241d8b82-c878-41e2-a307-764260a75d1b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Instance network_info: |[{"id": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "address": "fa:16:3e:f1:54:aa", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51fd660-c9", "ovs_interfaceid": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bc9b72c2-5118-427c-ad10-58dd852aff86 req-fc602ed7-9ee7-4052-88cb-0268fb2c261c service nova] Acquired lock "refresh_cache-241d8b82-c878-41e2-a307-764260a75d1b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.network.neutron [req-bc9b72c2-5118-427c-ad10-58dd852aff86 req-fc602ed7-9ee7-4052-88cb-0268fb2c261c service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Refreshing network info cache for port b51fd660-c996-40ac-8d70-59d7d1064f1b {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Start _get_guest_xml network_info=[{"id": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "address": "fa:16:3e:f1:54:aa", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51fd660-c9", "ovs_interfaceid": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 17:07:54 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:07:54 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T17:07:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2089698245',display_name='tempest-AttachVolumeTestJSON-server-2089698245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2089698245',id=50,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzoqe5oW1sK2wV2r3kYTWJ0J9caIj8d9YMN+UZ7vILhGn/5jegEoyZVAvSiTdVkm9ITXuLV9/tbX0mQEpSEO3ngSQFPMFx90Ndq7e2wwSzGFXZJLNi0AarFjpK8gtCcTg==',key_name='tempest-keypair-1316376287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cfa5b9d92df40d6bdfef6e8dfd3fad8',ramdisk_id='',reservation_id='r-uo9g985n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-99081524',owner_user_name='tempest-AttachVolumeTestJSON-99081524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T17:07:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e945ea4724446e5a6ee92a6b4d24ff0',uuid=241d8b82-c878-41e2-a307-764260a75d1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "address": "fa:16:3e:f1:54:aa", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51fd660-c9", "ovs_interfaceid": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converting VIF {"id": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "address": "fa:16:3e:f1:54:aa", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51fd660-c9", "ovs_interfaceid": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:54:aa,bridge_name='br-int',has_traffic_filtering=True,id=b51fd660-c996-40ac-8d70-59d7d1064f1b,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51fd660-c9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'pci_devices' on Instance uuid 241d8b82-c878-41e2-a307-764260a75d1b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 17:07:54 user nova-compute[73091]:   <uuid>241d8b82-c878-41e2-a307-764260a75d1b</uuid>
Aug 09 17:07:54 user nova-compute[73091]:   <name>instance-00000032</name>
Aug 09 17:07:54 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 17:07:54 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 17:07:54 user nova-compute[73091]:   <metadata>
Aug 09 17:07:54 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 17:07:54 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 17:07:54 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeTestJSON-server-2089698245</nova:name>
Aug 09 17:07:54 user nova-compute[73091]:       <nova:creationTime>2023-08-09 17:07:54</nova:creationTime>
Aug 09 17:07:54 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 17:07:54 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 17:07:54 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 17:07:54 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 17:07:54 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 17:07:54 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 17:07:54 user nova-compute[73091]:       </nova:flavor>
Aug 09 17:07:54 user nova-compute[73091]:       <nova:owner>
Aug 09 17:07:54 user nova-compute[73091]:         <nova:user uuid="2e945ea4724446e5a6ee92a6b4d24ff0">tempest-AttachVolumeTestJSON-99081524-project-member</nova:user>
Aug 09 17:07:54 user nova-compute[73091]:         <nova:project uuid="0cfa5b9d92df40d6bdfef6e8dfd3fad8">tempest-AttachVolumeTestJSON-99081524</nova:project>
Aug 09 17:07:54 user nova-compute[73091]:       </nova:owner>
Aug 09 17:07:54 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 17:07:54 user nova-compute[73091]:       <nova:ports>
Aug 09 17:07:54 user nova-compute[73091]:         <nova:port uuid="b51fd660-c996-40ac-8d70-59d7d1064f1b">
Aug 09 17:07:54 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 17:07:54 user nova-compute[73091]:         </nova:port>
Aug 09 17:07:54 user nova-compute[73091]:       </nova:ports>
Aug 09 17:07:54 user nova-compute[73091]:     </nova:instance>
Aug 09 17:07:54 user nova-compute[73091]:   </metadata>
Aug 09 17:07:54 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 17:07:54 user nova-compute[73091]:     <system>
Aug 09 17:07:54 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 17:07:54 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 17:07:54 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 17:07:54 user nova-compute[73091]:       <entry name="serial">241d8b82-c878-41e2-a307-764260a75d1b</entry>
Aug 09 17:07:54 user nova-compute[73091]:       <entry name="uuid">241d8b82-c878-41e2-a307-764260a75d1b</entry>
Aug 09 17:07:54 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 17:07:54 user nova-compute[73091]:     </system>
Aug 09 17:07:54 user nova-compute[73091]:   </sysinfo>
Aug 09 17:07:54 user nova-compute[73091]:   <os>
Aug 09 17:07:54 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 17:07:54 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 17:07:54 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 17:07:54 user nova-compute[73091]:   </os>
Aug 09 17:07:54 user nova-compute[73091]:   <features>
Aug 09 17:07:54 user nova-compute[73091]:     <acpi/>
Aug 09 17:07:54 user nova-compute[73091]:     <apic/>
Aug 09 17:07:54 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 17:07:54 user nova-compute[73091]:   </features>
Aug 09 17:07:54 user nova-compute[73091]:   <clock offset="utc">
Aug 09 17:07:54 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 17:07:54 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 17:07:54 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 17:07:54 user nova-compute[73091]:   </clock>
Aug 09 17:07:54 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 17:07:54 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 17:07:54 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 17:07:54 user nova-compute[73091]:   </cpu>
Aug 09 17:07:54 user nova-compute[73091]:   <devices>
Aug 09 17:07:54 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 17:07:54 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 17:07:54 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/disk"/>
Aug 09 17:07:54 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 17:07:54 user nova-compute[73091]:     </disk>
Aug 09 17:07:54 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 17:07:54 user nova-compute[73091]:       <mac address="fa:16:3e:f1:54:aa"/>
Aug 09 17:07:54 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 17:07:54 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 17:07:54 user nova-compute[73091]:       <target dev="tapb51fd660-c9"/>
Aug 09 17:07:54 user nova-compute[73091]:     </interface>
Aug 09 17:07:54 user nova-compute[73091]:     <serial type="pty">
Aug 09 17:07:54 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/console.log" append="off"/>
Aug 09 17:07:54 user nova-compute[73091]:     </serial>
Aug 09 17:07:54 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 17:07:54 user nova-compute[73091]:     <video>
Aug 09 17:07:54 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 17:07:54 user nova-compute[73091]:     </video>
Aug 09 17:07:54 user nova-compute[73091]:     <rng model="virtio">
Aug 09 17:07:54 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 17:07:54 user nova-compute[73091]:     </rng>
Aug 09 17:07:54 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 17:07:54 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 17:07:54 user nova-compute[73091]:       <stats period="10"/>
Aug 09 17:07:54 user nova-compute[73091]:     </memballoon>
Aug 09 17:07:54 user nova-compute[73091]:   </devices>
Aug 09 17:07:54 user nova-compute[73091]: </domain>
Aug 09 17:07:54 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T17:07:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2089698245',display_name='tempest-AttachVolumeTestJSON-server-2089698245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2089698245',id=50,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzoqe5oW1sK2wV2r3kYTWJ0J9caIj8d9YMN+UZ7vILhGn/5jegEoyZVAvSiTdVkm9ITXuLV9/tbX0mQEpSEO3ngSQFPMFx90Ndq7e2wwSzGFXZJLNi0AarFjpK8gtCcTg==',key_name='tempest-keypair-1316376287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cfa5b9d92df40d6bdfef6e8dfd3fad8',ramdisk_id='',reservation_id='r-uo9g985n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-99081524',owner_user_name='tempest-AttachVolumeTestJSON-99081524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T17:07:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e945ea4724446e5a6ee92a6b4d24ff0',uuid=241d8b82-c878-41e2-a307-764260a75d1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "address": "fa:16:3e:f1:54:aa", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51fd660-c9", "ovs_interfaceid": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converting VIF {"id": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "address": "fa:16:3e:f1:54:aa", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51fd660-c9", "ovs_interfaceid": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:54:aa,bridge_name='br-int',has_traffic_filtering=True,id=b51fd660-c996-40ac-8d70-59d7d1064f1b,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51fd660-c9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG os_vif [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:54:aa,bridge_name='br-int',has_traffic_filtering=True,id=b51fd660-c996-40ac-8d70-59d7d1064f1b,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51fd660-c9') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb51fd660-c9, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb51fd660-c9, col_values=(('external_ids', {'iface-id': 'b51fd660-c996-40ac-8d70-59d7d1064f1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:54:aa', 'vm-uuid': '241d8b82-c878-41e2-a307-764260a75d1b'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:07:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:54 user nova-compute[73091]: INFO os_vif [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:54:aa,bridge_name='br-int',has_traffic_filtering=True,id=b51fd660-c996-40ac-8d70-59d7d1064f1b,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51fd660-c9')
Aug 09 17:07:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:07:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] No VIF found with MAC fa:16:3e:f1:54:aa, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 17:07:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-bc9b72c2-5118-427c-ad10-58dd852aff86 req-fc602ed7-9ee7-4052-88cb-0268fb2c261c service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Updated VIF entry in instance network info cache for port b51fd660-c996-40ac-8d70-59d7d1064f1b. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 17:07:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-bc9b72c2-5118-427c-ad10-58dd852aff86 req-fc602ed7-9ee7-4052-88cb-0268fb2c261c service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Updating instance_info_cache with network_info: [{"id": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "address": "fa:16:3e:f1:54:aa", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51fd660-c9", "ovs_interfaceid": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:07:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bc9b72c2-5118-427c-ad10-58dd852aff86 req-fc602ed7-9ee7-4052-88cb-0268fb2c261c service nova] Releasing lock "refresh_cache-241d8b82-c878-41e2-a307-764260a75d1b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:07:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-00b6df07-e162-4a67-8a4d-96142316b9fb req-717c3985-3cd1-4dfb-a801-249ae2e69ddc service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Received event network-vif-plugged-b51fd660-c996-40ac-8d70-59d7d1064f1b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:07:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-00b6df07-e162-4a67-8a4d-96142316b9fb req-717c3985-3cd1-4dfb-a801-249ae2e69ddc service nova] Acquiring lock "241d8b82-c878-41e2-a307-764260a75d1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-00b6df07-e162-4a67-8a4d-96142316b9fb req-717c3985-3cd1-4dfb-a801-249ae2e69ddc service nova] Lock "241d8b82-c878-41e2-a307-764260a75d1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-00b6df07-e162-4a67-8a4d-96142316b9fb req-717c3985-3cd1-4dfb-a801-249ae2e69ddc service nova] Lock "241d8b82-c878-41e2-a307-764260a75d1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-00b6df07-e162-4a67-8a4d-96142316b9fb req-717c3985-3cd1-4dfb-a801-249ae2e69ddc service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] No waiting events found dispatching network-vif-plugged-b51fd660-c996-40ac-8d70-59d7d1064f1b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:07:56 user nova-compute[73091]: WARNING nova.compute.manager [req-00b6df07-e162-4a67-8a4d-96142316b9fb req-717c3985-3cd1-4dfb-a801-249ae2e69ddc service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Received unexpected event network-vif-plugged-b51fd660-c996-40ac-8d70-59d7d1064f1b for instance with vm_state building and task_state spawning.
Aug 09 17:07:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:07:58 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600878.4421976, 241d8b82-c878-41e2-a307-764260a75d1b => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:07:58 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] VM Resumed (Lifecycle Event)
Aug 09 17:07:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 17:07:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 17:07:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Instance spawned successfully.
Aug 09 17:07:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 17:07:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:07:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:07:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:07:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:07:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:07:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:07:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:07:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:07:58 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 17:07:58 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691600878.4436905, 241d8b82-c878-41e2-a307-764260a75d1b => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:07:58 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] VM Started (Lifecycle Event)
Aug 09 17:07:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:07:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:07:58 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 17:07:58 user nova-compute[73091]: INFO nova.compute.manager [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Took 5.64 seconds to spawn the instance on the hypervisor.
Aug 09 17:07:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:07:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-e6ef68a4-1bbd-45e9-bac9-ce1bda9876ef req-5e352612-050c-433b-b5f3-e8a889802f30 service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Received event network-vif-plugged-b51fd660-c996-40ac-8d70-59d7d1064f1b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:07:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e6ef68a4-1bbd-45e9-bac9-ce1bda9876ef req-5e352612-050c-433b-b5f3-e8a889802f30 service nova] Acquiring lock "241d8b82-c878-41e2-a307-764260a75d1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:07:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e6ef68a4-1bbd-45e9-bac9-ce1bda9876ef req-5e352612-050c-433b-b5f3-e8a889802f30 service nova] Lock "241d8b82-c878-41e2-a307-764260a75d1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:07:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e6ef68a4-1bbd-45e9-bac9-ce1bda9876ef req-5e352612-050c-433b-b5f3-e8a889802f30 service nova] Lock "241d8b82-c878-41e2-a307-764260a75d1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-e6ef68a4-1bbd-45e9-bac9-ce1bda9876ef req-5e352612-050c-433b-b5f3-e8a889802f30 service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] No waiting events found dispatching network-vif-plugged-b51fd660-c996-40ac-8d70-59d7d1064f1b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:07:58 user nova-compute[73091]: WARNING nova.compute.manager [req-e6ef68a4-1bbd-45e9-bac9-ce1bda9876ef req-5e352612-050c-433b-b5f3-e8a889802f30 service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Received unexpected event network-vif-plugged-b51fd660-c996-40ac-8d70-59d7d1064f1b for instance with vm_state building and task_state spawning.
Aug 09 17:07:58 user nova-compute[73091]: INFO nova.compute.manager [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Took 6.22 seconds to build instance.
Aug 09 17:07:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a8089eac-b8e1-45db-951a-22d68bc3613b tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "241d8b82-c878-41e2-a307-764260a75d1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.315s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:07:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:08:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:08:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:08:05 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691600870.5635016, c3871ef4-45e7-4118-8227-e48cc857d481 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:08:05 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] VM Stopped (Lifecycle Event)
Aug 09 17:08:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5afffb83-f35d-48d3-a56e-da499f4f04af None None] [instance: c3871ef4-45e7-4118-8227-e48cc857d481] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:08:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:08:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:08:05 user nova-compute[73091]: INFO nova.compute.manager [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Detaching volume 6f44e031-5367-4c9b-a1de-5ca2b5eee774
Aug 09 17:08:05 user nova-compute[73091]: INFO nova.virt.block_device [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Attempting to driver detach volume 6f44e031-5367-4c9b-a1de-5ca2b5eee774 from mountpoint /dev/vdb
Aug 09 17:08:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Attempting to detach device vdb from instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 17:08:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:08:05 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:08:05 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:08:05 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:08:05 user nova-compute[73091]:   <serial>6f44e031-5367-4c9b-a1de-5ca2b5eee774</serial>
Aug 09 17:08:05 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 17:08:05 user nova-compute[73091]: </disk>
Aug 09 17:08:05 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:08:05 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Successfully detached device vdb from instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f from the persistent domain config.
Aug 09 17:08:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 17:08:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:08:05 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:08:05 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:08:05 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:08:05 user nova-compute[73091]:   <serial>6f44e031-5367-4c9b-a1de-5ca2b5eee774</serial>
Aug 09 17:08:05 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 17:08:05 user nova-compute[73091]: </disk>
Aug 09 17:08:05 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691600886.4100604, 8c5cd921-9e64-475a-b796-7e6f6b95f07f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 17:08:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Successfully detached device vdb from instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f from the live domain config.
Aug 09 17:08:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oltvNXAO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:08:06 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:08:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[37185b82-add4-4583-8fc7-5175292d6dc7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbefd33c-67a9-47cb-a1d7-e7647c65a09a]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 (non-flash)
Aug 09 17:08:06 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 (non-flash)
Aug 09 17:08:06 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0802eed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[789bc221-56b2-4a5b-ab1f-bd72a529f92e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce34d88-7a0b-4999-98c0-9218dfc0427f]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[44325d51-5e23-4ec8-ba84-abd2f811928b]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f2482d-8738-4a71-a835-ae751a8fa04e]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[330c09a7-d3aa-4b5b-8261-08fe330ffe0b]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9808953-62f2-4453-b513-40b7b99af013]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774, portal: 172.16.0.220,3260]
Aug 09 17:08:06 user nova-compute[73091]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774, portal: 172.16.0.220,3260] successful.
Aug 09 17:08:06 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f44e031-5367-4c9b-a1de-5ca2b5eee774 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[202adfc4-9c2a-4ce9-a6fd-803a68ff5dc2]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] <== disconnect_volume: return (264ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:08:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 17:08:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lazy-loading 'flavor' on Instance uuid 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:08:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f39eea4a-f275-4f57-aa02-df5b3d100023 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.618s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:08:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:08:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:08:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:08:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:08:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:08:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:08:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:08:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:08:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:08:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:08:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:08:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:08:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:08:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:08:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 17:08:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:08:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:08:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:08:34 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:08:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:08:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Updating instance_info_cache with network_info: [{"id": "43cf267f-df5c-4b9e-b950-7837c9643aab", "address": "fa:16:3e:55:df:10", "network": {"id": "d6efa64f-c1e2-438e-82e7-3760c89c8492", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2060056810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba31c994632452891e5aa16005d62d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cf267f-df", "ovs_interfaceid": "43cf267f-df5c-4b9e-b950-7837c9643aab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:08:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:08:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:08:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:08:38 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:08:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:08:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:08:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:08:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:08:40 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:08:40 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:08:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8593MB free_disk=25.09851837158203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:08:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:08:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:08:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:08:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 241d8b82-c878-41e2-a307-764260a75d1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:08:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:08:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:08:40 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:08:40 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:08:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:08:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:08:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:08:41 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:08:41 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:08:42 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:08:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:08:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:08:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:08:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:08:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:08:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:08:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:08:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:08:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:08:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:08:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Verify base images {{(pid=73091) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 09 17:08:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Image id bb270def-cd6e-4463-89d8-f4240c9cb724 yields fingerprint 6d61bcd6e193d2258cec1205319c2faab1b70eff {{(pid=73091) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 09 17:08:54 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] image bb270def-cd6e-4463-89d8-f4240c9cb724 at (/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff): checking
Aug 09 17:08:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] image bb270def-cd6e-4463-89d8-f4240c9cb724 at (/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff): image is in use {{(pid=73091) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 09 17:08:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73091) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 09 17:08:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] 8c5cd921-9e64-475a-b796-7e6f6b95f07f is a valid instance name {{(pid=73091) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 09 17:08:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] 8c5cd921-9e64-475a-b796-7e6f6b95f07f has a disk file {{(pid=73091) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 09 17:08:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:08:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:08:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f is backed by 6d61bcd6e193d2258cec1205319c2faab1b70eff {{(pid=73091) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 09 17:08:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] 241d8b82-c878-41e2-a307-764260a75d1b is a valid instance name {{(pid=73091) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 09 17:08:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] 241d8b82-c878-41e2-a307-764260a75d1b has a disk file {{(pid=73091) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 09 17:08:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:08:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:08:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:08:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 241d8b82-c878-41e2-a307-764260a75d1b is backed by 6d61bcd6e193d2258cec1205319c2faab1b70eff {{(pid=73091) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 09 17:08:55 user nova-compute[73091]: WARNING nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Unknown base file: /opt/stack/data/nova/instances/_base/fc4a122f62154ce70545b4b30726ed4b293d2e8a
Aug 09 17:08:55 user nova-compute[73091]: WARNING nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Unknown base file: /opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216
Aug 09 17:08:55 user nova-compute[73091]: WARNING nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Unknown base file: /opt/stack/data/nova/instances/_base/917569f1dce69a44fc92d53b961ff96192840a3f
Aug 09 17:08:55 user nova-compute[73091]: WARNING nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Unknown base file: /opt/stack/data/nova/instances/_base/4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3
Aug 09 17:08:55 user nova-compute[73091]: WARNING nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Unknown base file: /opt/stack/data/nova/instances/_base/cd2d22fca9434725101f3d9f0668ad03a2243dd8
Aug 09 17:08:55 user nova-compute[73091]: WARNING nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Unknown base file: /opt/stack/data/nova/instances/_base/90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552
Aug 09 17:08:55 user nova-compute[73091]: WARNING nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Unknown base file: /opt/stack/data/nova/instances/_base/6e5fb35af1e0b3225906c08e568b6622fb50e588
Aug 09 17:08:55 user nova-compute[73091]: WARNING nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Unknown base file: /opt/stack/data/nova/instances/_base/dec08bd5298854fb6d8990a1c1610733a4b23015
Aug 09 17:08:55 user nova-compute[73091]: WARNING nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Unknown base file: /opt/stack/data/nova/instances/_base/045679c5680831b6044b74c1b3ccd1dd702831e6
Aug 09 17:08:55 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Active base files: /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff
Aug 09 17:08:55 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Removable base files: /opt/stack/data/nova/instances/_base/fc4a122f62154ce70545b4b30726ed4b293d2e8a /opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216 /opt/stack/data/nova/instances/_base/917569f1dce69a44fc92d53b961ff96192840a3f /opt/stack/data/nova/instances/_base/4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3 /opt/stack/data/nova/instances/_base/cd2d22fca9434725101f3d9f0668ad03a2243dd8 /opt/stack/data/nova/instances/_base/90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552 /opt/stack/data/nova/instances/_base/6e5fb35af1e0b3225906c08e568b6622fb50e588 /opt/stack/data/nova/instances/_base/dec08bd5298854fb6d8990a1c1610733a4b23015 /opt/stack/data/nova/instances/_base/045679c5680831b6044b74c1b3ccd1dd702831e6
Aug 09 17:08:55 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fc4a122f62154ce70545b4b30726ed4b293d2e8a
Aug 09 17:08:55 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/028ea0f3fd2dc87a207f6a95f89827793b8f5216
Aug 09 17:08:55 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/917569f1dce69a44fc92d53b961ff96192840a3f
Aug 09 17:08:55 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4d0b6f3cfef08a71f9591ff09b21e73acd0bcbf3
Aug 09 17:08:55 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cd2d22fca9434725101f3d9f0668ad03a2243dd8
Aug 09 17:08:55 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/90daf90aeb08ef1e191bdbb2ebe54fd68d9f5552
Aug 09 17:08:55 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6e5fb35af1e0b3225906c08e568b6622fb50e588
Aug 09 17:08:55 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dec08bd5298854fb6d8990a1c1610733a4b23015
Aug 09 17:08:55 user nova-compute[73091]: INFO nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/045679c5680831b6044b74c1b3ccd1dd702831e6
Aug 09 17:08:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Verification complete {{(pid=73091) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 09 17:08:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Verify swap images {{(pid=73091) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 09 17:08:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.imagecache [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Verify ephemeral images {{(pid=73091) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG nova.objects.instance [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lazy-loading 'flavor' on Instance uuid 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:09:00 user nova-compute[73091]: INFO nova.compute.manager [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Attaching volume 94b601ee-9b4a-41eb-931f-930ebcdb0e49 to /dev/vdb
Aug 09 17:09:00 user nova-compute[73091]: DEBUG os_brick.utils [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[573a51a2-97e7-4692-ad69-227dc59c5019]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f80fbba-0176-4272-805d-b3f3b78c3bef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dadc17f-226b-4a3e-9834-16685dda08ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6e4cd6-6d6e-4f51-ac6e-75d211e75494]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:09:00 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 17:09:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[474dd34b-583e-4d20-a32b-dae417b1a0ed]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG os_brick.utils [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Updating existing volume attachment record: bcf6be70-0e49-4cca-9b7a-ed803e7019b7 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 17:09:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:09:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxZQvOjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:09:08 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:09:08 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:09:08 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[598067cf-d34f-4ac5-904d-729179ea0d6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 17:09:08 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e465f3-d43e-49fa-88a8-71b55f3a838e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49] added
Aug 09 17:09:08 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd04cf44-dc77-432b-8507-c8479837e54f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b3ef6a-c4c2-4ef6-89ca-fa0f7adc8ff0]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxZQvOjS {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxZQvOjS" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13bb5af-a8c7-474e-b608-2187be6f9f39]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wxZQvOjS'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed2912d-9ee1-4436-bf04-e024bad335c7]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39a49ca-00b4-4340-90a4-d7379c143634]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 17:09:08 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 17:09:08 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:09:08 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 17:09:08 user nova-compute[73091]: 
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[863f4fdc-5087-4a9e-9b9b-e385f95006f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49, portal: 172.16.0.220,3260]
Aug 09 17:09:08 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49, portal: 172.16.0.220,3260] successful.
Aug 09 17:09:08 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7774586f-5b7e-4059-a1bf-01e2d003fb57]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbd7302-aeac-4e67-a223-555e3d79e755]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 (non-flash)
Aug 09 17:09:08 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 (non-flash)
Aug 09 17:09:08 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d21ce39-9086-442c-82c4-c3addbba3672]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:09:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxZQvOjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 17:09:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:09:09 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23964626230366266', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:09:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964626230366266', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 17:09:09 user nova-compute[73091]: DEBUG nova.objects.instance [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lazy-loading 'flavor' on Instance uuid 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:09:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 17:09:09 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:09:09 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:09:09 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:09:09 user nova-compute[73091]:   <serial>94b601ee-9b4a-41eb-931f-930ebcdb0e49</serial>
Aug 09 17:09:09 user nova-compute[73091]: </disk>
Aug 09 17:09:09 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 17:09:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:09:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:09:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] No VIF found with MAC fa:16:3e:55:df:10, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 17:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-62d7241f-3d14-4e5e-acd5-12e7dbd2ac00 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.817s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:09:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:09:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:09:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:09:12 user nova-compute[73091]: INFO nova.compute.manager [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Detaching volume 94b601ee-9b4a-41eb-931f-930ebcdb0e49
Aug 09 17:09:12 user nova-compute[73091]: INFO nova.virt.block_device [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Attempting to driver detach volume 94b601ee-9b4a-41eb-931f-930ebcdb0e49 from mountpoint /dev/vdb
Aug 09 17:09:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Attempting to detach device vdb from instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:09:13 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:09:13 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:09:13 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:09:13 user nova-compute[73091]:   <serial>94b601ee-9b4a-41eb-931f-930ebcdb0e49</serial>
Aug 09 17:09:13 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 17:09:13 user nova-compute[73091]: </disk>
Aug 09 17:09:13 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:09:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Successfully detached device vdb from instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f from the persistent domain config.
Aug 09 17:09:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:09:13 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:09:13 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:09:13 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:09:13 user nova-compute[73091]:   <serial>94b601ee-9b4a-41eb-931f-930ebcdb0e49</serial>
Aug 09 17:09:13 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 17:09:13 user nova-compute[73091]: </disk>
Aug 09 17:09:13 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691600953.4746547, 8c5cd921-9e64-475a-b796-7e6f6b95f07f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 17:09:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Successfully detached device vdb from instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f from the live domain config.
Aug 09 17:09:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxZQvOjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:09:13 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:09:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d07abf-5e67-499c-9fcf-a33bfda35cb1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8544c952-f2a1-4316-8173-ca3e398fc69e]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 (non-flash)
Aug 09 17:09:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 (non-flash)
Aug 09 17:09:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff03cf3a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc018bc-4d02-4d8f-83ee-f848af768695]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5217b5fd-ec3a-42ab-b847-1a6822b7405d]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd273c2-666e-4352-b76c-2d828798f837]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f53433-3b9c-4e42-b927-4f30eb7a12a3]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad13fcc-fc20-4dfc-97c9-c428408c1e0c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[095acdc5-ffe5-46f4-a776-a9fcaeab2015]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49, portal: 172.16.0.220,3260]
Aug 09 17:09:13 user nova-compute[73091]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49, portal: 172.16.0.220,3260] successful.
Aug 09 17:09:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94b601ee-9b4a-41eb-931f-930ebcdb0e49 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[909cee8a-fc23-4686-86e2-d9c5df0f4afe]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] <== disconnect_volume: return (264ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:09:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 17:09:14 user nova-compute[73091]: DEBUG nova.objects.instance [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lazy-loading 'flavor' on Instance uuid 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-858b1cc3-002c-43c7-9499-3e00aeba8e19 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.629s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:09:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:09:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:09:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:09:24 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:09:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 17:09:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:09:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:09:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:09:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:09:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:09:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:09:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:09:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:09:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:09:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:09:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:09:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:09:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:09:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:09:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-241d8b82-c878-41e2-a307-764260a75d1b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:09:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-241d8b82-c878-41e2-a307-764260a75d1b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:09:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:09:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Updating instance_info_cache with network_info: [{"id": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "address": "fa:16:3e:f1:54:aa", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51fd660-c9", "ovs_interfaceid": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:09:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-241d8b82-c878-41e2-a307-764260a75d1b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:09:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:09:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:09:38 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:09:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:09:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:09:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:09:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:09:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:40 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:09:40 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:09:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8633MB free_disk=25.096134185791016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:09:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:09:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:09:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:09:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:09:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 241d8b82-c878-41e2-a307-764260a75d1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:09:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:09:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:09:40 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing inventories for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 17:09:40 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Updating ProviderTree inventory for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 17:09:40 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Updating inventory in ProviderTree for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 17:09:40 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing aggregate associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 17:09:40 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing trait associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, traits: HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 17:09:40 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:09:40 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:09:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:09:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:09:41 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:09:42 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:09:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-2def59bf-abee-4e1e-afdf-e94e849cb03d req-d4cbee7e-79ed-4928-ae89-6b6bee5034ce service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Received event network-changed-b51fd660-c996-40ac-8d70-59d7d1064f1b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:09:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-2def59bf-abee-4e1e-afdf-e94e849cb03d req-d4cbee7e-79ed-4928-ae89-6b6bee5034ce service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Refreshing instance network info cache due to event network-changed-b51fd660-c996-40ac-8d70-59d7d1064f1b. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 17:09:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2def59bf-abee-4e1e-afdf-e94e849cb03d req-d4cbee7e-79ed-4928-ae89-6b6bee5034ce service nova] Acquiring lock "refresh_cache-241d8b82-c878-41e2-a307-764260a75d1b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:09:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2def59bf-abee-4e1e-afdf-e94e849cb03d req-d4cbee7e-79ed-4928-ae89-6b6bee5034ce service nova] Acquired lock "refresh_cache-241d8b82-c878-41e2-a307-764260a75d1b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:09:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-2def59bf-abee-4e1e-afdf-e94e849cb03d req-d4cbee7e-79ed-4928-ae89-6b6bee5034ce service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Refreshing network info cache for port b51fd660-c996-40ac-8d70-59d7d1064f1b {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 17:09:44 user nova-compute[73091]: DEBUG nova.network.neutron [req-2def59bf-abee-4e1e-afdf-e94e849cb03d req-d4cbee7e-79ed-4928-ae89-6b6bee5034ce service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Updated VIF entry in instance network info cache for port b51fd660-c996-40ac-8d70-59d7d1064f1b. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 17:09:44 user nova-compute[73091]: DEBUG nova.network.neutron [req-2def59bf-abee-4e1e-afdf-e94e849cb03d req-d4cbee7e-79ed-4928-ae89-6b6bee5034ce service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Updating instance_info_cache with network_info: [{"id": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "address": "fa:16:3e:f1:54:aa", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51fd660-c9", "ovs_interfaceid": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:09:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2def59bf-abee-4e1e-afdf-e94e849cb03d req-d4cbee7e-79ed-4928-ae89-6b6bee5034ce service nova] Releasing lock "refresh_cache-241d8b82-c878-41e2-a307-764260a75d1b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:09:44 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:09:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:09:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:09:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:09:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:09:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:09:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:09:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:09:45 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:09:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 17:09:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "241d8b82-c878-41e2-a307-764260a75d1b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "241d8b82-c878-41e2-a307-764260a75d1b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'flavor' on Instance uuid 241d8b82-c878-41e2-a307-764260a75d1b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "241d8b82-c878-41e2-a307-764260a75d1b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "241d8b82-c878-41e2-a307-764260a75d1b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "241d8b82-c878-41e2-a307-764260a75d1b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:09:48 user nova-compute[73091]: INFO nova.compute.manager [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Attaching volume e3c06ef5-cc70-4573-bca2-82b9a78e13b7 to /dev/vdb
Aug 09 17:09:48 user nova-compute[73091]: DEBUG os_brick.utils [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d36fa30-fd50-4713-8d9e-e0118d396fa9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ce604d-80e7-495e-86d7-886c480d323b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d106bf-21f4-402f-9406-0e7e95718e66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[650f5d6d-45a1-4708-902f-0917ff4de743]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:09:48 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 17:09:48 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda4a5ed-cc98-4f83-8f6f-a5e102017498]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG os_brick.utils [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:09:48 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Updating existing volume attachment record: 45c440c1-93d2-49d2-9f24-e0b631605bf7 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 17:09:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:09:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:09:52 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:09:53 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:09:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msjxRfla', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:09:56 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:09:56 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:09:56 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[feec78a0-4a7a-4a53-880d-c9a73d3eeba5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 17:09:56 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a42386b-6f9d-4ffd-9c62-bce0f0806a56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7] added
Aug 09 17:09:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8c97d3-72f2-446d-bbb0-657d3cd99f0b]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4536357e-4b6b-4787-ad77-30b5c8f576f6]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v msjxRfla {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v msjxRfla" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8d656e-c5b3-4826-a70d-b132f7c5884b]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'msjxRfla'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5ff513-ce29-4128-83ed-e3de277be68c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fde58ec-cecf-4fb8-af1f-15419972b511]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 17:09:56 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 17:09:56 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:09:56 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 17:09:56 user nova-compute[73091]: 
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f158e601-c09d-4707-8022-4e5a9f6a72fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7, portal: 172.16.0.220,3260]
Aug 09 17:09:56 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7, portal: 172.16.0.220,3260] successful.
Aug 09 17:09:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69e56b8-3473-4780-b624-884daf96ccb3]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bbcf28-5b64-40ea-93ce-f72a90ec0919]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 (non-flash)
Aug 09 17:09:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 (non-flash)
Aug 09 17:09:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bcb063-2732-4309-b32b-1286c07f09e3]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msjxRfla', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 17:09:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:09:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26331333435353134', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:09:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331333435353134', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 17:09:57 user nova-compute[73091]: DEBUG nova.objects.instance [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'flavor' on Instance uuid 241d8b82-c878-41e2-a307-764260a75d1b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:09:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 17:09:57 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:09:57 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:09:57 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:09:57 user nova-compute[73091]:   <serial>e3c06ef5-cc70-4573-bca2-82b9a78e13b7</serial>
Aug 09 17:09:57 user nova-compute[73091]: </disk>
Aug 09 17:09:57 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 17:09:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:09:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:09:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] No VIF found with MAC fa:16:3e:f1:54:aa, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 17:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-dedd9720-bbb6-49ed-a5db-b1864c758a6e tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "241d8b82-c878-41e2-a307-764260a75d1b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.011s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:10:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:10:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:10:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:10:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:10:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:10:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:10:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:10:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "241d8b82-c878-41e2-a307-764260a75d1b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:10:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "241d8b82-c878-41e2-a307-764260a75d1b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:10:02 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'flavor' on Instance uuid 241d8b82-c878-41e2-a307-764260a75d1b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:10:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "241d8b82-c878-41e2-a307-764260a75d1b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "241d8b82-c878-41e2-a307-764260a75d1b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "241d8b82-c878-41e2-a307-764260a75d1b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:10:03 user nova-compute[73091]: INFO nova.compute.manager [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Attaching volume 0c31f4ef-e403-4749-aff1-8944d5df01b3 to /dev/vdc
Aug 09 17:10:03 user nova-compute[73091]: DEBUG os_brick.utils [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d925b65f-977a-410b-bcb3-1421d918e85a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[817417a9-fbda-49da-8c03-02571e8a2798]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0270f6-469a-4388-9140-cd118e10580b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8751b36-58f5-415a-8860-390ce7f33f58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:10:03 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 17:10:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff5ff1c-f4fb-4fdb-b965-f2962d932858]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG os_brick.utils [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:10:03 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Updating existing volume attachment record: 70eb2873-485e-4035-a54d-2a0faf411b10 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 17:10:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lazy-loading 'flavor' on Instance uuid 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:10:07 user nova-compute[73091]: INFO nova.compute.manager [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Attaching volume 1325b266-11ea-4bcc-8951-1afba9418704 to /dev/vdb
Aug 09 17:10:07 user nova-compute[73091]: DEBUG os_brick.utils [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ece01e-23d5-46e3-9445-e60837a6c33d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dc72db-8dcf-4add-b607-5aeca87dc185]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[70863b30-fb27-4980-8dcc-71d9d32d1a6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[05617a45-9357-4158-a349-c89e28abf989]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:10:07 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 17:10:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bcaee2-2b17-40e2-9e04-c11bb7932b21]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG os_brick.utils [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:10:07 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Updating existing volume attachment record: 6b2e5017-2ee4-4541-9445-49e2758921c3 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 17:10:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:10:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_power_states {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid 241d8b82-c878-41e2-a307-764260a75d1b {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "241d8b82-c878-41e2-a307-764260a75d1b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TokdfRwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:10:11 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:10:11 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:10:11 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b09c5e-9b1e-4a99-b84b-3b9d0eb6e336]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 17:10:11 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[789248fd-8242-42e9-98f2-f24336e856b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3] added
Aug 09 17:10:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[368a36bb-a59a-4d6c-908e-2e5f2dc6c0c1]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1b7dcc-bd04-420d-a1d3-4b5eae6032ce]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TokdfRwx {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TokdfRwx" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[34194c8b-c64f-4107-aa31-f92971219cb7]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TokdfRwx'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[27816e32-1004-40a5-9592-a94722589be9]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e7240d-cf67-4ac6-8a81-fcaf97c3ac50]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 (non-flash)
Aug 09 17:10:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 (non-flash)
Aug 09 17:10:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d4379c-126a-44e9-ac2d-4d4944cb0360]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3, portal: 172.16.0.220,3260]
Aug 09 17:10:11 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3, portal: 172.16.0.220,3260] successful.
Aug 09 17:10:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2497c9c3-99e8-471b-af0e-992912a5def7]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[235356a7-1253-4dab-9fb6-9d259bb6eeee]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 (non-flash)
Aug 09 17:10:11 user nova-compute[73091]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 (non-flash)
Aug 09 17:10:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 (non-flash)
Aug 09 17:10:11 user nova-compute[73091]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 (non-flash)
Aug 09 17:10:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[30058704-95e7-4d50-adad-e43cfbb76f76]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:10:12 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:10:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TokdfRwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 17:10:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:10:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23466316263393635', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:10:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466316263393635', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 17:10:12 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'flavor' on Instance uuid 241d8b82-c878-41e2-a307-764260a75d1b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:10:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 17:10:12 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:10:12 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 09 17:10:12 user nova-compute[73091]:   <target dev="vdc" bus="virtio"/>
Aug 09 17:10:12 user nova-compute[73091]:   <serial>0c31f4ef-e403-4749-aff1-8944d5df01b3</serial>
Aug 09 17:10:12 user nova-compute[73091]: </disk>
Aug 09 17:10:12 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 17:10:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:10:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:10:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:10:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] No VIF found with MAC fa:16:3e:f1:54:aa, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 17:10:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ba603b7e-b161-4dbd-b830-04b0db41f338 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "241d8b82-c878-41e2-a307-764260a75d1b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.111s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:10:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "241d8b82-c878-41e2-a307-764260a75d1b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.173s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:10:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "241d8b82-c878-41e2-a307-764260a75d1b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:10:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:10:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "241d8b82-c878-41e2-a307-764260a75d1b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:10:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "241d8b82-c878-41e2-a307-764260a75d1b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:10:14 user nova-compute[73091]: INFO nova.compute.manager [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Detaching volume e3c06ef5-cc70-4573-bca2-82b9a78e13b7
Aug 09 17:10:14 user nova-compute[73091]: INFO nova.virt.block_device [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Attempting to driver detach volume e3c06ef5-cc70-4573-bca2-82b9a78e13b7 from mountpoint /dev/vdb
Aug 09 17:10:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Attempting to detach device vdb from instance 241d8b82-c878-41e2-a307-764260a75d1b from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 17:10:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:10:14 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:10:14 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:10:14 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:10:14 user nova-compute[73091]:   <serial>e3c06ef5-cc70-4573-bca2-82b9a78e13b7</serial>
Aug 09 17:10:14 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 17:10:14 user nova-compute[73091]: </disk>
Aug 09 17:10:14 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:10:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Successfully detached device vdb from instance 241d8b82-c878-41e2-a307-764260a75d1b from the persistent domain config.
Aug 09 17:10:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 241d8b82-c878-41e2-a307-764260a75d1b from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 17:10:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:10:14 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:10:14 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:10:14 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:10:14 user nova-compute[73091]:   <serial>e3c06ef5-cc70-4573-bca2-82b9a78e13b7</serial>
Aug 09 17:10:14 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 17:10:14 user nova-compute[73091]: </disk>
Aug 09 17:10:14 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691601015.4122066, 241d8b82-c878-41e2-a307-764260a75d1b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 241d8b82-c878-41e2-a307-764260a75d1b {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 17:10:15 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Successfully detached device vdb from instance 241d8b82-c878-41e2-a307-764260a75d1b from the live domain config.
Aug 09 17:10:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msjxRfla', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:10:15 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde4ac49-f2f9-4d2d-aca1-a699ad61c6bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ef78b4-2c03-4188-bd6e-1e0aec356796]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 (non-flash)
Aug 09 17:10:15 user nova-compute[73091]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 (non-flash)
Aug 09 17:10:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 (non-flash)
Aug 09 17:10:15 user nova-compute[73091]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 (non-flash)
Aug 09 17:10:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff060202710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e32aa7d-d528-4257-98cf-d6ce80950cb9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c082a448-df44-43b6-9381-a37a2ba5fcff]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee98c9c5-1aee-4e60-b3ee-49712f369277]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9b9233-88b0-476b-a8c9-c07ede87a046]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5829c8d-43d8-4262-a1ff-1e507cc4cb4d]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d1a8f1-3e44-40b6-bd12-5b60a4dc667b]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7, portal: 172.16.0.220,3260]
Aug 09 17:10:15 user nova-compute[73091]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7, portal: 172.16.0.220,3260] successful.
Aug 09 17:10:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c06ef5-cc70-4573-bca2-82b9a78e13b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70f68db-383b-41a6-9b13-ecd10d9de042]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] <== disconnect_volume: return (304ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vArfRgkM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:10:15 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:10:15 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:10:15 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e844e838-e1f9-4ee5-b680-ebd46ef55f1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 17:10:15 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7d8b37-9d88-43ac-956a-8a2b0ff3d414]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704] added
Aug 09 17:10:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f7fa73-c9ea-4a0d-94bb-fa438b136c39]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb611a2-8df3-43f0-b802-c09e86acdebb]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vArfRgkM {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vArfRgkM" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c28bd2-69b8-4d02-823f-b49af42bc2c1]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vArfRgkM'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[429c356a-526b-431c-9c0a-ac0cd8554e9c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ec2c70-a9da-407d-9ff6-fae72e1eebef]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 (non-flash)
Aug 09 17:10:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 (non-flash)
Aug 09 17:10:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5b9680-0ddf-47f5-b492-065d7058f073]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704, portal: 172.16.0.220,3260]
Aug 09 17:10:15 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704, portal: 172.16.0.220,3260] successful.
Aug 09 17:10:15 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.052s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30df614-5b98-4e3c-bedb-465119c17ec1]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[509e5f47-4597-4b4d-a4fa-c937287e57d4]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 (non-flash)
Aug 09 17:10:16 user nova-compute[73091]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 (non-flash)
Aug 09 17:10:16 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:10:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 (non-flash)
Aug 09 17:10:16 user nova-compute[73091]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 (non-flash)
Aug 09 17:10:16 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:10:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:10:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 17:10:16 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 17:10:16 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 17:10:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c9279c-2493-4b7d-b34e-4b16feea5823]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:16 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:10:16 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'flavor' on Instance uuid 241d8b82-c878-41e2-a307-764260a75d1b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:10:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ac58d978-b192-403e-a0e7-dd0b5fd9f188 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "241d8b82-c878-41e2-a307-764260a75d1b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.722s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vArfRgkM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26339666163316164', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339666163316164', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lazy-loading 'flavor' on Instance uuid 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 17:10:17 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:10:17 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:10:17 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:10:17 user nova-compute[73091]:   <serial>1325b266-11ea-4bcc-8951-1afba9418704</serial>
Aug 09 17:10:17 user nova-compute[73091]: </disk>
Aug 09 17:10:17 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "241d8b82-c878-41e2-a307-764260a75d1b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "241d8b82-c878-41e2-a307-764260a75d1b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:10:17 user nova-compute[73091]: INFO nova.compute.manager [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Detaching volume 0c31f4ef-e403-4749-aff1-8944d5df01b3
Aug 09 17:10:17 user nova-compute[73091]: INFO nova.virt.block_device [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Attempting to driver detach volume 0c31f4ef-e403-4749-aff1-8944d5df01b3 from mountpoint /dev/vdc
Aug 09 17:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Attempting to detach device vdc from instance 241d8b82-c878-41e2-a307-764260a75d1b from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:10:17 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:10:17 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 09 17:10:17 user nova-compute[73091]:   <target dev="vdc" bus="virtio"/>
Aug 09 17:10:17 user nova-compute[73091]:   <serial>0c31f4ef-e403-4749-aff1-8944d5df01b3</serial>
Aug 09 17:10:17 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 17:10:17 user nova-compute[73091]: </disk>
Aug 09 17:10:17 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:10:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Successfully detached device vdc from instance 241d8b82-c878-41e2-a307-764260a75d1b from the persistent domain config.
Aug 09 17:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 241d8b82-c878-41e2-a307-764260a75d1b from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:10:17 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:10:17 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 09 17:10:17 user nova-compute[73091]:   <target dev="vdc" bus="virtio"/>
Aug 09 17:10:17 user nova-compute[73091]:   <serial>0c31f4ef-e403-4749-aff1-8944d5df01b3</serial>
Aug 09 17:10:17 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 17:10:17 user nova-compute[73091]: </disk>
Aug 09 17:10:17 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] No VIF found with MAC fa:16:3e:55:df:10, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1445bb3d-36ed-4a72-a80d-d315f1e05b1f tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.454s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.682s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691601017.9000075, 241d8b82-c878-41e2-a307-764260a75d1b => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 241d8b82-c878-41e2-a307-764260a75d1b {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 17:10:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Successfully detached device vdc from instance 241d8b82-c878-41e2-a307-764260a75d1b from the live domain config.
Aug 09 17:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TokdfRwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:10:17 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da8c3f4-8ad1-4014-ab5a-41369aa8548f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93ab181-4650-4835-bdfd-87a3c0948d83]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 (non-flash)
Aug 09 17:10:17 user nova-compute[73091]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 (non-flash)
Aug 09 17:10:17 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 (non-flash)
Aug 09 17:10:17 user nova-compute[73091]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 (non-flash)
Aug 09 17:10:17 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0802ee200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bf6957-a174-412e-8ac1-238aa1cad0b8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e68589-2274-4902-8e6d-5035d74fea87]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44e2804-d9c2-4456-a193-96a3b169ce8e]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeaee87-2892-412c-8754-ef608b55b0dc]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fed2fd-d59d-471c-9728-7afd99615dee]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a8a491-eeb1-45a6-be06-0c8973a9c8c0]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3, portal: 172.16.0.220,3260]
Aug 09 17:10:18 user nova-compute[73091]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3, portal: 172.16.0.220,3260] successful.
Aug 09 17:10:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31f4ef-e403-4749-aff1-8944d5df01b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad47324-89ac-4f80-85d3-a81b47c8c5c6]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] <== disconnect_volume: return (284ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 17:10:18 user nova-compute[73091]: DEBUG nova.objects.instance [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'flavor' on Instance uuid 241d8b82-c878-41e2-a307-764260a75d1b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9554a318-e262-453a-ad3a-abc5407b4519 tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "241d8b82-c878-41e2-a307-764260a75d1b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.654s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:10:19 user nova-compute[73091]: INFO nova.compute.manager [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Detaching volume 1325b266-11ea-4bcc-8951-1afba9418704
Aug 09 17:10:19 user nova-compute[73091]: INFO nova.virt.block_device [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Attempting to driver detach volume 1325b266-11ea-4bcc-8951-1afba9418704 from mountpoint /dev/vdb
Aug 09 17:10:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Attempting to detach device vdb from instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 17:10:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:10:19 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:10:19 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:10:19 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:10:19 user nova-compute[73091]:   <serial>1325b266-11ea-4bcc-8951-1afba9418704</serial>
Aug 09 17:10:19 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 17:10:19 user nova-compute[73091]: </disk>
Aug 09 17:10:19 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:10:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Successfully detached device vdb from instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f from the persistent domain config.
Aug 09 17:10:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 17:10:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:10:19 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:10:19 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:10:19 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:10:19 user nova-compute[73091]:   <serial>1325b266-11ea-4bcc-8951-1afba9418704</serial>
Aug 09 17:10:19 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 17:10:19 user nova-compute[73091]: </disk>
Aug 09 17:10:19 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "241d8b82-c878-41e2-a307-764260a75d1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "241d8b82-c878-41e2-a307-764260a75d1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "241d8b82-c878-41e2-a307-764260a75d1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "241d8b82-c878-41e2-a307-764260a75d1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "241d8b82-c878-41e2-a307-764260a75d1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:10:20 user nova-compute[73091]: INFO nova.compute.manager [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Terminating instance
Aug 09 17:10:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691601020.1353106, 8c5cd921-9e64-475a-b796-7e6f6b95f07f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 17:10:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Successfully detached device vdb from instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f from the live domain config.
Aug 09 17:10:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vArfRgkM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:10:20 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2403244-87c8-4796-a857-ddda8d9e70d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ccc1a6-d410-411a-849d-102924f5b1e6]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 (non-flash)
Aug 09 17:10:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 (non-flash)
Aug 09 17:10:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0602cc280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[305f8f9e-e860-483f-aa57-01ba7fce330a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b396c0-9171-400d-881e-df741b342356]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce2a313-e00d-4141-bf92-30d8068912fd]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[06880503-e3a8-4489-8bb3-97a133673512]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c111f658-e3d8-4fdc-b71a-abdc6c766886]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4f8192-eeff-4ac1-b2db-266693aea5f4]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704, portal: 172.16.0.220,3260]
Aug 09 17:10:20 user nova-compute[73091]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704, portal: 172.16.0.220,3260] successful.
Aug 09 17:10:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1325b266-11ea-4bcc-8951-1afba9418704 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f140e1-a3aa-4d46-bf86-e6d082e84a1a]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] <== disconnect_volume: return (308ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-9fb0bb43-7105-44b1-8dd3-d116bc8228e5 req-6e7c1f5d-8037-44d9-a8dc-6b3d303d2dbd service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Received event network-vif-unplugged-b51fd660-c996-40ac-8d70-59d7d1064f1b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9fb0bb43-7105-44b1-8dd3-d116bc8228e5 req-6e7c1f5d-8037-44d9-a8dc-6b3d303d2dbd service nova] Acquiring lock "241d8b82-c878-41e2-a307-764260a75d1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9fb0bb43-7105-44b1-8dd3-d116bc8228e5 req-6e7c1f5d-8037-44d9-a8dc-6b3d303d2dbd service nova] Lock "241d8b82-c878-41e2-a307-764260a75d1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9fb0bb43-7105-44b1-8dd3-d116bc8228e5 req-6e7c1f5d-8037-44d9-a8dc-6b3d303d2dbd service nova] Lock "241d8b82-c878-41e2-a307-764260a75d1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-9fb0bb43-7105-44b1-8dd3-d116bc8228e5 req-6e7c1f5d-8037-44d9-a8dc-6b3d303d2dbd service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] No waiting events found dispatching network-vif-unplugged-b51fd660-c996-40ac-8d70-59d7d1064f1b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-9fb0bb43-7105-44b1-8dd3-d116bc8228e5 req-6e7c1f5d-8037-44d9-a8dc-6b3d303d2dbd service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Received event network-vif-unplugged-b51fd660-c996-40ac-8d70-59d7d1064f1b for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:10:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Instance destroyed successfully.
Aug 09 17:10:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lazy-loading 'resources' on Instance uuid 241d8b82-c878-41e2-a307-764260a75d1b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T17:07:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2089698245',display_name='tempest-AttachVolumeTestJSON-server-2089698245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2089698245',id=50,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzoqe5oW1sK2wV2r3kYTWJ0J9caIj8d9YMN+UZ7vILhGn/5jegEoyZVAvSiTdVkm9ITXuLV9/tbX0mQEpSEO3ngSQFPMFx90Ndq7e2wwSzGFXZJLNi0AarFjpK8gtCcTg==',key_name='tempest-keypair-1316376287',keypairs=<?>,launch_index=0,launched_at=2023-08-09T17:07:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cfa5b9d92df40d6bdfef6e8dfd3fad8',ramdisk_id='',reservation_id='r-uo9g985n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-99081524',owner_user_name='tempest-AttachVolumeTestJSON-99081524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T17:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e945ea4724446e5a6ee92a6b4d24ff0',uuid=241d8b82-c878-41e2-a307-764260a75d1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "address": "fa:16:3e:f1:54:aa", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51fd660-c9", "ovs_interfaceid": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converting VIF {"id": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "address": "fa:16:3e:f1:54:aa", "network": {"id": "bcf9dfec-3cab-48b4-a073-70d9d08535ab", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-737446635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cfa5b9d92df40d6bdfef6e8dfd3fad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51fd660-c9", "ovs_interfaceid": "b51fd660-c996-40ac-8d70-59d7d1064f1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:54:aa,bridge_name='br-int',has_traffic_filtering=True,id=b51fd660-c996-40ac-8d70-59d7d1064f1b,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51fd660-c9') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG os_vif [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:54:aa,bridge_name='br-int',has_traffic_filtering=True,id=b51fd660-c996-40ac-8d70-59d7d1064f1b,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51fd660-c9') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb51fd660-c9, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:10:20 user nova-compute[73091]: INFO os_vif [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:54:aa,bridge_name='br-int',has_traffic_filtering=True,id=b51fd660-c996-40ac-8d70-59d7d1064f1b,network=Network(bcf9dfec-3cab-48b4-a073-70d9d08535ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51fd660-c9')
Aug 09 17:10:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Deleting instance files /opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b_del
Aug 09 17:10:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Deletion of /opt/stack/data/nova/instances/241d8b82-c878-41e2-a307-764260a75d1b_del complete
Aug 09 17:10:20 user nova-compute[73091]: INFO nova.compute.manager [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 09 17:10:20 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 17:10:20 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 17:10:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lazy-loading 'flavor' on Instance uuid 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d7b0f185-3afc-4989-acd5-e18add4c8723 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.671s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:10:21 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:10:21 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Took 0.98 seconds to deallocate network for instance.
Aug 09 17:10:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-4709e1b2-8569-4062-b7f3-812b97df2257 req-1eef67ce-400a-4f04-b469-f4693da8eb16 service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Received event network-vif-deleted-b51fd660-c996-40ac-8d70-59d7d1064f1b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:10:22 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:10:22 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:10:22 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Deleted allocations for instance 241d8b82-c878-41e2-a307-764260a75d1b
Aug 09 17:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c9e5aead-193e-46d4-bfc3-d86f6c19b9cc tempest-AttachVolumeTestJSON-99081524 tempest-AttachVolumeTestJSON-99081524-project-member] Lock "241d8b82-c878-41e2-a307-764260a75d1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.213s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:10:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-62eaaadf-e72d-46e2-950b-69f5197ad25c req-fafbd303-59b0-4169-b106-bd5f1664334b service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Received event network-vif-plugged-b51fd660-c996-40ac-8d70-59d7d1064f1b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-62eaaadf-e72d-46e2-950b-69f5197ad25c req-fafbd303-59b0-4169-b106-bd5f1664334b service nova] Acquiring lock "241d8b82-c878-41e2-a307-764260a75d1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-62eaaadf-e72d-46e2-950b-69f5197ad25c req-fafbd303-59b0-4169-b106-bd5f1664334b service nova] Lock "241d8b82-c878-41e2-a307-764260a75d1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-62eaaadf-e72d-46e2-950b-69f5197ad25c req-fafbd303-59b0-4169-b106-bd5f1664334b service nova] Lock "241d8b82-c878-41e2-a307-764260a75d1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:10:22 user nova-compute[73091]: DEBUG nova.compute.manager [req-62eaaadf-e72d-46e2-950b-69f5197ad25c req-fafbd303-59b0-4169-b106-bd5f1664334b service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] No waiting events found dispatching network-vif-plugged-b51fd660-c996-40ac-8d70-59d7d1064f1b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:10:22 user nova-compute[73091]: WARNING nova.compute.manager [req-62eaaadf-e72d-46e2-950b-69f5197ad25c req-fafbd303-59b0-4169-b106-bd5f1664334b service nova] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Received unexpected event network-vif-plugged-b51fd660-c996-40ac-8d70-59d7d1064f1b for instance with vm_state deleted and task_state None.
Aug 09 17:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:10:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:10:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:10:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:10:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:10:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:10:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:10:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:10:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:10:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:10:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:10:35 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691601020.806134, 241d8b82-c878-41e2-a307-764260a75d1b => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:10:35 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] VM Stopped (Lifecycle Event)
Aug 09 17:10:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-59aca5d5-de4c-476b-8323-f3b0f3653119 None None] [instance: 241d8b82-c878-41e2-a307-764260a75d1b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:10:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:10:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:10:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:10:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 17:10:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:10:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:10:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:10:37 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:10:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Updating instance_info_cache with network_info: [{"id": "43cf267f-df5c-4b9e-b950-7837c9643aab", "address": "fa:16:3e:55:df:10", "network": {"id": "d6efa64f-c1e2-438e-82e7-3760c89c8492", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2060056810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba31c994632452891e5aa16005d62d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cf267f-df", "ovs_interfaceid": "43cf267f-df5c-4b9e-b950-7837c9643aab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:10:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:10:38 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:10:38 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:10:38 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:10:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:10:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:10:39 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:10:39 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:10:39 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8707MB free_disk=25.112770080566406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:10:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:10:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:10:39 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:10:39 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:10:39 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:10:39 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:10:39 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:10:39 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:10:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:10:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:10:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:10:44 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:10:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:10:46 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:10:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:10:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:11:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:11:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:11:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:11:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:11:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:11:13 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lazy-loading 'flavor' on Instance uuid 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:11:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:11:14 user nova-compute[73091]: INFO nova.compute.manager [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Attaching volume 332b86f2-fb11-43e6-9a77-03dd52bef785 to /dev/vdb
Aug 09 17:11:14 user nova-compute[73091]: DEBUG os_brick.utils [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c897161-99ef-4e5a-93fa-b1d47ea21611]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[faadce40-4c34-4673-94ec-c1e390626ca4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6880808f-1c01-4aac-87b3-f124c6f0bd2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3e11b7-0ebb-4fba-ae9d-568a1f194d0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:11:14 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 17:11:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd36c115-4bfb-4420-bd32-885a03b5ebb6]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG os_brick.utils [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:11:14 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Updating existing volume attachment record: a8d82656-b3d7-4b5f-80de-d421ae5632cf {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 17:11:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:11:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:11:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:11:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:11:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:11:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:11:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:11:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KubPdqSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:11:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:11:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:11:22 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c4d0a4-8420-48eb-adb0-1897777f6792]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 17:11:22 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[41198b82-5378-46ac-8601-ae7f2f65ecbd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785] added
Aug 09 17:11:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3f5f00-922d-4eaa-9883-68fafba158a8]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddab444-dfc2-41ca-8643-e3c0f04d4af6]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KubPdqSf {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KubPdqSf" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1983ae84-d628-40fb-b3ec-f7ccdc4fa2b7]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KubPdqSf'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e991bf-99f7-47ca-864d-835771dc0625]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec115ad-5400-41fa-922b-7cbf6ad22c96]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 17:11:22 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 17:11:22 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:11:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 17:11:22 user nova-compute[73091]: 
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3c72fd-2986-4536-9882-b9f3ff049676]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785, portal: 172.16.0.220,3260]
Aug 09 17:11:22 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785, portal: 172.16.0.220,3260] successful.
Aug 09 17:11:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9be2fdd-5b84-4a82-b670-e31879cd5016]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0cd7dd-1744-4901-b923-cd72c0f3d5f0]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 (non-flash)
Aug 09 17:11:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 (non-flash)
Aug 09 17:11:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f400a9-1b2d-4a3d-b213-b3dd4b99739e]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:11:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KubPdqSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 17:11:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:11:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23238656263646230', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:11:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238656263646230', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 17:11:23 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lazy-loading 'flavor' on Instance uuid 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:11:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 17:11:23 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:11:23 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:11:23 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:11:23 user nova-compute[73091]:   <serial>332b86f2-fb11-43e6-9a77-03dd52bef785</serial>
Aug 09 17:11:23 user nova-compute[73091]: </disk>
Aug 09 17:11:23 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 17:11:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:11:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:11:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] No VIF found with MAC fa:16:3e:55:df:10, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 17:11:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4ebd25c1-782e-4c07-a256-76a647ca90aa tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.113s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:11:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:11:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:11:26 user nova-compute[73091]: INFO nova.compute.manager [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Detaching volume 332b86f2-fb11-43e6-9a77-03dd52bef785
Aug 09 17:11:26 user nova-compute[73091]: INFO nova.virt.block_device [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Attempting to driver detach volume 332b86f2-fb11-43e6-9a77-03dd52bef785 from mountpoint /dev/vdb
Aug 09 17:11:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Attempting to detach device vdb from instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 17:11:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:11:26 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:11:26 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:11:26 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:11:26 user nova-compute[73091]:   <serial>332b86f2-fb11-43e6-9a77-03dd52bef785</serial>
Aug 09 17:11:26 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 17:11:26 user nova-compute[73091]: </disk>
Aug 09 17:11:26 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:11:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Successfully detached device vdb from instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f from the persistent domain config.
Aug 09 17:11:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 17:11:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:11:26 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:11:26 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:11:26 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:11:26 user nova-compute[73091]:   <serial>332b86f2-fb11-43e6-9a77-03dd52bef785</serial>
Aug 09 17:11:26 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 17:11:26 user nova-compute[73091]: </disk>
Aug 09 17:11:26 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:11:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691601087.1861913, 8c5cd921-9e64-475a-b796-7e6f6b95f07f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 17:11:27 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Successfully detached device vdb from instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f from the live domain config.
Aug 09 17:11:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KubPdqSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:11:27 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[473897ee-43c6-412e-b3f2-6914b7f984a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd648c7-8338-4a16-b346-6f9ed1dd26ac]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 (non-flash)
Aug 09 17:11:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 (non-flash)
Aug 09 17:11:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff060150a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ceb847f-a707-4cb2-b8f8-96e7fd8bef4e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a10e7f2-f8c3-4b47-9833-f06855047ebb]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdce003f-e4e1-47bc-bda2-40baf9fe3124]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c323fb1-15ac-412d-b797-1e199a340b34]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8f5a63-da57-409c-b313-4bbf01bac626]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34f2de7-aab6-470d-94f6-58a61a196dcb]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785, portal: 172.16.0.220,3260]
Aug 09 17:11:27 user nova-compute[73091]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785, portal: 172.16.0.220,3260] successful.
Aug 09 17:11:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:332b86f2-fb11-43e6-9a77-03dd52bef785 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1524226b-2eff-4f30-8695-09eaed4fa2df]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] <== disconnect_volume: return (275ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 17:11:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:11:28 user nova-compute[73091]: DEBUG nova.objects.instance [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lazy-loading 'flavor' on Instance uuid 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:11:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-12ba2c66-331d-4fb7-a155-5259fd137964 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.726s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:11:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:11:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:11:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:11:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:11:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:11:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:11:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:11:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:11:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:11:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 17:11:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:11:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:11:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:11:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:11:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Updating instance_info_cache with network_info: [{"id": "43cf267f-df5c-4b9e-b950-7837c9643aab", "address": "fa:16:3e:55:df:10", "network": {"id": "d6efa64f-c1e2-438e-82e7-3760c89c8492", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2060056810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba31c994632452891e5aa16005d62d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cf267f-df", "ovs_interfaceid": "43cf267f-df5c-4b9e-b950-7837c9643aab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:11:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:11:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:11:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:11:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:11:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:11:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:11:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:11:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:11:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:11:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:11:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:11:41 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:11:41 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:11:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8712MB free_disk=25.1097412109375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:11:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:11:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:11:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:11:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:11:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:11:41 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:11:41 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:11:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:11:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:11:41 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:11:45 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:11:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:11:48 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:11:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:11:53 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:11:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:12:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:12:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:12:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:12:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:12:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:12:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:12:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:12:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:12:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:12:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:12:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:12:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:12:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:12:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:12:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:12:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:12:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:12:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:12:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:12:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:12:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:12:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:12:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:12:41 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:12:41 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:12:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8756MB free_disk=25.099388122558594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:12:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:12:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:12:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:12:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:12:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:12:41 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:12:41 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:12:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:12:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:12:42 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:12:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:12:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 17:12:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:12:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:12:43 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:12:43 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:12:44 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Updating instance_info_cache with network_info: [{"id": "43cf267f-df5c-4b9e-b950-7837c9643aab", "address": "fa:16:3e:55:df:10", "network": {"id": "d6efa64f-c1e2-438e-82e7-3760c89c8492", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2060056810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba31c994632452891e5aa16005d62d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cf267f-df", "ovs_interfaceid": "43cf267f-df5c-4b9e-b950-7837c9643aab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:12:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-8c5cd921-9e64-475a-b796-7e6f6b95f07f" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:12:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:12:44 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:12:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:46 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:12:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:49 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:12:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:12:52 user nova-compute[73091]: INFO nova.compute.manager [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Terminating instance
Aug 09 17:12:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 17:12:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-ada7d8f9-487e-4e3c-afe3-0a4c76634eb9 req-dba82fb1-876d-4b48-9faa-0dfdc6240b96 service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Received event network-vif-unplugged-43cf267f-df5c-4b9e-b950-7837c9643aab {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ada7d8f9-487e-4e3c-afe3-0a4c76634eb9 req-dba82fb1-876d-4b48-9faa-0dfdc6240b96 service nova] Acquiring lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ada7d8f9-487e-4e3c-afe3-0a4c76634eb9 req-dba82fb1-876d-4b48-9faa-0dfdc6240b96 service nova] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ada7d8f9-487e-4e3c-afe3-0a4c76634eb9 req-dba82fb1-876d-4b48-9faa-0dfdc6240b96 service nova] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:12:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-ada7d8f9-487e-4e3c-afe3-0a4c76634eb9 req-dba82fb1-876d-4b48-9faa-0dfdc6240b96 service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] No waiting events found dispatching network-vif-unplugged-43cf267f-df5c-4b9e-b950-7837c9643aab {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:12:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-ada7d8f9-487e-4e3c-afe3-0a4c76634eb9 req-dba82fb1-876d-4b48-9faa-0dfdc6240b96 service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Received event network-vif-unplugged-43cf267f-df5c-4b9e-b950-7837c9643aab for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 17:12:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Instance destroyed successfully.
Aug 09 17:12:53 user nova-compute[73091]: DEBUG nova.objects.instance [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lazy-loading 'resources' on Instance uuid 8c5cd921-9e64-475a-b796-7e6f6b95f07f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:12:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T17:05:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-599722711',display_name='tempest-SnapshotDataIntegrityTests-server-599722711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-599722711',id=49,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYEmIeK5mTSazElT7Kf7hm6KPY/c24FIn+rE1AhVVwXjRAuv0EuSXdJ7A/gh/IZp2/NAO27aLrobzQlObPh5zoLFEE0q6YmOG2vWfhp5rRFuU/SOqiXZwz0UiTxbYjZ/g==',key_name='tempest-keypair-1751868432',keypairs=<?>,launch_index=0,launched_at=2023-08-09T17:05:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ba31c994632452891e5aa16005d62d8',ramdisk_id='',reservation_id='r-hmot0w5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1716172847',owner_user_name='tempest-SnapshotDataIntegrityTests-1716172847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T17:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ee5c215b9ee41ae87e81ae22496049a',uuid=8c5cd921-9e64-475a-b796-7e6f6b95f07f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43cf267f-df5c-4b9e-b950-7837c9643aab", "address": "fa:16:3e:55:df:10", "network": {"id": "d6efa64f-c1e2-438e-82e7-3760c89c8492", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2060056810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba31c994632452891e5aa16005d62d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cf267f-df", "ovs_interfaceid": "43cf267f-df5c-4b9e-b950-7837c9643aab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 17:12:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Converting VIF {"id": "43cf267f-df5c-4b9e-b950-7837c9643aab", "address": "fa:16:3e:55:df:10", "network": {"id": "d6efa64f-c1e2-438e-82e7-3760c89c8492", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2060056810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ba31c994632452891e5aa16005d62d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cf267f-df", "ovs_interfaceid": "43cf267f-df5c-4b9e-b950-7837c9643aab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:12:53 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:df:10,bridge_name='br-int',has_traffic_filtering=True,id=43cf267f-df5c-4b9e-b950-7837c9643aab,network=Network(d6efa64f-c1e2-438e-82e7-3760c89c8492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43cf267f-df') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:12:53 user nova-compute[73091]: DEBUG os_vif [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:df:10,bridge_name='br-int',has_traffic_filtering=True,id=43cf267f-df5c-4b9e-b950-7837c9643aab,network=Network(d6efa64f-c1e2-438e-82e7-3760c89c8492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43cf267f-df') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 17:12:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43cf267f-df, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:12:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:12:53 user nova-compute[73091]: INFO os_vif [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:df:10,bridge_name='br-int',has_traffic_filtering=True,id=43cf267f-df5c-4b9e-b950-7837c9643aab,network=Network(d6efa64f-c1e2-438e-82e7-3760c89c8492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43cf267f-df')
Aug 09 17:12:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Deleting instance files /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f_del
Aug 09 17:12:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Deletion of /opt/stack/data/nova/instances/8c5cd921-9e64-475a-b796-7e6f6b95f07f_del complete
Aug 09 17:12:53 user nova-compute[73091]: INFO nova.compute.manager [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 09 17:12:53 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 17:12:53 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 17:12:53 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 17:12:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:55 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:12:55 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Took 1.67 seconds to deallocate network for instance.
Aug 09 17:12:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-0e193019-179c-41ab-8ebd-5f4e7ba7e117 req-7bb95c14-4d03-4ecd-a607-b74e2a8ed81c service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Received event network-vif-plugged-43cf267f-df5c-4b9e-b950-7837c9643aab {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:12:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0e193019-179c-41ab-8ebd-5f4e7ba7e117 req-7bb95c14-4d03-4ecd-a607-b74e2a8ed81c service nova] Acquiring lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:12:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0e193019-179c-41ab-8ebd-5f4e7ba7e117 req-7bb95c14-4d03-4ecd-a607-b74e2a8ed81c service nova] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:12:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0e193019-179c-41ab-8ebd-5f4e7ba7e117 req-7bb95c14-4d03-4ecd-a607-b74e2a8ed81c service nova] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:12:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-0e193019-179c-41ab-8ebd-5f4e7ba7e117 req-7bb95c14-4d03-4ecd-a607-b74e2a8ed81c service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] No waiting events found dispatching network-vif-plugged-43cf267f-df5c-4b9e-b950-7837c9643aab {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:12:55 user nova-compute[73091]: WARNING nova.compute.manager [req-0e193019-179c-41ab-8ebd-5f4e7ba7e117 req-7bb95c14-4d03-4ecd-a607-b74e2a8ed81c service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Received unexpected event network-vif-plugged-43cf267f-df5c-4b9e-b950-7837c9643aab for instance with vm_state active and task_state deleting.
Aug 09 17:12:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-0e193019-179c-41ab-8ebd-5f4e7ba7e117 req-7bb95c14-4d03-4ecd-a607-b74e2a8ed81c service nova] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Received event network-vif-deleted-43cf267f-df5c-4b9e-b950-7837c9643aab {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:12:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:12:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:12:55 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:12:55 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:12:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:12:55 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Deleted allocations for instance 8c5cd921-9e64-475a-b796-7e6f6b95f07f
Aug 09 17:12:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-70270538-078a-491e-94b5-8c98cddbbd23 tempest-SnapshotDataIntegrityTests-1716172847 tempest-SnapshotDataIntegrityTests-1716172847-project-member] Lock "8c5cd921-9e64-475a-b796-7e6f6b95f07f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.886s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:12:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Acquiring lock "07aa9f18-0c38-4f01-b615-0e461d49e87b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:12:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "07aa9f18-0c38-4f01-b615-0e461d49e87b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:12:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 17:12:58 user nova-compute[73091]: INFO nova.compute.claims [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Claim successful on node user
Aug 09 17:12:58 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.175s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 17:12:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 17:12:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG nova.policy [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34e066161b66402f9dc6e359c3ddd0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fac85b3e008424289126e2990cf3723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 17:12:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Creating image(s)
Aug 09 17:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Acquiring lock "/opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "/opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "/opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.132s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.133s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk 1073741824" returned: 0 in 0.049s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.147s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:12:58 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Successfully created port: 67bcfa42-a511-45ae-8f97-c5a9b8624aaf {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 17:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:12:59 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Cannot resize image /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 17:12:59 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lazy-loading 'migration_context' on Instance uuid 07aa9f18-0c38-4f01-b615-0e461d49e87b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:12:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 17:12:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Ensure instance console log exists: /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 17:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:12:59 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Successfully updated port: 67bcfa42-a511-45ae-8f97-c5a9b8624aaf {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 17:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Acquiring lock "refresh_cache-07aa9f18-0c38-4f01-b615-0e461d49e87b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Acquired lock "refresh_cache-07aa9f18-0c38-4f01-b615-0e461d49e87b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:12:59 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 17:12:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-f61677ce-8b14-4fd7-9c4c-6a2404e3c320 req-5ae125da-29d7-4c8e-9cae-a0f5ca0d84f8 service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Received event network-changed-67bcfa42-a511-45ae-8f97-c5a9b8624aaf {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:12:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-f61677ce-8b14-4fd7-9c4c-6a2404e3c320 req-5ae125da-29d7-4c8e-9cae-a0f5ca0d84f8 service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Refreshing instance network info cache due to event network-changed-67bcfa42-a511-45ae-8f97-c5a9b8624aaf. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 17:12:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f61677ce-8b14-4fd7-9c4c-6a2404e3c320 req-5ae125da-29d7-4c8e-9cae-a0f5ca0d84f8 service nova] Acquiring lock "refresh_cache-07aa9f18-0c38-4f01-b615-0e461d49e87b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:12:59 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Updating instance_info_cache with network_info: [{"id": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "address": "fa:16:3e:eb:15:6d", "network": {"id": "281d680d-367d-48ab-a599-0af81a68a8be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2119620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fac85b3e008424289126e2990cf3723", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bcfa42-a5", "ovs_interfaceid": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Releasing lock "refresh_cache-07aa9f18-0c38-4f01-b615-0e461d49e87b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Instance network_info: |[{"id": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "address": "fa:16:3e:eb:15:6d", "network": {"id": "281d680d-367d-48ab-a599-0af81a68a8be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2119620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fac85b3e008424289126e2990cf3723", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bcfa42-a5", "ovs_interfaceid": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f61677ce-8b14-4fd7-9c4c-6a2404e3c320 req-5ae125da-29d7-4c8e-9cae-a0f5ca0d84f8 service nova] Acquired lock "refresh_cache-07aa9f18-0c38-4f01-b615-0e461d49e87b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.network.neutron [req-f61677ce-8b14-4fd7-9c4c-6a2404e3c320 req-5ae125da-29d7-4c8e-9cae-a0f5ca0d84f8 service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Refreshing network info cache for port 67bcfa42-a511-45ae-8f97-c5a9b8624aaf {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Start _get_guest_xml network_info=[{"id": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "address": "fa:16:3e:eb:15:6d", "network": {"id": "281d680d-367d-48ab-a599-0af81a68a8be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2119620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fac85b3e008424289126e2990cf3723", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bcfa42-a5", "ovs_interfaceid": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 17:13:00 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:13:00 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T17:12:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-134544557',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-134544557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1345445',id=51,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrdRtekdTdDDvT1efuYtD0d7O5lk+mwiHT9Y02Dt4+Jh0lWs6fnbq7XtQnVLGzuq6/3dvoPvvWvkAeZaIVoN5+ZaBn13+CAAoy1eNkC8TV/utybf8yLOe6O1s4EuTm0Sw==',key_name='tempest-keypair-959227307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fac85b3e008424289126e2990cf3723',ramdisk_id='',reservation_id='r-8txjgj8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-736664057',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T17:12:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34e066161b66402f9dc6e359c3ddd0d5',uuid=07aa9f18-0c38-4f01-b615-0e461d49e87b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "address": "fa:16:3e:eb:15:6d", "network": {"id": "281d680d-367d-48ab-a599-0af81a68a8be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2119620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fac85b3e008424289126e2990cf3723", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bcfa42-a5", "ovs_interfaceid": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Converting VIF {"id": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "address": "fa:16:3e:eb:15:6d", "network": {"id": "281d680d-367d-48ab-a599-0af81a68a8be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2119620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fac85b3e008424289126e2990cf3723", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bcfa42-a5", "ovs_interfaceid": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:15:6d,bridge_name='br-int',has_traffic_filtering=True,id=67bcfa42-a511-45ae-8f97-c5a9b8624aaf,network=Network(281d680d-367d-48ab-a599-0af81a68a8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67bcfa42-a5') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lazy-loading 'pci_devices' on Instance uuid 07aa9f18-0c38-4f01-b615-0e461d49e87b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 17:13:00 user nova-compute[73091]:   <uuid>07aa9f18-0c38-4f01-b615-0e461d49e87b</uuid>
Aug 09 17:13:00 user nova-compute[73091]:   <name>instance-00000033</name>
Aug 09 17:13:00 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 17:13:00 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 17:13:00 user nova-compute[73091]:   <metadata>
Aug 09 17:13:00 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 17:13:00 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 17:13:00 user nova-compute[73091]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-134544557</nova:name>
Aug 09 17:13:00 user nova-compute[73091]:       <nova:creationTime>2023-08-09 17:13:00</nova:creationTime>
Aug 09 17:13:00 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 17:13:00 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 17:13:00 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 17:13:00 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 17:13:00 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 17:13:00 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 17:13:00 user nova-compute[73091]:       </nova:flavor>
Aug 09 17:13:00 user nova-compute[73091]:       <nova:owner>
Aug 09 17:13:00 user nova-compute[73091]:         <nova:user uuid="34e066161b66402f9dc6e359c3ddd0d5">tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member</nova:user>
Aug 09 17:13:00 user nova-compute[73091]:         <nova:project uuid="4fac85b3e008424289126e2990cf3723">tempest-TestServerVolumeAttachScenarioOldVersion-736664057</nova:project>
Aug 09 17:13:00 user nova-compute[73091]:       </nova:owner>
Aug 09 17:13:00 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 17:13:00 user nova-compute[73091]:       <nova:ports>
Aug 09 17:13:00 user nova-compute[73091]:         <nova:port uuid="67bcfa42-a511-45ae-8f97-c5a9b8624aaf">
Aug 09 17:13:00 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 17:13:00 user nova-compute[73091]:         </nova:port>
Aug 09 17:13:00 user nova-compute[73091]:       </nova:ports>
Aug 09 17:13:00 user nova-compute[73091]:     </nova:instance>
Aug 09 17:13:00 user nova-compute[73091]:   </metadata>
Aug 09 17:13:00 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 17:13:00 user nova-compute[73091]:     <system>
Aug 09 17:13:00 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 17:13:00 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 17:13:00 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 17:13:00 user nova-compute[73091]:       <entry name="serial">07aa9f18-0c38-4f01-b615-0e461d49e87b</entry>
Aug 09 17:13:00 user nova-compute[73091]:       <entry name="uuid">07aa9f18-0c38-4f01-b615-0e461d49e87b</entry>
Aug 09 17:13:00 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 17:13:00 user nova-compute[73091]:     </system>
Aug 09 17:13:00 user nova-compute[73091]:   </sysinfo>
Aug 09 17:13:00 user nova-compute[73091]:   <os>
Aug 09 17:13:00 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 17:13:00 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 17:13:00 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 17:13:00 user nova-compute[73091]:   </os>
Aug 09 17:13:00 user nova-compute[73091]:   <features>
Aug 09 17:13:00 user nova-compute[73091]:     <acpi/>
Aug 09 17:13:00 user nova-compute[73091]:     <apic/>
Aug 09 17:13:00 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 17:13:00 user nova-compute[73091]:   </features>
Aug 09 17:13:00 user nova-compute[73091]:   <clock offset="utc">
Aug 09 17:13:00 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 17:13:00 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 17:13:00 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 17:13:00 user nova-compute[73091]:   </clock>
Aug 09 17:13:00 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 17:13:00 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 17:13:00 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 17:13:00 user nova-compute[73091]:   </cpu>
Aug 09 17:13:00 user nova-compute[73091]:   <devices>
Aug 09 17:13:00 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 17:13:00 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 17:13:00 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk"/>
Aug 09 17:13:00 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 17:13:00 user nova-compute[73091]:     </disk>
Aug 09 17:13:00 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 17:13:00 user nova-compute[73091]:       <mac address="fa:16:3e:eb:15:6d"/>
Aug 09 17:13:00 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 17:13:00 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 17:13:00 user nova-compute[73091]:       <target dev="tap67bcfa42-a5"/>
Aug 09 17:13:00 user nova-compute[73091]:     </interface>
Aug 09 17:13:00 user nova-compute[73091]:     <serial type="pty">
Aug 09 17:13:00 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/console.log" append="off"/>
Aug 09 17:13:00 user nova-compute[73091]:     </serial>
Aug 09 17:13:00 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 17:13:00 user nova-compute[73091]:     <video>
Aug 09 17:13:00 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 17:13:00 user nova-compute[73091]:     </video>
Aug 09 17:13:00 user nova-compute[73091]:     <rng model="virtio">
Aug 09 17:13:00 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 17:13:00 user nova-compute[73091]:     </rng>
Aug 09 17:13:00 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 17:13:00 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 17:13:00 user nova-compute[73091]:       <stats period="10"/>
Aug 09 17:13:00 user nova-compute[73091]:     </memballoon>
Aug 09 17:13:00 user nova-compute[73091]:   </devices>
Aug 09 17:13:00 user nova-compute[73091]: </domain>
Aug 09 17:13:00 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T17:12:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-134544557',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-134544557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1345445',id=51,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrdRtekdTdDDvT1efuYtD0d7O5lk+mwiHT9Y02Dt4+Jh0lWs6fnbq7XtQnVLGzuq6/3dvoPvvWvkAeZaIVoN5+ZaBn13+CAAoy1eNkC8TV/utybf8yLOe6O1s4EuTm0Sw==',key_name='tempest-keypair-959227307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fac85b3e008424289126e2990cf3723',ramdisk_id='',reservation_id='r-8txjgj8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-736664057',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T17:12:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34e066161b66402f9dc6e359c3ddd0d5',uuid=07aa9f18-0c38-4f01-b615-0e461d49e87b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "address": "fa:16:3e:eb:15:6d", "network": {"id": "281d680d-367d-48ab-a599-0af81a68a8be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2119620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fac85b3e008424289126e2990cf3723", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bcfa42-a5", "ovs_interfaceid": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Converting VIF {"id": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "address": "fa:16:3e:eb:15:6d", "network": {"id": "281d680d-367d-48ab-a599-0af81a68a8be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2119620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fac85b3e008424289126e2990cf3723", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bcfa42-a5", "ovs_interfaceid": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:15:6d,bridge_name='br-int',has_traffic_filtering=True,id=67bcfa42-a511-45ae-8f97-c5a9b8624aaf,network=Network(281d680d-367d-48ab-a599-0af81a68a8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67bcfa42-a5') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG os_vif [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:15:6d,bridge_name='br-int',has_traffic_filtering=True,id=67bcfa42-a511-45ae-8f97-c5a9b8624aaf,network=Network(281d680d-367d-48ab-a599-0af81a68a8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67bcfa42-a5') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67bcfa42-a5, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67bcfa42-a5, col_values=(('external_ids', {'iface-id': '67bcfa42-a511-45ae-8f97-c5a9b8624aaf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:15:6d', 'vm-uuid': '07aa9f18-0c38-4f01-b615-0e461d49e87b'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:00 user nova-compute[73091]: INFO os_vif [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:15:6d,bridge_name='br-int',has_traffic_filtering=True,id=67bcfa42-a511-45ae-8f97-c5a9b8624aaf,network=Network(281d680d-367d-48ab-a599-0af81a68a8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67bcfa42-a5')
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] No VIF found with MAC fa:16:3e:eb:15:6d, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.network.neutron [req-f61677ce-8b14-4fd7-9c4c-6a2404e3c320 req-5ae125da-29d7-4c8e-9cae-a0f5ca0d84f8 service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Updated VIF entry in instance network info cache for port 67bcfa42-a511-45ae-8f97-c5a9b8624aaf. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG nova.network.neutron [req-f61677ce-8b14-4fd7-9c4c-6a2404e3c320 req-5ae125da-29d7-4c8e-9cae-a0f5ca0d84f8 service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Updating instance_info_cache with network_info: [{"id": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "address": "fa:16:3e:eb:15:6d", "network": {"id": "281d680d-367d-48ab-a599-0af81a68a8be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2119620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fac85b3e008424289126e2990cf3723", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bcfa42-a5", "ovs_interfaceid": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f61677ce-8b14-4fd7-9c4c-6a2404e3c320 req-5ae125da-29d7-4c8e-9cae-a0f5ca0d84f8 service nova] Releasing lock "refresh_cache-07aa9f18-0c38-4f01-b615-0e461d49e87b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:13:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-8a668d08-a289-4d98-8a30-2aeb088de011 req-eadb6911-45f5-484f-a8f9-a1d2bd23af72 service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Received event network-vif-plugged-67bcfa42-a511-45ae-8f97-c5a9b8624aaf {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:13:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8a668d08-a289-4d98-8a30-2aeb088de011 req-eadb6911-45f5-484f-a8f9-a1d2bd23af72 service nova] Acquiring lock "07aa9f18-0c38-4f01-b615-0e461d49e87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:13:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8a668d08-a289-4d98-8a30-2aeb088de011 req-eadb6911-45f5-484f-a8f9-a1d2bd23af72 service nova] Lock "07aa9f18-0c38-4f01-b615-0e461d49e87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:13:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8a668d08-a289-4d98-8a30-2aeb088de011 req-eadb6911-45f5-484f-a8f9-a1d2bd23af72 service nova] Lock "07aa9f18-0c38-4f01-b615-0e461d49e87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:13:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-8a668d08-a289-4d98-8a30-2aeb088de011 req-eadb6911-45f5-484f-a8f9-a1d2bd23af72 service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] No waiting events found dispatching network-vif-plugged-67bcfa42-a511-45ae-8f97-c5a9b8624aaf {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:13:01 user nova-compute[73091]: WARNING nova.compute.manager [req-8a668d08-a289-4d98-8a30-2aeb088de011 req-eadb6911-45f5-484f-a8f9-a1d2bd23af72 service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Received unexpected event network-vif-plugged-67bcfa42-a511-45ae-8f97-c5a9b8624aaf for instance with vm_state building and task_state spawning.
Aug 09 17:13:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:03 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691601183.6972895, 07aa9f18-0c38-4f01-b615-0e461d49e87b => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:13:03 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] VM Resumed (Lifecycle Event)
Aug 09 17:13:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 17:13:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 17:13:03 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Instance spawned successfully.
Aug 09 17:13:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 17:13:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:13:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:13:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:13:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:13:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:13:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:13:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:13:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:13:03 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 17:13:03 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691601183.6985624, 07aa9f18-0c38-4f01-b615-0e461d49e87b => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:13:03 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] VM Started (Lifecycle Event)
Aug 09 17:13:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:13:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:13:03 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 17:13:03 user nova-compute[73091]: INFO nova.compute.manager [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Took 5.38 seconds to spawn the instance on the hypervisor.
Aug 09 17:13:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:13:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-9688c952-6f7c-4123-b7cc-8e9bc1185c7c req-4c160713-cba5-4924-9574-e6d21e07a301 service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Received event network-vif-plugged-67bcfa42-a511-45ae-8f97-c5a9b8624aaf {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:13:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9688c952-6f7c-4123-b7cc-8e9bc1185c7c req-4c160713-cba5-4924-9574-e6d21e07a301 service nova] Acquiring lock "07aa9f18-0c38-4f01-b615-0e461d49e87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:13:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9688c952-6f7c-4123-b7cc-8e9bc1185c7c req-4c160713-cba5-4924-9574-e6d21e07a301 service nova] Lock "07aa9f18-0c38-4f01-b615-0e461d49e87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:13:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9688c952-6f7c-4123-b7cc-8e9bc1185c7c req-4c160713-cba5-4924-9574-e6d21e07a301 service nova] Lock "07aa9f18-0c38-4f01-b615-0e461d49e87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:13:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-9688c952-6f7c-4123-b7cc-8e9bc1185c7c req-4c160713-cba5-4924-9574-e6d21e07a301 service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] No waiting events found dispatching network-vif-plugged-67bcfa42-a511-45ae-8f97-c5a9b8624aaf {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:13:03 user nova-compute[73091]: WARNING nova.compute.manager [req-9688c952-6f7c-4123-b7cc-8e9bc1185c7c req-4c160713-cba5-4924-9574-e6d21e07a301 service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Received unexpected event network-vif-plugged-67bcfa42-a511-45ae-8f97-c5a9b8624aaf for instance with vm_state building and task_state spawning.
Aug 09 17:13:03 user nova-compute[73091]: INFO nova.compute.manager [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Took 5.88 seconds to build instance.
Aug 09 17:13:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5edd55e2-d152-431e-8cd8-35f8d555195b tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "07aa9f18-0c38-4f01-b615-0e461d49e87b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.973s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:13:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:08 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691601173.5381873, 8c5cd921-9e64-475a-b796-7e6f6b95f07f => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:13:08 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] VM Stopped (Lifecycle Event)
Aug 09 17:13:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-882bb2c7-ace0-4aa9-8d90-2ba2b88654f5 None None] [instance: 8c5cd921-9e64-475a-b796-7e6f6b95f07f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:13:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:13:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:13:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:13:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:13:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:13:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:13:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:13:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:13:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:13:40 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:13:40 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:13:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:13:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:13:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:13:41 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:13:41 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:13:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8727MB free_disk=25.096908569335938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:13:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:13:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:13:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 07aa9f18-0c38-4f01-b615-0e461d49e87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:13:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:13:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:13:41 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:13:41 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:13:41 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:13:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:13:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:43 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:13:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:13:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 17:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-07aa9f18-0c38-4f01-b615-0e461d49e87b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-07aa9f18-0c38-4f01-b615-0e461d49e87b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:13:44 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:13:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid 07aa9f18-0c38-4f01-b615-0e461d49e87b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:13:44 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Updating instance_info_cache with network_info: [{"id": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "address": "fa:16:3e:eb:15:6d", "network": {"id": "281d680d-367d-48ab-a599-0af81a68a8be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2119620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fac85b3e008424289126e2990cf3723", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bcfa42-a5", "ovs_interfaceid": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:13:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-07aa9f18-0c38-4f01-b615-0e461d49e87b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:13:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:13:44 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:13:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:48 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:13:49 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:13:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:13:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:14:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:14:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:14:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:14:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:14:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:14:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:14:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:14:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:14:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:14:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:14:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:14:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:14:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:14:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:14:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:14:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:14:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:14:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 17:14:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:14:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:14:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:14:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:14:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:14:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:14:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:14:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:14:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:14:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:14:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:14:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:14:40 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:14:42 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:14:42 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:14:42 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:14:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:14:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:14:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:14:43 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:14:43 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:14:43 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8818MB free_disk=25.0955810546875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:14:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:14:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:14:43 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 07aa9f18-0c38-4f01-b615-0e461d49e87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:14:43 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:14:43 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:14:44 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing inventories for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 17:14:44 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Updating ProviderTree inventory for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 17:14:44 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Updating inventory in ProviderTree for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 17:14:44 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing aggregate associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 17:14:44 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing trait associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, traits: HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 17:14:44 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:14:44 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:14:44 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:14:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:14:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:14:46 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:14:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:14:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 17:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-07aa9f18-0c38-4f01-b615-0e461d49e87b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-07aa9f18-0c38-4f01-b615-0e461d49e87b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:14:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:14:46 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid 07aa9f18-0c38-4f01-b615-0e461d49e87b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:14:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Updating instance_info_cache with network_info: [{"id": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "address": "fa:16:3e:eb:15:6d", "network": {"id": "281d680d-367d-48ab-a599-0af81a68a8be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2119620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fac85b3e008424289126e2990cf3723", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bcfa42-a5", "ovs_interfaceid": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-07aa9f18-0c38-4f01-b615-0e461d49e87b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:14:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:14:48 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:14:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-b5b2a67d-cca8-41ee-acbb-c991c1794b9f req-d25cc609-44f2-4c49-9433-e4e4cd1101ba service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Received event network-changed-67bcfa42-a511-45ae-8f97-c5a9b8624aaf {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:14:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-b5b2a67d-cca8-41ee-acbb-c991c1794b9f req-d25cc609-44f2-4c49-9433-e4e4cd1101ba service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Refreshing instance network info cache due to event network-changed-67bcfa42-a511-45ae-8f97-c5a9b8624aaf. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 17:14:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b5b2a67d-cca8-41ee-acbb-c991c1794b9f req-d25cc609-44f2-4c49-9433-e4e4cd1101ba service nova] Acquiring lock "refresh_cache-07aa9f18-0c38-4f01-b615-0e461d49e87b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:14:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b5b2a67d-cca8-41ee-acbb-c991c1794b9f req-d25cc609-44f2-4c49-9433-e4e4cd1101ba service nova] Acquired lock "refresh_cache-07aa9f18-0c38-4f01-b615-0e461d49e87b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:14:48 user nova-compute[73091]: DEBUG nova.network.neutron [req-b5b2a67d-cca8-41ee-acbb-c991c1794b9f req-d25cc609-44f2-4c49-9433-e4e4cd1101ba service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Refreshing network info cache for port 67bcfa42-a511-45ae-8f97-c5a9b8624aaf {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 17:14:49 user nova-compute[73091]: DEBUG nova.network.neutron [req-b5b2a67d-cca8-41ee-acbb-c991c1794b9f req-d25cc609-44f2-4c49-9433-e4e4cd1101ba service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Updated VIF entry in instance network info cache for port 67bcfa42-a511-45ae-8f97-c5a9b8624aaf. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 17:14:49 user nova-compute[73091]: DEBUG nova.network.neutron [req-b5b2a67d-cca8-41ee-acbb-c991c1794b9f req-d25cc609-44f2-4c49-9433-e4e4cd1101ba service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Updating instance_info_cache with network_info: [{"id": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "address": "fa:16:3e:eb:15:6d", "network": {"id": "281d680d-367d-48ab-a599-0af81a68a8be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2119620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fac85b3e008424289126e2990cf3723", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bcfa42-a5", "ovs_interfaceid": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:14:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b5b2a67d-cca8-41ee-acbb-c991c1794b9f req-d25cc609-44f2-4c49-9433-e4e4cd1101ba service nova] Releasing lock "refresh_cache-07aa9f18-0c38-4f01-b615-0e461d49e87b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:14:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:14:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:14:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:14:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:14:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:14:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:14:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:14:50 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Acquiring lock "07aa9f18-0c38-4f01-b615-0e461d49e87b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "07aa9f18-0c38-4f01-b615-0e461d49e87b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG nova.objects.instance [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lazy-loading 'flavor' on Instance uuid 07aa9f18-0c38-4f01-b615-0e461d49e87b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "07aa9f18-0c38-4f01-b615-0e461d49e87b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Acquiring lock "07aa9f18-0c38-4f01-b615-0e461d49e87b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "07aa9f18-0c38-4f01-b615-0e461d49e87b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:14:53 user nova-compute[73091]: INFO nova.compute.manager [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Attaching volume 75701a50-aea6-44da-b6b7-2d5a7b8d7329 to /dev/vdb
Aug 09 17:14:53 user nova-compute[73091]: DEBUG os_brick.utils [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26df82a-ec05-4775-9e0f-89a6d2bed161]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[871f5562-3358-481d-b48a-e0982adf847c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fe9f9e-af09-4896-aab7-e881f8fdb85c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf711bd-c09f-44e1-8d26-7fd04638c327]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:14:53 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 17:14:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1f47e9-e437-4c88-b004-e72079fe75d0]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG os_brick.utils [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:14:53 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Updating existing volume attachment record: 09c99618-f2f4-4225-ae7e-48e94b2e1c11 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 17:14:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:14:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:14:58 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:14:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 17:14:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 17:15:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJsUIVtm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:15:01 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:15:01 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:15:01 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3e923b-caf0-40f9-8349-49d12ad7297c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 17:15:01 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3463430-e926-4054-9e36-5211eeb02f7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329] added
Aug 09 17:15:01 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e302761-8d5d-4716-9892-e0ae7ec94753]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[30681cd4-e19f-4dd4-bb40-d82532b4be96]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJsUIVtm {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJsUIVtm" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[907a81c2-c936-4ef6-9c98-35d51ab1ebee]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZJsUIVtm'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[85533897-630b-44bc-83e5-7c024fae72de]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a73507-927e-4480-ba6a-d2f362ec06f6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 17:15:01 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 17:15:01 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:15:01 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 17:15:01 user nova-compute[73091]: 
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[354b3685-69b9-43d5-9299-cc77500b14bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329, portal: 172.16.0.220,3260]
Aug 09 17:15:01 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329, portal: 172.16.0.220,3260] successful.
Aug 09 17:15:01 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[563b38a3-2ebb-481f-bd55-6b5034fba17f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0051198a-a4a2-4fe5-96b4-52a6bec38137]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 (non-flash)
Aug 09 17:15:01 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 (non-flash)
Aug 09 17:15:01 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e323c9-4cb6-4af6-ade4-71235b8caa78]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:15:01 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:15:02 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:15:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJsUIVtm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 17:15:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:15:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26531323263613964', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:15:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531323263613964', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 17:15:02 user nova-compute[73091]: DEBUG nova.objects.instance [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lazy-loading 'flavor' on Instance uuid 07aa9f18-0c38-4f01-b615-0e461d49e87b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:15:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 17:15:02 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:15:02 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:15:02 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:15:02 user nova-compute[73091]:   <serial>75701a50-aea6-44da-b6b7-2d5a7b8d7329</serial>
Aug 09 17:15:02 user nova-compute[73091]: </disk>
Aug 09 17:15:02 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 17:15:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:15:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:15:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] No VIF found with MAC fa:16:3e:eb:15:6d, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 17:15:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-67cb46cb-85c2-4491-a919-0d8dbb655bcb tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "07aa9f18-0c38-4f01-b615-0e461d49e87b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.762s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Acquiring lock "07aa9f18-0c38-4f01-b615-0e461d49e87b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "07aa9f18-0c38-4f01-b615-0e461d49e87b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:15:05 user nova-compute[73091]: INFO nova.compute.manager [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Detaching volume 75701a50-aea6-44da-b6b7-2d5a7b8d7329
Aug 09 17:15:05 user nova-compute[73091]: INFO nova.virt.block_device [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Attempting to driver detach volume 75701a50-aea6-44da-b6b7-2d5a7b8d7329 from mountpoint /dev/vdb
Aug 09 17:15:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Attempting to detach device vdb from instance 07aa9f18-0c38-4f01-b615-0e461d49e87b from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:15:05 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:15:05 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:15:05 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:15:05 user nova-compute[73091]:   <serial>75701a50-aea6-44da-b6b7-2d5a7b8d7329</serial>
Aug 09 17:15:05 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 17:15:05 user nova-compute[73091]: </disk>
Aug 09 17:15:05 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:15:05 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Successfully detached device vdb from instance 07aa9f18-0c38-4f01-b615-0e461d49e87b from the persistent domain config.
Aug 09 17:15:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07aa9f18-0c38-4f01-b615-0e461d49e87b from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:15:05 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:15:05 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:15:05 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:15:05 user nova-compute[73091]:   <serial>75701a50-aea6-44da-b6b7-2d5a7b8d7329</serial>
Aug 09 17:15:05 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 17:15:05 user nova-compute[73091]: </disk>
Aug 09 17:15:05 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691601305.714463, 07aa9f18-0c38-4f01-b615-0e461d49e87b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07aa9f18-0c38-4f01-b615-0e461d49e87b {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 17:15:05 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Successfully detached device vdb from instance 07aa9f18-0c38-4f01-b615-0e461d49e87b from the live domain config.
Aug 09 17:15:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJsUIVtm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:15:05 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:15:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c3090c-3811-4da1-be0c-72c4bf2048e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0baca40e-9b8f-44b3-9b23-8ce3ae795bcc]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 (non-flash)
Aug 09 17:15:05 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 (non-flash)
Aug 09 17:15:05 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff060748700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[586d532b-f7e3-4b27-a34d-3e6abd3270eb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4847a92-67a9-4ce7-a78a-e8e6c8e4cf0e]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52bf1a6-848d-476e-99ce-89761876b742]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd9b138-bbd7-44a4-b5b5-8fdd0822c4c3]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3c21d0-2016-4442-9396-d1a5c20eac1c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3399bd-3c27-4608-bc47-6f11aef3d8be]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329, portal: 172.16.0.220,3260]
Aug 09 17:15:05 user nova-compute[73091]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329, portal: 172.16.0.220,3260] successful.
Aug 09 17:15:05 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75701a50-aea6-44da-b6b7-2d5a7b8d7329 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbce1ed-b1ee-4d5f-a46e-5f3547957c69]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:15:06 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] <== disconnect_volume: return (281ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:15:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 17:15:06 user nova-compute[73091]: DEBUG nova.objects.instance [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lazy-loading 'flavor' on Instance uuid 07aa9f18-0c38-4f01-b615-0e461d49e87b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-77dfbf7a-3809-4653-8b9e-8afebdb8b028 tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "07aa9f18-0c38-4f01-b615-0e461d49e87b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.587s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:15:06 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:15:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:15:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:15:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:15:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:15:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:15:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:15:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:15:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:15:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:15:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:15:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:15:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:15:41 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:15:44 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:15:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:15:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 17:15:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-07aa9f18-0c38-4f01-b615-0e461d49e87b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:15:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-07aa9f18-0c38-4f01-b615-0e461d49e87b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:15:44 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:15:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid 07aa9f18-0c38-4f01-b615-0e461d49e87b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:15:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:15:45 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Updating instance_info_cache with network_info: [{"id": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "address": "fa:16:3e:eb:15:6d", "network": {"id": "281d680d-367d-48ab-a599-0af81a68a8be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2119620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fac85b3e008424289126e2990cf3723", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bcfa42-a5", "ovs_interfaceid": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:15:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-07aa9f18-0c38-4f01-b615-0e461d49e87b" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:15:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:15:45 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:15:45 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:15:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:15:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:15:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:15:45 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:15:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:15:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:15:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:15:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:15:46 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8808MB free_disk=25.094390869140625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:15:46 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 07aa9f18-0c38-4f01-b615-0e461d49e87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:15:46 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:15:46 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:15:46 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:15:46 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:15:46 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:15:49 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:15:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:15:50 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:15:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:00 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:16:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Acquiring lock "07aa9f18-0c38-4f01-b615-0e461d49e87b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:16:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "07aa9f18-0c38-4f01-b615-0e461d49e87b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:16:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Acquiring lock "07aa9f18-0c38-4f01-b615-0e461d49e87b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:16:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "07aa9f18-0c38-4f01-b615-0e461d49e87b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:16:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "07aa9f18-0c38-4f01-b615-0e461d49e87b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:16:00 user nova-compute[73091]: INFO nova.compute.manager [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Terminating instance
Aug 09 17:16:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 17:16:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-0be8917e-cbd6-444f-ba7f-f7fc40061585 req-d787df25-02cb-42c1-8315-3a3e0dd92755 service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Received event network-vif-unplugged-67bcfa42-a511-45ae-8f97-c5a9b8624aaf {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0be8917e-cbd6-444f-ba7f-f7fc40061585 req-d787df25-02cb-42c1-8315-3a3e0dd92755 service nova] Acquiring lock "07aa9f18-0c38-4f01-b615-0e461d49e87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0be8917e-cbd6-444f-ba7f-f7fc40061585 req-d787df25-02cb-42c1-8315-3a3e0dd92755 service nova] Lock "07aa9f18-0c38-4f01-b615-0e461d49e87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0be8917e-cbd6-444f-ba7f-f7fc40061585 req-d787df25-02cb-42c1-8315-3a3e0dd92755 service nova] Lock "07aa9f18-0c38-4f01-b615-0e461d49e87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-0be8917e-cbd6-444f-ba7f-f7fc40061585 req-d787df25-02cb-42c1-8315-3a3e0dd92755 service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] No waiting events found dispatching network-vif-unplugged-67bcfa42-a511-45ae-8f97-c5a9b8624aaf {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-0be8917e-cbd6-444f-ba7f-f7fc40061585 req-d787df25-02cb-42c1-8315-3a3e0dd92755 service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Received event network-vif-unplugged-67bcfa42-a511-45ae-8f97-c5a9b8624aaf for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Instance destroyed successfully.
Aug 09 17:16:01 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lazy-loading 'resources' on Instance uuid 07aa9f18-0c38-4f01-b615-0e461d49e87b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T17:12:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-134544557',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-134544557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1345445',id=51,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrdRtekdTdDDvT1efuYtD0d7O5lk+mwiHT9Y02Dt4+Jh0lWs6fnbq7XtQnVLGzuq6/3dvoPvvWvkAeZaIVoN5+ZaBn13+CAAoy1eNkC8TV/utybf8yLOe6O1s4EuTm0Sw==',key_name='tempest-keypair-959227307',keypairs=<?>,launch_index=0,launched_at=2023-08-09T17:13:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fac85b3e008424289126e2990cf3723',ramdisk_id='',reservation_id='r-8txjgj8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-736664057',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T17:13:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34e066161b66402f9dc6e359c3ddd0d5',uuid=07aa9f18-0c38-4f01-b615-0e461d49e87b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "address": "fa:16:3e:eb:15:6d", "network": {"id": "281d680d-367d-48ab-a599-0af81a68a8be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2119620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fac85b3e008424289126e2990cf3723", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bcfa42-a5", "ovs_interfaceid": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Converting VIF {"id": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "address": "fa:16:3e:eb:15:6d", "network": {"id": "281d680d-367d-48ab-a599-0af81a68a8be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2119620757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fac85b3e008424289126e2990cf3723", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bcfa42-a5", "ovs_interfaceid": "67bcfa42-a511-45ae-8f97-c5a9b8624aaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:15:6d,bridge_name='br-int',has_traffic_filtering=True,id=67bcfa42-a511-45ae-8f97-c5a9b8624aaf,network=Network(281d680d-367d-48ab-a599-0af81a68a8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67bcfa42-a5') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG os_vif [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:15:6d,bridge_name='br-int',has_traffic_filtering=True,id=67bcfa42-a511-45ae-8f97-c5a9b8624aaf,network=Network(281d680d-367d-48ab-a599-0af81a68a8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67bcfa42-a5') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67bcfa42-a5, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:16:01 user nova-compute[73091]: INFO os_vif [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:15:6d,bridge_name='br-int',has_traffic_filtering=True,id=67bcfa42-a511-45ae-8f97-c5a9b8624aaf,network=Network(281d680d-367d-48ab-a599-0af81a68a8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67bcfa42-a5')
Aug 09 17:16:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Deleting instance files /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b_del
Aug 09 17:16:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Deletion of /opt/stack/data/nova/instances/07aa9f18-0c38-4f01-b615-0e461d49e87b_del complete
Aug 09 17:16:01 user nova-compute[73091]: INFO nova.compute.manager [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 17:16:01 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 17:16:01 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 17:16:03 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:16:03 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Took 1.40 seconds to deallocate network for instance.
Aug 09 17:16:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-36e04428-3146-4bd6-9554-907eedbc68a6 req-bf0bd3b5-2175-4567-a21e-ef32dec55c5c service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Received event network-vif-deleted-67bcfa42-a511-45ae-8f97-c5a9b8624aaf {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:16:03 user nova-compute[73091]: INFO nova.compute.manager [req-36e04428-3146-4bd6-9554-907eedbc68a6 req-bf0bd3b5-2175-4567-a21e-ef32dec55c5c service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Neutron deleted interface 67bcfa42-a511-45ae-8f97-c5a9b8624aaf; detaching it from the instance and deleting it from the info cache
Aug 09 17:16:03 user nova-compute[73091]: DEBUG nova.network.neutron [req-36e04428-3146-4bd6-9554-907eedbc68a6 req-bf0bd3b5-2175-4567-a21e-ef32dec55c5c service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:16:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-36e04428-3146-4bd6-9554-907eedbc68a6 req-bf0bd3b5-2175-4567-a21e-ef32dec55c5c service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Detach interface failed, port_id=67bcfa42-a511-45ae-8f97-c5a9b8624aaf, reason: Instance 07aa9f18-0c38-4f01-b615-0e461d49e87b could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 17:16:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:16:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:16:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-bcf4d8e1-bf6f-4993-b93a-2ae163f50566 req-607b2708-b072-43b3-b268-cb33265dfd78 service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Received event network-vif-plugged-67bcfa42-a511-45ae-8f97-c5a9b8624aaf {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:16:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bcf4d8e1-bf6f-4993-b93a-2ae163f50566 req-607b2708-b072-43b3-b268-cb33265dfd78 service nova] Acquiring lock "07aa9f18-0c38-4f01-b615-0e461d49e87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:16:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bcf4d8e1-bf6f-4993-b93a-2ae163f50566 req-607b2708-b072-43b3-b268-cb33265dfd78 service nova] Lock "07aa9f18-0c38-4f01-b615-0e461d49e87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:16:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bcf4d8e1-bf6f-4993-b93a-2ae163f50566 req-607b2708-b072-43b3-b268-cb33265dfd78 service nova] Lock "07aa9f18-0c38-4f01-b615-0e461d49e87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:16:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-bcf4d8e1-bf6f-4993-b93a-2ae163f50566 req-607b2708-b072-43b3-b268-cb33265dfd78 service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] No waiting events found dispatching network-vif-plugged-67bcfa42-a511-45ae-8f97-c5a9b8624aaf {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:16:03 user nova-compute[73091]: WARNING nova.compute.manager [req-bcf4d8e1-bf6f-4993-b93a-2ae163f50566 req-607b2708-b072-43b3-b268-cb33265dfd78 service nova] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Received unexpected event network-vif-plugged-67bcfa42-a511-45ae-8f97-c5a9b8624aaf for instance with vm_state deleted and task_state None.
Aug 09 17:16:03 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:16:03 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:16:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:16:03 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Deleted allocations for instance 07aa9f18-0c38-4f01-b615-0e461d49e87b
Aug 09 17:16:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a1c8f339-b7fa-4cb7-99e3-505bc4657def tempest-TestServerVolumeAttachScenarioOldVersion-736664057 tempest-TestServerVolumeAttachScenarioOldVersion-736664057-project-member] Lock "07aa9f18-0c38-4f01-b615-0e461d49e87b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.601s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:16:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:16 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691601361.6823833, 07aa9f18-0c38-4f01-b615-0e461d49e87b => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:16:16 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] VM Stopped (Lifecycle Event)
Aug 09 17:16:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-21392911-4970-4bab-82c8-1a964c23dd09 None None] [instance: 07aa9f18-0c38-4f01-b615-0e461d49e87b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:16:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:16:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:16:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:16:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:16:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:16:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:16:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:16:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:16:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:16:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:43 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:16:45 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:16:45 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:16:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:16:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:16:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:16:45 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:16:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:16:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:16:46 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8964MB free_disk=25.12158966064453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:16:46 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:16:46 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:16:46 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:16:46 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:16:46 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:16:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:16:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:16:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 17:16:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 17:16:49 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:16:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:52 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:16:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:16:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:17:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:17:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:17:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:17:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:17:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:17:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:17:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:17:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:17:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:17:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:45 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:17:45 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:17:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:17:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:17:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:17:45 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:17:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "61c61e32-848f-4cd4-847a-6760c6561220" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:17:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:17:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:17:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:17:46 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8636MB free_disk=25.107540130615234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:17:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:17:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.004s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:17:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 17:17:46 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 61c61e32-848f-4cd4-847a-6760c6561220 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 09 17:17:46 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:17:46 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.585s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.096s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 17:17:47 user nova-compute[73091]: INFO nova.compute.claims [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Claim successful on node user
Aug 09 17:17:47 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 17:17:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 17:17:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG nova.policy [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9de2eb02822249fea3720bda90a2621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5cb5537975476ba8d5de1e14a0ad0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 17:17:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Creating image(s)
Aug 09 17:17:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "/opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "/opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "/opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:17:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk 1073741824 {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff,backing_fmt=raw /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk 1073741824" returned: 0 in 0.067s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "6d61bcd6e193d2258cec1205319c2faab1b70eff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Skipping network cache update for instance because it is Building. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d61bcd6e193d2258cec1205319c2faab1b70eff --force-share --output=json" returned: 0 in 0.168s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Cannot resize image /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lazy-loading 'migration_context' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Ensure instance console log exists: /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:17:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Successfully created port: 5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 17:17:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Successfully updated port: 5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 17:17:49 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquired lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:17:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 17:17:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-370c5a4c-5e0b-4e36-be1a-952b54e8cfec req-b648682c-07ec-43a3-b498-7b4e55cf3b40 service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Received event network-changed-5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:17:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-370c5a4c-5e0b-4e36-be1a-952b54e8cfec req-b648682c-07ec-43a3-b498-7b4e55cf3b40 service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Refreshing instance network info cache due to event network-changed-5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 17:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-370c5a4c-5e0b-4e36-be1a-952b54e8cfec req-b648682c-07ec-43a3-b498-7b4e55cf3b40 service nova] Acquiring lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:17:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updating instance_info_cache with network_info: [{"id": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "address": "fa:16:3e:e3:69:cd", "network": {"id": "8ecbc517-fb95-47b6-b3f0-03660f8a91b5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1897535615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5cb5537975476ba8d5de1e14a0ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2a8b00-6d", "ovs_interfaceid": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Releasing lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Instance network_info: |[{"id": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "address": "fa:16:3e:e3:69:cd", "network": {"id": "8ecbc517-fb95-47b6-b3f0-03660f8a91b5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1897535615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5cb5537975476ba8d5de1e14a0ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2a8b00-6d", "ovs_interfaceid": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-370c5a4c-5e0b-4e36-be1a-952b54e8cfec req-b648682c-07ec-43a3-b498-7b4e55cf3b40 service nova] Acquired lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.network.neutron [req-370c5a4c-5e0b-4e36-be1a-952b54e8cfec req-b648682c-07ec-43a3-b498-7b4e55cf3b40 service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Refreshing network info cache for port 5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Start _get_guest_xml network_info=[{"id": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "address": "fa:16:3e:e3:69:cd", "network": {"id": "8ecbc517-fb95-47b6-b3f0-03660f8a91b5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1897535615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5cb5537975476ba8d5de1e14a0ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2a8b00-6d", "ovs_interfaceid": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'image_id': 'bb270def-cd6e-4463-89d8-f4240c9cb724'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 17:17:50 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:17:50 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T16:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T16:29:23Z,direct_url=<?>,disk_format='qcow2',id=bb270def-cd6e-4463-89d8-f4240c9cb724,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60dfd79245eb479985ac7f4dd5ed5356',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T16:29:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T17:17:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1810440724',display_name='tempest-SnapshotDataIntegrityTests-server-1810440724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1810440724',id=52,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8t2Y/xncU+3b4UBh4zJPvG1mlmtwyWw5XSJuxKRiMQjCNOiUNAltENK7DjRt7TB70d6eag8ew5ZdOzBRAQnH7KwldDyR51X49U+DtfQh7JdsaLyS6x0tCF15flcoYL3w==',key_name='tempest-keypair-1391873310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a5cb5537975476ba8d5de1e14a0ad0d',ramdisk_id='',reservation_id='r-xnq3u9t5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1957788907',owner_user_name='tempest-SnapshotDataIntegrityTests-1957788907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T17:17:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9de2eb02822249fea3720bda90a2621a',uuid=61c61e32-848f-4cd4-847a-6760c6561220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "address": "fa:16:3e:e3:69:cd", "network": {"id": "8ecbc517-fb95-47b6-b3f0-03660f8a91b5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1897535615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5cb5537975476ba8d5de1e14a0ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2a8b00-6d", "ovs_interfaceid": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Converting VIF {"id": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "address": "fa:16:3e:e3:69:cd", "network": {"id": "8ecbc517-fb95-47b6-b3f0-03660f8a91b5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1897535615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5cb5537975476ba8d5de1e14a0ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2a8b00-6d", "ovs_interfaceid": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f,network=Network(8ecbc517-fb95-47b6-b3f0-03660f8a91b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2a8b00-6d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lazy-loading 'pci_devices' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] End _get_guest_xml xml=<domain type="kvm">
Aug 09 17:17:50 user nova-compute[73091]:   <uuid>61c61e32-848f-4cd4-847a-6760c6561220</uuid>
Aug 09 17:17:50 user nova-compute[73091]:   <name>instance-00000034</name>
Aug 09 17:17:50 user nova-compute[73091]:   <memory>524288</memory>
Aug 09 17:17:50 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 09 17:17:50 user nova-compute[73091]:   <metadata>
Aug 09 17:17:50 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 17:17:50 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 09 17:17:50 user nova-compute[73091]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1810440724</nova:name>
Aug 09 17:17:50 user nova-compute[73091]:       <nova:creationTime>2023-08-09 17:17:50</nova:creationTime>
Aug 09 17:17:50 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 09 17:17:50 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 09 17:17:50 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 09 17:17:50 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 09 17:17:50 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 17:17:50 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 09 17:17:50 user nova-compute[73091]:       </nova:flavor>
Aug 09 17:17:50 user nova-compute[73091]:       <nova:owner>
Aug 09 17:17:50 user nova-compute[73091]:         <nova:user uuid="9de2eb02822249fea3720bda90a2621a">tempest-SnapshotDataIntegrityTests-1957788907-project-member</nova:user>
Aug 09 17:17:50 user nova-compute[73091]:         <nova:project uuid="8a5cb5537975476ba8d5de1e14a0ad0d">tempest-SnapshotDataIntegrityTests-1957788907</nova:project>
Aug 09 17:17:50 user nova-compute[73091]:       </nova:owner>
Aug 09 17:17:50 user nova-compute[73091]:       <nova:root type="image" uuid="bb270def-cd6e-4463-89d8-f4240c9cb724"/>
Aug 09 17:17:50 user nova-compute[73091]:       <nova:ports>
Aug 09 17:17:50 user nova-compute[73091]:         <nova:port uuid="5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f">
Aug 09 17:17:50 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 17:17:50 user nova-compute[73091]:         </nova:port>
Aug 09 17:17:50 user nova-compute[73091]:       </nova:ports>
Aug 09 17:17:50 user nova-compute[73091]:     </nova:instance>
Aug 09 17:17:50 user nova-compute[73091]:   </metadata>
Aug 09 17:17:50 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 09 17:17:50 user nova-compute[73091]:     <system>
Aug 09 17:17:50 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 17:17:50 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 09 17:17:50 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 09 17:17:50 user nova-compute[73091]:       <entry name="serial">61c61e32-848f-4cd4-847a-6760c6561220</entry>
Aug 09 17:17:50 user nova-compute[73091]:       <entry name="uuid">61c61e32-848f-4cd4-847a-6760c6561220</entry>
Aug 09 17:17:50 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 09 17:17:50 user nova-compute[73091]:     </system>
Aug 09 17:17:50 user nova-compute[73091]:   </sysinfo>
Aug 09 17:17:50 user nova-compute[73091]:   <os>
Aug 09 17:17:50 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 17:17:50 user nova-compute[73091]:     <boot dev="hd"/>
Aug 09 17:17:50 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 09 17:17:50 user nova-compute[73091]:   </os>
Aug 09 17:17:50 user nova-compute[73091]:   <features>
Aug 09 17:17:50 user nova-compute[73091]:     <acpi/>
Aug 09 17:17:50 user nova-compute[73091]:     <apic/>
Aug 09 17:17:50 user nova-compute[73091]:     <vmcoreinfo/>
Aug 09 17:17:50 user nova-compute[73091]:   </features>
Aug 09 17:17:50 user nova-compute[73091]:   <clock offset="utc">
Aug 09 17:17:50 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 17:17:50 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 17:17:50 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 09 17:17:50 user nova-compute[73091]:   </clock>
Aug 09 17:17:50 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 09 17:17:50 user nova-compute[73091]:     <model>Nehalem</model>
Aug 09 17:17:50 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 17:17:50 user nova-compute[73091]:   </cpu>
Aug 09 17:17:50 user nova-compute[73091]:   <devices>
Aug 09 17:17:50 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 09 17:17:50 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 17:17:50 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk"/>
Aug 09 17:17:50 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 09 17:17:50 user nova-compute[73091]:     </disk>
Aug 09 17:17:50 user nova-compute[73091]:     <interface type="ethernet">
Aug 09 17:17:50 user nova-compute[73091]:       <mac address="fa:16:3e:e3:69:cd"/>
Aug 09 17:17:50 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 17:17:50 user nova-compute[73091]:       <mtu size="1442"/>
Aug 09 17:17:50 user nova-compute[73091]:       <target dev="tap5c2a8b00-6d"/>
Aug 09 17:17:50 user nova-compute[73091]:     </interface>
Aug 09 17:17:50 user nova-compute[73091]:     <serial type="pty">
Aug 09 17:17:50 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/console.log" append="off"/>
Aug 09 17:17:50 user nova-compute[73091]:     </serial>
Aug 09 17:17:50 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 17:17:50 user nova-compute[73091]:     <video>
Aug 09 17:17:50 user nova-compute[73091]:       <model type="virtio"/>
Aug 09 17:17:50 user nova-compute[73091]:     </video>
Aug 09 17:17:50 user nova-compute[73091]:     <rng model="virtio">
Aug 09 17:17:50 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 09 17:17:50 user nova-compute[73091]:     </rng>
Aug 09 17:17:50 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 09 17:17:50 user nova-compute[73091]:     <memballoon model="virtio">
Aug 09 17:17:50 user nova-compute[73091]:       <stats period="10"/>
Aug 09 17:17:50 user nova-compute[73091]:     </memballoon>
Aug 09 17:17:50 user nova-compute[73091]:   </devices>
Aug 09 17:17:50 user nova-compute[73091]: </domain>
Aug 09 17:17:50 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T17:17:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1810440724',display_name='tempest-SnapshotDataIntegrityTests-server-1810440724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1810440724',id=52,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8t2Y/xncU+3b4UBh4zJPvG1mlmtwyWw5XSJuxKRiMQjCNOiUNAltENK7DjRt7TB70d6eag8ew5ZdOzBRAQnH7KwldDyR51X49U+DtfQh7JdsaLyS6x0tCF15flcoYL3w==',key_name='tempest-keypair-1391873310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a5cb5537975476ba8d5de1e14a0ad0d',ramdisk_id='',reservation_id='r-xnq3u9t5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1957788907',owner_user_name='tempest-SnapshotDataIntegrityTests-1957788907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T17:17:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9de2eb02822249fea3720bda90a2621a',uuid=61c61e32-848f-4cd4-847a-6760c6561220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "address": "fa:16:3e:e3:69:cd", "network": {"id": "8ecbc517-fb95-47b6-b3f0-03660f8a91b5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1897535615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5cb5537975476ba8d5de1e14a0ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2a8b00-6d", "ovs_interfaceid": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Converting VIF {"id": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "address": "fa:16:3e:e3:69:cd", "network": {"id": "8ecbc517-fb95-47b6-b3f0-03660f8a91b5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1897535615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5cb5537975476ba8d5de1e14a0ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2a8b00-6d", "ovs_interfaceid": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f,network=Network(8ecbc517-fb95-47b6-b3f0-03660f8a91b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2a8b00-6d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG os_vif [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f,network=Network(8ecbc517-fb95-47b6-b3f0-03660f8a91b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2a8b00-6d') {{(pid=73091) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c2a8b00-6d, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5c2a8b00-6d, col_values=(('external_ids', {'iface-id': '5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:69:cd', 'vm-uuid': '61c61e32-848f-4cd4-847a-6760c6561220'}),), if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:50 user nova-compute[73091]: INFO os_vif [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f,network=Network(8ecbc517-fb95-47b6-b3f0-03660f8a91b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2a8b00-6d')
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:17:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] No VIF found with MAC fa:16:3e:e3:69:cd, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 17:17:51 user nova-compute[73091]: DEBUG nova.network.neutron [req-370c5a4c-5e0b-4e36-be1a-952b54e8cfec req-b648682c-07ec-43a3-b498-7b4e55cf3b40 service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updated VIF entry in instance network info cache for port 5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 17:17:51 user nova-compute[73091]: DEBUG nova.network.neutron [req-370c5a4c-5e0b-4e36-be1a-952b54e8cfec req-b648682c-07ec-43a3-b498-7b4e55cf3b40 service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updating instance_info_cache with network_info: [{"id": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "address": "fa:16:3e:e3:69:cd", "network": {"id": "8ecbc517-fb95-47b6-b3f0-03660f8a91b5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1897535615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5cb5537975476ba8d5de1e14a0ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2a8b00-6d", "ovs_interfaceid": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:17:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-370c5a4c-5e0b-4e36-be1a-952b54e8cfec req-b648682c-07ec-43a3-b498-7b4e55cf3b40 service nova] Releasing lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:17:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-3ce4fa6a-12ea-4199-b3dc-65e3f254473c req-dba8c71a-e33e-4a6a-8201-076bd3618ced service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Received event network-vif-plugged-5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:17:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3ce4fa6a-12ea-4199-b3dc-65e3f254473c req-dba8c71a-e33e-4a6a-8201-076bd3618ced service nova] Acquiring lock "61c61e32-848f-4cd4-847a-6760c6561220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:17:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3ce4fa6a-12ea-4199-b3dc-65e3f254473c req-dba8c71a-e33e-4a6a-8201-076bd3618ced service nova] Lock "61c61e32-848f-4cd4-847a-6760c6561220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:17:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3ce4fa6a-12ea-4199-b3dc-65e3f254473c req-dba8c71a-e33e-4a6a-8201-076bd3618ced service nova] Lock "61c61e32-848f-4cd4-847a-6760c6561220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:17:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-3ce4fa6a-12ea-4199-b3dc-65e3f254473c req-dba8c71a-e33e-4a6a-8201-076bd3618ced service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] No waiting events found dispatching network-vif-plugged-5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:17:52 user nova-compute[73091]: WARNING nova.compute.manager [req-3ce4fa6a-12ea-4199-b3dc-65e3f254473c req-dba8c71a-e33e-4a6a-8201-076bd3618ced service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Received unexpected event network-vif-plugged-5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f for instance with vm_state building and task_state spawning.
Aug 09 17:17:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:52 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:17:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:54 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691601474.6255536, 61c61e32-848f-4cd4-847a-6760c6561220 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:17:54 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] VM Resumed (Lifecycle Event)
Aug 09 17:17:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 17:17:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 17:17:54 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Instance spawned successfully.
Aug 09 17:17:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 17:17:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-b7550fd5-d530-4a03-b6d9-5d847f776cdc req-a2ff043b-09d9-484d-b56e-17a36b61f465 service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Received event network-vif-plugged-5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:17:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b7550fd5-d530-4a03-b6d9-5d847f776cdc req-a2ff043b-09d9-484d-b56e-17a36b61f465 service nova] Acquiring lock "61c61e32-848f-4cd4-847a-6760c6561220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:17:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b7550fd5-d530-4a03-b6d9-5d847f776cdc req-a2ff043b-09d9-484d-b56e-17a36b61f465 service nova] Lock "61c61e32-848f-4cd4-847a-6760c6561220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:17:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b7550fd5-d530-4a03-b6d9-5d847f776cdc req-a2ff043b-09d9-484d-b56e-17a36b61f465 service nova] Lock "61c61e32-848f-4cd4-847a-6760c6561220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:17:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-b7550fd5-d530-4a03-b6d9-5d847f776cdc req-a2ff043b-09d9-484d-b56e-17a36b61f465 service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] No waiting events found dispatching network-vif-plugged-5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:17:54 user nova-compute[73091]: WARNING nova.compute.manager [req-b7550fd5-d530-4a03-b6d9-5d847f776cdc req-a2ff043b-09d9-484d-b56e-17a36b61f465 service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Received unexpected event network-vif-plugged-5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f for instance with vm_state building and task_state spawning.
Aug 09 17:17:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:17:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:17:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:17:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:17:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:17:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:17:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 17:17:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:17:54 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 17:17:54 user nova-compute[73091]: DEBUG nova.virt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Emitting event <LifecycleEvent: 1691601474.6314993, 61c61e32-848f-4cd4-847a-6760c6561220 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:17:54 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] VM Started (Lifecycle Event)
Aug 09 17:17:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:17:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 17:17:54 user nova-compute[73091]: INFO nova.compute.manager [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Took 7.09 seconds to spawn the instance on the hypervisor.
Aug 09 17:17:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:17:54 user nova-compute[73091]: INFO nova.compute.manager [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 17:17:54 user nova-compute[73091]: INFO nova.compute.manager [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Took 8.20 seconds to build instance.
Aug 09 17:17:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5f28f24d-d80d-437b-869d-940976a44b41 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.357s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:17:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:17:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:18:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:18:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:18:03 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:18:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:18:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:18:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:18:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:18:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:18:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:18:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:18:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:18:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:18:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:18:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:18:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:18:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:18:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:18:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:18:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:18:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:18:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:18:45 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:18:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:18:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:18:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:18:45 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:18:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:18:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:18:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:18:46 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8701MB free_disk=25.075275421142578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:18:46 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 61c61e32-848f-4cd4-847a-6760c6561220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:18:46 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:18:46 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:18:46 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:18:46 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:18:46 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:18:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:18:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:18:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:18:48 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:18:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:18:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 17:18:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:18:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:18:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:18:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:18:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updating instance_info_cache with network_info: [{"id": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "address": "fa:16:3e:e3:69:cd", "network": {"id": "8ecbc517-fb95-47b6-b3f0-03660f8a91b5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1897535615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5cb5537975476ba8d5de1e14a0ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2a8b00-6d", "ovs_interfaceid": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:18:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:18:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:18:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:18:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:18:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:18:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:18:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:18:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:18:50 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:18:52 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:18:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:19:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:19:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:19:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:19:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:19:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:19:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:19:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:19:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 17:19:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:19:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:19:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:19:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:19:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:19:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-befdb1fd-762d-43dc-be45-63152e480eea req-47f05643-d7af-4d65-a45a-a7812f8be1bb service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Received event network-changed-5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:19:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-befdb1fd-762d-43dc-be45-63152e480eea req-47f05643-d7af-4d65-a45a-a7812f8be1bb service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Refreshing instance network info cache due to event network-changed-5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 17:19:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-befdb1fd-762d-43dc-be45-63152e480eea req-47f05643-d7af-4d65-a45a-a7812f8be1bb service nova] Acquiring lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:19:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-befdb1fd-762d-43dc-be45-63152e480eea req-47f05643-d7af-4d65-a45a-a7812f8be1bb service nova] Acquired lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:19:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-befdb1fd-762d-43dc-be45-63152e480eea req-47f05643-d7af-4d65-a45a-a7812f8be1bb service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Refreshing network info cache for port 5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 17:19:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:19:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-befdb1fd-762d-43dc-be45-63152e480eea req-47f05643-d7af-4d65-a45a-a7812f8be1bb service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updated VIF entry in instance network info cache for port 5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 17:19:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-befdb1fd-762d-43dc-be45-63152e480eea req-47f05643-d7af-4d65-a45a-a7812f8be1bb service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updating instance_info_cache with network_info: [{"id": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "address": "fa:16:3e:e3:69:cd", "network": {"id": "8ecbc517-fb95-47b6-b3f0-03660f8a91b5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1897535615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5cb5537975476ba8d5de1e14a0ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2a8b00-6d", "ovs_interfaceid": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:19:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-befdb1fd-762d-43dc-be45-63152e480eea req-47f05643-d7af-4d65-a45a-a7812f8be1bb service nova] Releasing lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:19:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:19:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:19:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "61c61e32-848f-4cd4-847a-6760c6561220" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:19:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:19:41 user nova-compute[73091]: DEBUG nova.objects.instance [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lazy-loading 'flavor' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "61c61e32-848f-4cd4-847a-6760c6561220" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:19:42 user nova-compute[73091]: INFO nova.compute.manager [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Attaching volume 8080fcba-8fe3-413d-9451-b9eba4c31399 to /dev/vdb
Aug 09 17:19:42 user nova-compute[73091]: DEBUG os_brick.utils [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc9fec5-a57c-497b-a365-f0901d0760a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1c50ef-4fdc-45b5-8863-faa066a4ef25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7279b80-4ce4-4563-a417-4a51c0956d33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bb0d0f-8aca-4e49-a245-c4a68850dfcc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:19:42 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 17:19:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[346b9813-c45e-42b5-aa3d-afc655692015]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG os_brick.utils [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:19:42 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updating existing volume attachment record: 5de59221-3235-4c8d-a828-e43133ea0126 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 17:19:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:19:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:19:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:19:47 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:19:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:19:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:19:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:19:47 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:19:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:19:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:19:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:19:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:19:48 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:19:48 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:19:48 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8805MB free_disk=25.074073791503906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:19:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:19:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:19:49 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 61c61e32-848f-4cd4-847a-6760c6561220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:19:49 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:19:49 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:19:49 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing inventories for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 17:19:49 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Updating ProviderTree inventory for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 17:19:49 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Updating inventory in ProviderTree for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 17:19:49 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing aggregate associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 17:19:49 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing trait associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, traits: HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 17:19:49 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:19:49 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:19:49 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:19:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:19:50 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:19:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:19:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 17:19:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:19:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:19:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:19:50 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:19:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:19:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updating instance_info_cache with network_info: [{"id": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "address": "fa:16:3e:e3:69:cd", "network": {"id": "8ecbc517-fb95-47b6-b3f0-03660f8a91b5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1897535615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5cb5537975476ba8d5de1e14a0ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2a8b00-6d", "ovs_interfaceid": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:19:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:19:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:19:50 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:19:52 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:19:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oTdkIrXJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:19:55 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:19:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:19:55 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:19:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:19:55 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 17:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e24a2bf-47f6-449f-b5ec-19a1b1901413]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 17:19:55 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ef034a-11af-4cfe-ac75-e86986cd8513]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399] added
Aug 09 17:19:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fd9e4e-7d32-4e12-8142-ffec67a84169]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5163f1-bf35-42c0-bd66-ae216ece2c46]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oTdkIrXJ {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oTdkIrXJ" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f61a4f7-2580-44ce-bddf-0e21b37d4025]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oTdkIrXJ'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff47d85-c676-487a-9fe5-7dd997c2a085]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[44aa55dc-b66d-4fd9-a1bb-2a8eaa20dc8a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 17:19:56 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 17:19:56 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:19:56 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 17:19:56 user nova-compute[73091]: 
Aug 09 17:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[29eeae37-39b5-4c2d-9cec-4a0b313d5b11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399, portal: 172.16.0.220,3260]
Aug 09 17:19:56 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399, portal: 172.16.0.220,3260] successful.
Aug 09 17:19:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b12fce-4657-4a0e-8613-92715fc9b778]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2d7139-ccb6-4e8b-a7ee-ba0869882c5c]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 (non-flash)
Aug 09 17:19:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 (non-flash)
Aug 09 17:19:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[416d08c3-2a84-4696-a72b-b5db7da71804]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oTdkIrXJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 17:19:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:19:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23762306635393433', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:19:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762306635393433', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 17:19:57 user nova-compute[73091]: DEBUG nova.objects.instance [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lazy-loading 'flavor' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:19:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 17:19:57 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:19:57 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:19:57 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:19:57 user nova-compute[73091]:   <serial>8080fcba-8fe3-413d-9451-b9eba4c31399</serial>
Aug 09 17:19:57 user nova-compute[73091]: </disk>
Aug 09 17:19:57 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 17:19:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:19:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:19:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] No VIF found with MAC fa:16:3e:e3:69:cd, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 17:19:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78788fff-37d5-462c-a113-d9ccd8e5c813 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.518s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:20:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:20:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:20:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:20:05 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:20:06 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:20:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 17:20:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 17:20:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:20:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:20:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:20:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:20:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:20:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:20:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "61c61e32-848f-4cd4-847a-6760c6561220" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:20:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:20:20 user nova-compute[73091]: INFO nova.compute.manager [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Detaching volume 8080fcba-8fe3-413d-9451-b9eba4c31399
Aug 09 17:20:20 user nova-compute[73091]: INFO nova.virt.block_device [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Attempting to driver detach volume 8080fcba-8fe3-413d-9451-b9eba4c31399 from mountpoint /dev/vdb
Aug 09 17:20:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Attempting to detach device vdb from instance 61c61e32-848f-4cd4-847a-6760c6561220 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 17:20:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:20:20 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:20:20 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:20:20 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:20:20 user nova-compute[73091]:   <serial>8080fcba-8fe3-413d-9451-b9eba4c31399</serial>
Aug 09 17:20:20 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 17:20:20 user nova-compute[73091]: </disk>
Aug 09 17:20:20 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:20:20 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Successfully detached device vdb from instance 61c61e32-848f-4cd4-847a-6760c6561220 from the persistent domain config.
Aug 09 17:20:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61c61e32-848f-4cd4-847a-6760c6561220 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 17:20:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:20:20 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:20:20 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:20:20 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:20:20 user nova-compute[73091]:   <serial>8080fcba-8fe3-413d-9451-b9eba4c31399</serial>
Aug 09 17:20:20 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 17:20:20 user nova-compute[73091]: </disk>
Aug 09 17:20:20 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691601621.300819, 61c61e32-848f-4cd4-847a-6760c6561220 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 17:20:21 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Successfully detached device vdb from instance 61c61e32-848f-4cd4-847a-6760c6561220 from the live domain config.
Aug 09 17:20:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oTdkIrXJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:20:21 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:20:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a022631-3309-4ad4-9a6e-58e7398b229c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[395c26e9-483a-49fd-a204-aa46a29729fe]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 (non-flash)
Aug 09 17:20:21 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 (non-flash)
Aug 09 17:20:21 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0602556c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7139156f-807e-4628-bcc8-a85b4c515bc5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8922e41-2518-481d-834c-7336d95c6fb4]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bceafea7-002d-4329-9f00-c56d56641303]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd431a03-eef8-4c1f-9237-35cef77f4a3d]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb0bf19-e898-459d-a28f-402e143e0889]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[42141816-f7a0-48ba-9905-8acecc8c4ad3]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399, portal: 172.16.0.220,3260]
Aug 09 17:20:21 user nova-compute[73091]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399, portal: 172.16.0.220,3260] successful.
Aug 09 17:20:21 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8080fcba-8fe3-413d-9451-b9eba4c31399 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9edcc5-101d-4b48-bd44-4299ef4b9961]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] <== disconnect_volume: return (273ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:20:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 17:20:22 user nova-compute[73091]: DEBUG nova.objects.instance [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lazy-loading 'flavor' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:20:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-7d9bf015-77bd-417d-95f4-d3f55c1d026b tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.622s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:20:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:20:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:20:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:20:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:20:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:20:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:20:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_power_states {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:20:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Triggering sync for uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 17:20:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "61c61e32-848f-4cd4-847a-6760c6561220" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:20:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "61c61e32-848f-4cd4-847a-6760c6561220" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:20:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "61c61e32-848f-4cd4-847a-6760c6561220" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:20:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:20:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:20:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:20:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:20:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:20:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:20:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:20:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:20:48 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:20:48 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:20:49 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:20:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:20:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 17:20:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:20:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:20:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:20:49 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:20:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:20:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updating instance_info_cache with network_info: [{"id": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "address": "fa:16:3e:e3:69:cd", "network": {"id": "8ecbc517-fb95-47b6-b3f0-03660f8a91b5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1897535615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5cb5537975476ba8d5de1e14a0ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2a8b00-6d", "ovs_interfaceid": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:20:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:20:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:20:50 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:20:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:20:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:20:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:20:50 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:20:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:20:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:20:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:20:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:20:51 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:20:51 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:20:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8802MB free_disk=25.06509017944336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:20:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:20:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:20:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 61c61e32-848f-4cd4-847a-6760c6561220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:20:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:20:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:20:51 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:20:51 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:20:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:20:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:20:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:20:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:20:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:21:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:21:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:21:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:21:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "61c61e32-848f-4cd4-847a-6760c6561220" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:21:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:21:14 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lazy-loading 'flavor' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:21:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "61c61e32-848f-4cd4-847a-6760c6561220" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:21:15 user nova-compute[73091]: INFO nova.compute.manager [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Attaching volume 25b32f09-fa63-4462-9f4a-a5f4e94090d5 to /dev/vdb
Aug 09 17:21:15 user nova-compute[73091]: DEBUG os_brick.utils [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4add495-6f2e-4ee2-80f7-3299e1efef2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bc0b2d-ce17-4fbf-8752-6ca7e5731fb2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49069bb-8aa3-4e26-9e50-316a24d8ab65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ac08ba-c7f1-4bd3-a95b-c15c0f8d0f21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:21:15 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 17:21:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe372f8d-35ca-4f31-87b6-c702b122bab5]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG os_brick.utils [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updating existing volume attachment record: 7278480d-3a1f-424c-ac21-be34b2807849 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:21:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:21:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SNdDaQHR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:21:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:21:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:21:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:21:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:21:22 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3a9ddd-db90-448c-9c1d-f32ab9df4e77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 17:21:22 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[474ac61d-df39-489d-829e-038304c1378e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5] added
Aug 09 17:21:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91aa5a7-9d9f-47ab-9dce-c283c791728c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8957b24b-6c64-4cbb-becd-a4b296af0c1d]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SNdDaQHR {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SNdDaQHR" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6f3cd7-807e-4fef-b593-16c795e523e9]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SNdDaQHR'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0add4cc7-cbdd-4910-b0ce-4e9b23915140]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e464943d-ec26-47a4-aee2-68d323c72574]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 17:21:22 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:21:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 17:21:22 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:21:22 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 17:21:22 user nova-compute[73091]: 
Aug 09 17:21:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f3bd49-779b-4ec9-b81b-0b2613939923]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5, portal: 172.16.0.220,3260]
Aug 09 17:21:23 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5, portal: 172.16.0.220,3260] successful.
Aug 09 17:21:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:21:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc047ded-b86e-4095-9b0a-605810d8a2f9]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:21:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da0bdfb-bb2c-4840-a69b-9263dc526245]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 (non-flash)
Aug 09 17:21:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:21:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 (non-flash)
Aug 09 17:21:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:21:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:21:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 17:21:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 17:21:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 17:21:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e64e7d-72e3-411d-9868-8f84ef73b929]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:21:24 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:21:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SNdDaQHR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 17:21:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:21:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23965316366363461', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:21:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965316366363461', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 17:21:24 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lazy-loading 'flavor' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:21:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 17:21:24 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:21:24 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:21:24 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:21:24 user nova-compute[73091]:   <serial>25b32f09-fa63-4462-9f4a-a5f4e94090d5</serial>
Aug 09 17:21:24 user nova-compute[73091]: </disk>
Aug 09 17:21:24 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 17:21:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:21:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:21:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] No VIF found with MAC fa:16:3e:e3:69:cd, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 17:21:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6ee68c8e-4564-4ea2-ae70-d7af0991b34e tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.611s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:21:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:21:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:21:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:21:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:21:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:21:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:21:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:21:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "61c61e32-848f-4cd4-847a-6760c6561220" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:21:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:21:26 user nova-compute[73091]: INFO nova.compute.manager [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Detaching volume 25b32f09-fa63-4462-9f4a-a5f4e94090d5
Aug 09 17:21:26 user nova-compute[73091]: INFO nova.virt.block_device [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Attempting to driver detach volume 25b32f09-fa63-4462-9f4a-a5f4e94090d5 from mountpoint /dev/vdb
Aug 09 17:21:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Attempting to detach device vdb from instance 61c61e32-848f-4cd4-847a-6760c6561220 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 17:21:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:21:26 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:21:26 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:21:26 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:21:26 user nova-compute[73091]:   <serial>25b32f09-fa63-4462-9f4a-a5f4e94090d5</serial>
Aug 09 17:21:26 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 17:21:26 user nova-compute[73091]: </disk>
Aug 09 17:21:26 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:21:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Successfully detached device vdb from instance 61c61e32-848f-4cd4-847a-6760c6561220 from the persistent domain config.
Aug 09 17:21:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61c61e32-848f-4cd4-847a-6760c6561220 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 17:21:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:21:26 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:21:26 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:21:26 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:21:26 user nova-compute[73091]:   <serial>25b32f09-fa63-4462-9f4a-a5f4e94090d5</serial>
Aug 09 17:21:26 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 17:21:26 user nova-compute[73091]: </disk>
Aug 09 17:21:26 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691601687.0707786, 61c61e32-848f-4cd4-847a-6760c6561220 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 17:21:27 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Successfully detached device vdb from instance 61c61e32-848f-4cd4-847a-6760c6561220 from the live domain config.
Aug 09 17:21:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SNdDaQHR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:21:27 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:21:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b34a66-16ad-4ffd-8841-0cde6e2ca277]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bb33ff-1657-4644-bc61-43b7e73a2b4a]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 (non-flash)
Aug 09 17:21:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 (non-flash)
Aug 09 17:21:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff060254040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5b6c38-3afe-424f-9715-be765dce4215]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe5e2bc-05b3-448b-8730-415f389d93c3]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[661bb1d2-f699-48bc-87aa-1aa4f12a82c3]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9210d8a3-ae23-4df4-8987-c56bbdd68095]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[822c5f48-4b18-4496-88d4-fcd968e72764]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b908f66-0633-4191-af10-60bcbb32560e]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5, portal: 172.16.0.220,3260]
Aug 09 17:21:27 user nova-compute[73091]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5, portal: 172.16.0.220,3260] successful.
Aug 09 17:21:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b32f09-fa63-4462-9f4a-a5f4e94090d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[be40c389-975b-4beb-84dd-f66b4aa58359]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] <== disconnect_volume: return (283ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:21:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 17:21:28 user nova-compute[73091]: DEBUG nova.objects.instance [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lazy-loading 'flavor' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:21:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-54a70fd1-6d9b-4362-aa9d-91a5e1981200 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.677s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:21:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:21:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:21:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:21:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:21:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:21:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:21:39 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:21:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:21:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:21:48 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:21:49 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:21:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:21:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 17:21:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:21:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:21:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:21:49 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:21:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updating instance_info_cache with network_info: [{"id": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "address": "fa:16:3e:e3:69:cd", "network": {"id": "8ecbc517-fb95-47b6-b3f0-03660f8a91b5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1897535615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5cb5537975476ba8d5de1e14a0ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2a8b00-6d", "ovs_interfaceid": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:21:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:21:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:21:50 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:21:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:21:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:21:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:21:50 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:21:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:21:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:21:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:21:51 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:21:51 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:21:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8780MB free_disk=25.064167022705078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:21:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:21:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:21:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 61c61e32-848f-4cd4-847a-6760c6561220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:21:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:21:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:21:51 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:21:51 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:21:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:21:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:21:51 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:21:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:21:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:21:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:22:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:22:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:22:06 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:22:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:22:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "61c61e32-848f-4cd4-847a-6760c6561220" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lazy-loading 'flavor' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "61c61e32-848f-4cd4-847a-6760c6561220" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:22:20 user nova-compute[73091]: INFO nova.compute.manager [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Attaching volume 9c0fabff-8137-4429-beae-3e3c69c2b405 to /dev/vdb
Aug 09 17:22:20 user nova-compute[73091]: DEBUG os_brick.utils [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e5aafc-f70a-4d16-93c6-3fb9aadaf3be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3943311-d814-44e9-a31e-5e6637eefc68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[faab2309-9b42-4f7d-8d0a-3ebae26219cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[018a2318-b660-4414-95bb-37e75329a301]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:22:20 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 17:22:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3dc190-e1a3-4293-9d39-b7c26034237c]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG os_brick.utils [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:22:20 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updating existing volume attachment record: bd4b521e-7d8f-4d79-9bac-0ba7d7b8a146 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 17:22:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTgYMFqb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:22:28 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:22:28 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:22:28 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b774ca19-4e87-4874-8edf-8c1f3f2fbd56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 17:22:28 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47baeb0-f455-46cd-b7c6-7089b1b8f071]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405] added
Aug 09 17:22:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[614fd777-9d4e-4056-a1ce-da518f75698b]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b920bd23-4d18-4fc2-b7e3-2f65fd4bf671]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dTgYMFqb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dTgYMFqb" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad186a7-9809-427b-b365-4a97affe961b]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dTgYMFqb'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf632c5-061d-48aa-9b26-2ec9f6e44d23]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7122a88e-515a-4ee8-8701-7a1de1fa9911]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 17:22:28 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 17:22:28 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:22:28 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 17:22:28 user nova-compute[73091]: 
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f612b15-98cf-46ab-bd6b-ef1a4d2b6402]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405, portal: 172.16.0.220,3260]
Aug 09 17:22:28 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405, portal: 172.16.0.220,3260] successful.
Aug 09 17:22:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b847511-9add-4559-b259-ace9d4e233e2]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6609d11-2ed5-45c2-8aa9-2ee0e1efdbd4]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 (non-flash)
Aug 09 17:22:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 (non-flash)
Aug 09 17:22:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22c49a1-1466-4de9-bbc5-0adbac892d58]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:22:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTgYMFqb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 17:22:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:22:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23139626663383731', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:22:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139626663383731', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 17:22:29 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lazy-loading 'flavor' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:22:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 17:22:29 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:22:29 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:22:29 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:22:29 user nova-compute[73091]:   <serial>9c0fabff-8137-4429-beae-3e3c69c2b405</serial>
Aug 09 17:22:29 user nova-compute[73091]: </disk>
Aug 09 17:22:29 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 17:22:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:22:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:22:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] No VIF found with MAC fa:16:3e:e3:69:cd, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 17:22:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f5b037ea-3b4f-47c0-a11e-a16d93fe4e13 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.700s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:22:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:22:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:22:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:22:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:22:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:22:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:22:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "61c61e32-848f-4cd4-847a-6760c6561220" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:22:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:22:33 user nova-compute[73091]: INFO nova.compute.manager [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Detaching volume 9c0fabff-8137-4429-beae-3e3c69c2b405
Aug 09 17:22:33 user nova-compute[73091]: INFO nova.virt.block_device [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Attempting to driver detach volume 9c0fabff-8137-4429-beae-3e3c69c2b405 from mountpoint /dev/vdb
Aug 09 17:22:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Attempting to detach device vdb from instance 61c61e32-848f-4cd4-847a-6760c6561220 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:22:33 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:22:33 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:22:33 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:22:33 user nova-compute[73091]:   <serial>9c0fabff-8137-4429-beae-3e3c69c2b405</serial>
Aug 09 17:22:33 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 17:22:33 user nova-compute[73091]: </disk>
Aug 09 17:22:33 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:22:33 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Successfully detached device vdb from instance 61c61e32-848f-4cd4-847a-6760c6561220 from the persistent domain config.
Aug 09 17:22:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61c61e32-848f-4cd4-847a-6760c6561220 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:22:33 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:22:33 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:22:33 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:22:33 user nova-compute[73091]:   <serial>9c0fabff-8137-4429-beae-3e3c69c2b405</serial>
Aug 09 17:22:33 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 17:22:33 user nova-compute[73091]: </disk>
Aug 09 17:22:33 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691601753.5457954, 61c61e32-848f-4cd4-847a-6760c6561220 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 17:22:33 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Successfully detached device vdb from instance 61c61e32-848f-4cd4-847a-6760c6561220 from the live domain config.
Aug 09 17:22:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTgYMFqb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:22:33 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:22:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a175d9f-94d6-40f0-ba38-5912bc1d22db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a721d4-c560-43b3-b30e-92ba8dcd83c3]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 (non-flash)
Aug 09 17:22:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 (non-flash)
Aug 09 17:22:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0601105e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[63928993-ee63-4933-a574-67958d06cd4a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba18621-a69f-43e5-bdd7-6003fefeb90d]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bda20c3-d18d-4cd6-91e1-a3ce543b495c]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c01ecd-f6cf-44da-8ab3-fb0977db3b94]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef3f205-d3dc-4e41-8cf8-88ea42acd434]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d73e19f-1c8c-4dee-a339-dc8ba3055ccc]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405, portal: 172.16.0.220,3260]
Aug 09 17:22:33 user nova-compute[73091]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405, portal: 172.16.0.220,3260] successful.
Aug 09 17:22:33 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c0fabff-8137-4429-beae-3e3c69c2b405 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c736368-77d3-44af-988b-4b64e7c549d2]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] <== disconnect_volume: return (268ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:22:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 17:22:34 user nova-compute[73091]: DEBUG nova.objects.instance [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lazy-loading 'flavor' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:22:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-112397c6-4e69-401c-a563-0e16fa458c7d tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.592s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:22:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:22:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:22:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:22:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:22:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:22:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:22:41 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:22:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:22:48 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:22:49 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:22:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:22:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 17:22:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:22:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:22:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:22:49 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:22:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updating instance_info_cache with network_info: [{"id": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "address": "fa:16:3e:e3:69:cd", "network": {"id": "8ecbc517-fb95-47b6-b3f0-03660f8a91b5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1897535615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5cb5537975476ba8d5de1e14a0ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2a8b00-6d", "ovs_interfaceid": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:22:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:22:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:22:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:22:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:22:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:22:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:22:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:22:50 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:22:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:22:50 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:22:51 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:22:51 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:22:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8792MB free_disk=25.06314468383789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:22:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 61c61e32-848f-4cd4-847a-6760c6561220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:22:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:22:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:22:51 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:22:51 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:22:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:22:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:22:52 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:22:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:22:56 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:22:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:23:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:23:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:23:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:23:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:23:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:23:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:23:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:23:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:23:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:23:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:23:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:23:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "61c61e32-848f-4cd4-847a-6760c6561220" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:23:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:23:27 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lazy-loading 'flavor' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:23:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "61c61e32-848f-4cd4-847a-6760c6561220" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:23:28 user nova-compute[73091]: INFO nova.compute.manager [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Attaching volume f97d4e1e-256c-46d8-a3b1-8236ab01b172 to /dev/vdb
Aug 09 17:23:28 user nova-compute[73091]: DEBUG os_brick.utils [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9a33b5-679a-4114-b475-c7ebd15f4696]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11481e3fba52\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef13bcf-c829-431a-b740-87e2f8d4d56b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[097602f9-5934-49e6-b767-78283ec34325]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a255d1-f649-4307-a2e4-d96aad3cdad0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] nvme not present on system {{(pid=73091) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 17:23:28 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 17:23:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ad395c-039f-42a6-979a-7f9976a95af0]: (4, '') {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG os_brick.utils [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11481e3fba52', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:23:28 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updating existing volume attachment record: 670c1dca-f318-4205-a73f-248a3a71dc71 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 17:23:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:23:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:23:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:23:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:23:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAaswvBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:23:36 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:23:36 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:23:36 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9a3e55-8f7f-451c-aeed-15d7311cd1b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 17:23:36 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 --interface default --op new {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe325e7-a4bc-49cb-8d66-822c7de95b4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172] added\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172] added
Aug 09 17:23:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b97ec24-140b-4b61-a198-2c7af696abdb]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b81005-dcea-401d-ad6e-b0a6e493bb50]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kAaswvBc {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kAaswvBc" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1211fb87-580f-4f31-8524-b15179ad801f]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kAaswvBc'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcec61ca-a7d5-4fa7-ab12-ddf180b31d85]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fde23b-e3ee-4074-bf8a-a8fdf41026fa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 17:23:36 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 17:23:36 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:23:36 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 17:23:36 user nova-compute[73091]: 
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 --login {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[78598d3d-cd5c-4c49-af38-9851124e2343]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172, portal: 172.16.0.220,3260]
Aug 09 17:23:36 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172, portal: 172.16.0.220,3260] successful.
Aug 09 17:23:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e2ff5f-a3e2-4ff0-8ca7-0b00b7dc7e7e]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1aa069f-a99f-46fe-9a52-3335a7acaf94]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 (non-flash)
Aug 09 17:23:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 (non-flash)
Aug 09 17:23:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=73091) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8affc856-4c01-491c-b3de-c5f600e42a26]: (4, ('- - 0', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAaswvBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 17:23:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:23:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:23:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23962653062636430', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:23:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962653062636430', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 17:23:37 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lazy-loading 'flavor' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:23:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 17:23:37 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:23:37 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:23:37 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:23:37 user nova-compute[73091]:   <serial>f97d4e1e-256c-46d8-a3b1-8236ab01b172</serial>
Aug 09 17:23:37 user nova-compute[73091]: </disk>
Aug 09 17:23:37 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 17:23:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:23:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 17:23:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] No VIF found with MAC fa:16:3e:e3:69:cd, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 17:23:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ff2dbc52-2afd-4f04-861c-984dc96f1a3f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.793s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:23:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "61c61e32-848f-4cd4-847a-6760c6561220" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:23:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:23:40 user nova-compute[73091]: INFO nova.compute.manager [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Detaching volume f97d4e1e-256c-46d8-a3b1-8236ab01b172
Aug 09 17:23:40 user nova-compute[73091]: INFO nova.virt.block_device [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Attempting to driver detach volume f97d4e1e-256c-46d8-a3b1-8236ab01b172 from mountpoint /dev/vdb
Aug 09 17:23:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Attempting to detach device vdb from instance 61c61e32-848f-4cd4-847a-6760c6561220 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 17:23:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:23:40 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:23:40 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:23:40 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:23:40 user nova-compute[73091]:   <serial>f97d4e1e-256c-46d8-a3b1-8236ab01b172</serial>
Aug 09 17:23:40 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 17:23:40 user nova-compute[73091]: </disk>
Aug 09 17:23:40 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:23:40 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Successfully detached device vdb from instance 61c61e32-848f-4cd4-847a-6760c6561220 from the persistent domain config.
Aug 09 17:23:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61c61e32-848f-4cd4-847a-6760c6561220 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 17:23:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 17:23:40 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 17:23:40 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 09 17:23:40 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 09 17:23:40 user nova-compute[73091]:   <serial>f97d4e1e-256c-46d8-a3b1-8236ab01b172</serial>
Aug 09 17:23:40 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 17:23:40 user nova-compute[73091]: </disk>
Aug 09 17:23:40 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 17:23:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:23:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-388e47a0-12c1-42d0-8c23-98d31a4a3191 None None] Received event <DeviceRemovedEvent: 1691601821.0045729, 61c61e32-848f-4cd4-847a-6760c6561220 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 17:23:41 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Successfully detached device vdb from instance 61c61e32-848f-4cd4-847a-6760c6561220 from the live domain config.
Aug 09 17:23:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff08033f8e0>, {'target_iqns': ['iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAaswvBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 17:23:41 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 17:23:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172', 0)] {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f46f6ca-2839-462f-a9ee-b1c2ffdd24a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff676ad-9c0a-4c51-a22d-5b204f5c86cf]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 (non-flash)\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 (non-flash)
Aug 09 17:23:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 (non-flash)
Aug 09 17:23:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff0804c4550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede24ece-c71e-4bb5-bb68-07f8c0352a7b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1776ad-ec5f-4955-af7f-03a615150d29]: (4, ('ok\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[430cead7-5680-4c65-b151-3de267dde7d1]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7754a60-9af4-4c29-9664-f64ff4391f91]: (4, ('1', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172')] {{(pid=73091) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[78576426-488b-49d7-b050-4bd1df0b22b2]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 --logout {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af980e2-b434-4349-8dbb-fd645ebcbe68]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172, portal: 172.16.0.220,3260]
Aug 09 17:23:41 user nova-compute[73091]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172, portal: 172.16.0.220,3260] successful.
Aug 09 17:23:41 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 --op delete {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97d4e1e-256c-46d8-a3b1-8236ab01b172 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83925) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd8e002-90e9-424f-b9b1-50a5b36e9c9d]: (4, ('', '')) {{(pid=83925) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] <== disconnect_volume: return (275ms) None {{(pid=73091) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 17:23:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 17:23:42 user nova-compute[73091]: DEBUG nova.objects.instance [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lazy-loading 'flavor' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:23:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-341e9dc0-91c9-46b2-9a82-416b066c1c0f tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.636s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:23:42 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:23:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:23:49 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:23:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:23:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 17:23:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:23:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:23:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:23:49 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:23:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updating instance_info_cache with network_info: [{"id": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "address": "fa:16:3e:e3:69:cd", "network": {"id": "8ecbc517-fb95-47b6-b3f0-03660f8a91b5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1897535615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5cb5537975476ba8d5de1e14a0ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2a8b00-6d", "ovs_interfaceid": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:23:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:23:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:23:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:23:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:23:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:23:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:23:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:23:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:23:50 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:23:50 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:23:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:23:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:23:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:23:50 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:23:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:23:51 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:23:51 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:23:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=25.06210708618164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:23:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 61c61e32-848f-4cd4-847a-6760c6561220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:23:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:23:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:23:51 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:23:51 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:23:51 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:23:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:23:54 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:23:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:23:57 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:23:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:24:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:24:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:24:07 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:24:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:24:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:24:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:24:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:24:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:24:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:24:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:24:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:24:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:24:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:24:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:24:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 17:24:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:24:36 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:24:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:24:37 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:24:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:24:44 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:24:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:24:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:24:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:24:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:24:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:24:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:24:49 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:24:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:24:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 17:24:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 17:24:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquired lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 17:24:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 17:24:50 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lazy-loading 'info_cache' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:24:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updating instance_info_cache with network_info: [{"id": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "address": "fa:16:3e:e3:69:cd", "network": {"id": "8ecbc517-fb95-47b6-b3f0-03660f8a91b5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1897535615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5cb5537975476ba8d5de1e14a0ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2a8b00-6d", "ovs_interfaceid": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:24:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Releasing lock "refresh_cache-61c61e32-848f-4cd4-847a-6760c6561220" {{(pid=73091) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 17:24:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 17:24:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:24:51 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:24:52 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:24:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:24:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:24:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:24:52 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:24:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:24:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:24:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 17:24:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=73091) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 17:24:53 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:24:53 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:24:53 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8801MB free_disk=25.061298370361328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:24:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:24:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:24:53 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Instance 61c61e32-848f-4cd4-847a-6760c6561220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 17:24:53 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:24:53 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:24:53 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing inventories for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 17:24:53 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Updating ProviderTree inventory for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 17:24:53 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Updating inventory in ProviderTree for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 17:24:53 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing aggregate associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 17:24:53 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Refreshing trait associations for resource provider acad0a00-fc5f-4423-bdc7-4d5877e83b16, traits: HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_TRUSTED_CERTS {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 17:24:54 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:24:54 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:24:54 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:24:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.396s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:24:55 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:24:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:24:58 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:25:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:25:01 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:25:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:25:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "61c61e32-848f-4cd4-847a-6760c6561220" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:25:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:25:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "61c61e32-848f-4cd4-847a-6760c6561220-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:25:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:25:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:25:06 user nova-compute[73091]: INFO nova.compute.manager [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Terminating instance
Aug 09 17:25:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 17:25:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:25:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:25:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:25:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:25:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-d847a6c8-2264-416c-967d-f904daaaf770 req-9756feb8-3480-438e-8dbb-b3f1047ac720 service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Received event network-vif-unplugged-5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:25:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d847a6c8-2264-416c-967d-f904daaaf770 req-9756feb8-3480-438e-8dbb-b3f1047ac720 service nova] Acquiring lock "61c61e32-848f-4cd4-847a-6760c6561220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:25:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d847a6c8-2264-416c-967d-f904daaaf770 req-9756feb8-3480-438e-8dbb-b3f1047ac720 service nova] Lock "61c61e32-848f-4cd4-847a-6760c6561220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:25:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d847a6c8-2264-416c-967d-f904daaaf770 req-9756feb8-3480-438e-8dbb-b3f1047ac720 service nova] Lock "61c61e32-848f-4cd4-847a-6760c6561220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:25:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-d847a6c8-2264-416c-967d-f904daaaf770 req-9756feb8-3480-438e-8dbb-b3f1047ac720 service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] No waiting events found dispatching network-vif-unplugged-5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:25:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-d847a6c8-2264-416c-967d-f904daaaf770 req-9756feb8-3480-438e-8dbb-b3f1047ac720 service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Received event network-vif-unplugged-5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 17:25:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:25:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Instance destroyed successfully.
Aug 09 17:25:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lazy-loading 'resources' on Instance uuid 61c61e32-848f-4cd4-847a-6760c6561220 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 17:25:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T17:17:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1810440724',display_name='tempest-SnapshotDataIntegrityTests-server-1810440724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1810440724',id=52,image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8t2Y/xncU+3b4UBh4zJPvG1mlmtwyWw5XSJuxKRiMQjCNOiUNAltENK7DjRt7TB70d6eag8ew5ZdOzBRAQnH7KwldDyR51X49U+DtfQh7JdsaLyS6x0tCF15flcoYL3w==',key_name='tempest-keypair-1391873310',keypairs=<?>,launch_index=0,launched_at=2023-08-09T17:17:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a5cb5537975476ba8d5de1e14a0ad0d',ramdisk_id='',reservation_id='r-xnq3u9t5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bb270def-cd6e-4463-89d8-f4240c9cb724',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1957788907',owner_user_name='tempest-SnapshotDataIntegrityTests-1957788907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T17:17:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9de2eb02822249fea3720bda90a2621a',uuid=61c61e32-848f-4cd4-847a-6760c6561220,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "address": "fa:16:3e:e3:69:cd", "network": {"id": "8ecbc517-fb95-47b6-b3f0-03660f8a91b5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1897535615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5cb5537975476ba8d5de1e14a0ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2a8b00-6d", "ovs_interfaceid": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 17:25:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Converting VIF {"id": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "address": "fa:16:3e:e3:69:cd", "network": {"id": "8ecbc517-fb95-47b6-b3f0-03660f8a91b5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1897535615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5cb5537975476ba8d5de1e14a0ad0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2a8b00-6d", "ovs_interfaceid": "5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 17:25:07 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f,network=Network(8ecbc517-fb95-47b6-b3f0-03660f8a91b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2a8b00-6d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 17:25:07 user nova-compute[73091]: DEBUG os_vif [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f,network=Network(8ecbc517-fb95-47b6-b3f0-03660f8a91b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2a8b00-6d') {{(pid=73091) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 17:25:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:25:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c2a8b00-6d, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 17:25:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:25:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:25:07 user nova-compute[73091]: INFO os_vif [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:69:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f,network=Network(8ecbc517-fb95-47b6-b3f0-03660f8a91b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2a8b00-6d')
Aug 09 17:25:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Deleting instance files /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220_del
Aug 09 17:25:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Deletion of /opt/stack/data/nova/instances/61c61e32-848f-4cd4-847a-6760c6561220_del complete
Aug 09 17:25:07 user nova-compute[73091]: INFO nova.compute.manager [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 09 17:25:07 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 17:25:07 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 17:25:07 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 17:25:08 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 17:25:08 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Took 1.01 seconds to deallocate network for instance.
Aug 09 17:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:25:08 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:25:08 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:25:08 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Deleted allocations for instance 61c61e32-848f-4cd4-847a-6760c6561220
Aug 09 17:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-72a42c2c-7776-46fe-aa77-2dceb9a8d339 tempest-SnapshotDataIntegrityTests-1957788907 tempest-SnapshotDataIntegrityTests-1957788907-project-member] Lock "61c61e32-848f-4cd4-847a-6760c6561220" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.164s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:25:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-c7da7886-1fdf-4a87-b763-8a809f5905d9 req-8edaf18c-15c5-4792-a23f-9317b82a5c13 service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Received event network-vif-plugged-5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c7da7886-1fdf-4a87-b763-8a809f5905d9 req-8edaf18c-15c5-4792-a23f-9317b82a5c13 service nova] Acquiring lock "61c61e32-848f-4cd4-847a-6760c6561220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c7da7886-1fdf-4a87-b763-8a809f5905d9 req-8edaf18c-15c5-4792-a23f-9317b82a5c13 service nova] Lock "61c61e32-848f-4cd4-847a-6760c6561220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:25:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c7da7886-1fdf-4a87-b763-8a809f5905d9 req-8edaf18c-15c5-4792-a23f-9317b82a5c13 service nova] Lock "61c61e32-848f-4cd4-847a-6760c6561220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:25:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-c7da7886-1fdf-4a87-b763-8a809f5905d9 req-8edaf18c-15c5-4792-a23f-9317b82a5c13 service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] No waiting events found dispatching network-vif-plugged-5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 17:25:08 user nova-compute[73091]: WARNING nova.compute.manager [req-c7da7886-1fdf-4a87-b763-8a809f5905d9 req-8edaf18c-15c5-4792-a23f-9317b82a5c13 service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Received unexpected event network-vif-plugged-5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f for instance with vm_state deleted and task_state None.
Aug 09 17:25:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-c7da7886-1fdf-4a87-b763-8a809f5905d9 req-8edaf18c-15c5-4792-a23f-9317b82a5c13 service nova] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Received event network-vif-deleted-5c2a8b00-6dd3-4829-9958-4ea0d5a4ff9f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 17:25:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:25:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:25:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:25:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:25:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:25:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:25:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:25:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:25:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 17:25:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 17:25:22 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691601907.1051855, 61c61e32-848f-4cd4-847a-6760c6561220 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 17:25:22 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] VM Stopped (Lifecycle Event)
Aug 09 17:25:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-64a795a2-b0cc-41cb-b76c-b762825806d2 None None] [instance: 61c61e32-848f-4cd4-847a-6760c6561220] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 17:25:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:25:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:25:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:25:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:25:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:25:38 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:25:38 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:25:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 17:25:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:25:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:25:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:25:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:25:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:25:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:25:44 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:25:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:25:50 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:25:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 17:25:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 17:25:50 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 17:25:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:25:52 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:25:53 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:25:53 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:25:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:25:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:25:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:25:53 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 17:25:54 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:25:54 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 17:25:54 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Hypervisor/Node resource view: name=user free_ram=8955MB free_disk=25.08868408203125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 17:25:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 17:25:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 17:25:54 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 17:25:54 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 17:25:54 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed in ProviderTree for provider: acad0a00-fc5f-4423-bdc7-4d5877e83b16 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 17:25:54 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Inventory has not changed for provider acad0a00-fc5f-4423-bdc7-4d5877e83b16 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 17:25:54 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 17:25:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=73091) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 17:25:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:25:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:25:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:25:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:25:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:25:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:25:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:25:59 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:26:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:26:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:26:02 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:26:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:26:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:26:11 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-ec5b90d1-9ef4-492c-9592-0ed22a2d862c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 17:26:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:26:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:26:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:26:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:26:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:26:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:26:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:26:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 17:26:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 17:26:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 17:26:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:26:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 17:26:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73091) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}